Thread: force defaults
Hi,
I want to force deafults, and wonder about the performance.
The trigger i use (below) makes the query (also below) take 45% more time.
The result is the same now, but i do have a use for using the trigger (see "background info").
Isn't there a more efficient way to force the defaults (in the database) when the application layer explicitly inserts a NULL?
Cheers,
WBL
<backgorund info>
I'm building an application where users can upload data to a database, with a website as a gui.
In the legacy database that we're "pimping", some attributes are optional, but there are also codes that explicitly mark the attribute as 'Unknown' in the same field.
That would mean that there are 2 things that mean the same thing: NULL and 'U' for unknown.
I don't want to bother our customer with the NULL issues in queries, so i would like to make those fields NOT NULL.
The users will use an Excel or CSV form to upload the data and they can just leave a blank for the optional fields if they like.
We'll use php to insert the data in a table, from which we'll check if the input satisfies our demands before inserting into the actual tables that matter.
When the users leave a blank, php is bound to insert a NULL (or even an empty string) into the upload table.
I want to use a default, even if php explicitly inserts a NULL.
</backgorund info>
--the TRIGGER
create or replace function force_defaults () returns trigger as $$
begin
new.val:=coalesce(new.val, 'U');
return new;
end;
$$ language plpgsql;
--the QUERIES (on my laptop, no postgres config, pg 9.1):
create table accounts (like pgbench_accounts including all);
--(1)
alter table accounts add column val text default 'U';
insert into accounts(aid, bid, abalance, filler) select * from pgbench_accounts;
INSERT 0 50000000
Time: 538760.542 ms
--(2)
alter table accounts alter column val set default null;
create trigger bla before insert or update on accounts for each row ...etc
vacuum accounts;
insert into accounts(aid, bid, abalance, filler) select * from pgbench_accounts;
INSERT 0 50000000
Time: 780421.041 ms
--
"Quality comes from focus and clarity of purpose" -- Mark Shuttleworth
I want to force deafults, and wonder about the performance.
The trigger i use (below) makes the query (also below) take 45% more time.
The result is the same now, but i do have a use for using the trigger (see "background info").
Isn't there a more efficient way to force the defaults (in the database) when the application layer explicitly inserts a NULL?
Cheers,
WBL
<backgorund info>
I'm building an application where users can upload data to a database, with a website as a gui.
In the legacy database that we're "pimping", some attributes are optional, but there are also codes that explicitly mark the attribute as 'Unknown' in the same field.
That would mean that there are 2 things that mean the same thing: NULL and 'U' for unknown.
I don't want to bother our customer with the NULL issues in queries, so i would like to make those fields NOT NULL.
The users will use an Excel or CSV form to upload the data and they can just leave a blank for the optional fields if they like.
We'll use php to insert the data in a table, from which we'll check if the input satisfies our demands before inserting into the actual tables that matter.
When the users leave a blank, php is bound to insert a NULL (or even an empty string) into the upload table.
I want to use a default, even if php explicitly inserts a NULL.
</backgorund info>
--the TRIGGER
create or replace function force_defaults () returns trigger as $$
begin
new.val:=coalesce(new.val, 'U');
return new;
end;
$$ language plpgsql;
--the QUERIES (on my laptop, no postgres config, pg 9.1):
create table accounts (like pgbench_accounts including all);
--(1)
alter table accounts add column val text default 'U';
insert into accounts(aid, bid, abalance, filler) select * from pgbench_accounts;
INSERT 0 50000000
Time: 538760.542 ms
--(2)
alter table accounts alter column val set default null;
create trigger bla before insert or update on accounts for each row ...etc
vacuum accounts;
insert into accounts(aid, bid, abalance, filler) select * from pgbench_accounts;
INSERT 0 50000000
Time: 780421.041 ms
--
"Quality comes from focus and clarity of purpose" -- Mark Shuttleworth
On 12 September 2012 08:49, Willy-Bas Loos <willybas@gmail.com> wrote:
Perhaps a rewrite-rule on INSERT/UPDATE would serve your purpose better? You could just wrap the appropriate column with a coalesce-call, like you did in your trigger.
Even then, calling coalesce for each inserted/updated row is not free, of course.
You could also perform the replacing of NULL values in your PHP application. Probably better to handle this case in the database though.
-- Hi,
I want to force deafults, and wonder about the performance.
The trigger i use (below) makes the query (also below) take 45% more time.
The result is the same now, but i do have a use for using the trigger (see "background info").
Isn't there a more efficient way to force the defaults (in the database) when the application layer explicitly inserts a NULL?
Perhaps a rewrite-rule on INSERT/UPDATE would serve your purpose better? You could just wrap the appropriate column with a coalesce-call, like you did in your trigger.
Even then, calling coalesce for each inserted/updated row is not free, of course.
You could also perform the replacing of NULL values in your PHP application. Probably better to handle this case in the database though.
If you can't see the forest for the trees,
Cut the trees and you'll see there is no forest.
<meta content="text/html; charset=ISO-8859-1" http-equiv="Content-Type"> body p { margin-bottom: 0cm; margin-top: 0pt; } <body style="direction: ltr;" bidimailui-detected-decoding-type="latin-charset" text="#000000" bgcolor="#FFFFFF"> I haven't checked more recent versions, but in 8.2 using case when new.val is null then 'U' else new.val end worked a hell of a lot faster then coalesce. However, just going into the trigger is significant overhead. Alban's suggestion of using a rule would work as well. If you don't need the value in real time, you can either have a cron job update all the wrong values on a regular basis or using listen/notify you can get it close to real time. Sim On 09/12/2012 09:49 AM, Willy-Bas Loos wrote: <blockquote cite="mid:CAHnozTjpO3Yn9VfcAdZYj6A1tPkAOC26HFnsvL2mosHi6189sw@mail.gmail.com" type="cite">Hi, I want to force deafults, and wonder about the performance. The trigger i use (below) makes the query (also below) take 45% more time. The result is the same now, but i do have a use for using the trigger (see "background info"). Isn't there a more efficient way to force the defaults (in the database) when the application layer explicitly inserts a NULL? Cheers, WBL <backgorund info> I'm building an application where users can upload data to a database, with a website as a gui. In the legacy database that we're "pimping", some attributes are optional, but there are also codes that explicitly mark the attribute as 'Unknown' in the same field. That would mean that there are 2 things that mean the same thing: NULL and 'U' for unknown. I don't want to bother our customer with the NULL issues in queries, so i would like to make those fields NOT NULL. The users will use an Excel or CSV form to upload the data and they can just leave a blank for the optional fields if they like. We'll use php to insert the data in a table, from which we'll check if the input satisfies our demands before inserting into the actual tables that matter. When the users leave a blank, php is bound to insert a NULL (or even an empty string) into the upload table. I want to use a default, even if php explicitly inserts a NULL. </backgorund info> --the TRIGGER create or replace function force_defaults () returns trigger as $$ begin new.val:=coalesce(new.val, 'U'); return new; end; $$ language plpgsql; --the QUERIES (on my laptop, no postgres config, pg 9.1): create table accounts (like pgbench_accounts including all); --(1) alter table accounts add column val text default 'U'; insert into accounts(aid, bid, abalance, filler) select * from pgbench_accounts; INSERT 0 50000000 Time: 538760.542 ms --(2) alter table accounts alter column val set default null; create trigger bla before insert or update on accounts for each row ...etc vacuum accounts; insert into accounts(aid, bid, abalance, filler) select * from pgbench_accounts; INSERT 0 50000000 Time: 780421.041 ms <img moz-do-not-send="true" class="ajT" src="https://mail.google.com/mail/u/0/images/cleardot.gif"> -- "Quality comes from focus and clarity of purpose" -- Mark Shuttleworth