Speedier count(*) - Mailing list pgsql-performance

From Dan Harris
Subject Speedier count(*)
Date
Msg-id 3E43C7D5-9DB8-4132-BF4F-607B000866E1@drivefaster.net
Whole thread Raw
Responses Re: Speedier count(*)  ("Joshua D. Drake" <jd@commandprompt.com>)
Re: Speedier count(*)  (Michael Fuhr <mike@fuhr.org>)
Re: Speedier count(*)  (John A Meinel <john@arbash-meinel.com>)
Re: Speedier count(*)  (Gavin Sherry <swm@alcove.com.au>)
List pgsql-performance
I have a web page for my customers that shows them count of records
and some min/max date ranges in each table of a database, as this is
how we bill them for service.  They can log in and check the counts
at any time.  I'd like for the counts to be as fresh as possible by
keeping this dynamic, but I will use a periodic 'snapshot'/cron job
if that is the only option to speed this up.   I have thought about
using the table statistics, but the estimate error is probably
unacceptable because of the billing purposes.

For some reason, the SQL Server we migrated the app from can return
count(*) in a split second on multi-million row tables, even though
it is a MUCH slower box hardware-wise, but it's now taking many
seconds to run. I have read in the archives the problems MVCC brings
into the count(*) dilemma forcing Pg to run a seq scan to get
counts.  Does SQLServer not use MVCC or have they found another
approach for arriving at this number?  Compounding all the min/max
and counts from other tables and all those queries take about a
minute to run. The tables will contain anywhere from 1 million to 40
million rows.

Also, I am using "select ... group by ... order by .. limit 1" to get
the min/max since I have already been bit by the issue of min() max()
being slower.


-Dan



pgsql-performance by date:

Previous
From: Tom Lane
Date:
Subject: Re: Planner doesn't look at LIMIT?
Next
From: "Joshua D. Drake"
Date:
Subject: Re: Speedier count(*)