Thread: can postgresql handle these large tables

can postgresql handle these large tables

From
Dino Vliet
Date:
Hi folks,
I'm busy with analyzing some data and therefore will
have to store 2 big tables containing 50 million obs &
25 million obs. Selecting some interesting obs can
decrease these tables with maybe a factor 10 but
eventually I will have to combine them using a join.
These tables contain almost 20 colums and after
selecting the appropriate ones I will have maybe 10
colums.

Off course I will have to make use of indexes and try
to optimize the settings in postgresql.conf file like:

geqo=true
geqo_treshold=11
geqo_effort= 1
geqo_generations=5

But my main question is whether postgresql will be
able to handle these large volumes of data, or should
I ask whether my hardware will be capable of working
with these large tables.

Answers, Ideas, remarks...everything is welcome folks,
Many thanks in advance, it is MUCH appreciated what is
done in this list!!






__________________________________
Do you Yahoo!?
Yahoo! Mail - Helps protect you from nasty viruses.
http://promotions.yahoo.com/new_mail

Re: can postgresql handle these large tables

From
Gaetano Mendola
Date:
Dino Vliet wrote:
> Hi folks,
> I'm busy with analyzing some data and therefore will
> have to store 2 big tables containing 50 million obs &
> 25 million obs. Selecting some interesting obs can
> decrease these tables with maybe a factor 10 but
> eventually I will have to combine them using a join.
> These tables contain almost 20 colums and after
> selecting the appropriate ones I will have maybe 10
> colums.
>
> Off course I will have to make use of indexes and try
> to optimize the settings in postgresql.conf file like:
>
> geqo=true
> geqo_treshold=11
> geqo_effort= 1
> geqo_generations=5

These value will affect only if you join more then "geqo_threshold"
tables, it doesn't depend on the number of column and/or
rows number.


Regards
Gaetano Mendola