Re: Slow response if pulling through pgadmin - Mailing list pgsql-general

From Mammarelli, Joanne T
Subject Re: Slow response if pulling through pgadmin
Date
Msg-id 2A9DC32516465540A0B1D37D25D6EF9A04149BECEB@FHDP1LUMXC7V12.us.one.verizon.com
Whole thread Raw
In response to Re: Slow response if pulling through pgadmin  (Melvin Davidson <melvin6925@gmail.com>)
Responses Re: Slow response if pulling through pgadmin  (Adrian Klaver <adrian.klaver@aklaver.com>)
List pgsql-general
Ok . thanks .. this is our first foray into postgresql and we were  comparing retrieve times based on the 'normal'
MicrosoftSQL environment to ensure that we were at least functioning properly.
 

Long term, our goal is to restructure that table into a star-schema/mdm type format to ease the maintenance.

In your opinion, would we see the benefit of moving to a postgresql environment by restructuring the 80 column table
intoa star-schema?
 

Joanne


-----Original Message-----
From: Melvin Davidson [mailto:melvin6925@gmail.com] 
Sent: Tuesday, November 10, 2015 11:16 AM
To: Jim Nasby
Cc: Mammarelli, Joanne T; pgsql-general@postgresql.org
Subject: Re: [GENERAL] Slow response if pulling through pgadmin

I would also like to add that I am very suspicious of a table with 80 columns.
Offhand, it sounds like poor database design where someone was trying to put all the eggs in one basket
(figuratively).

Further, what was the exact query?
Queries of the form SELECT * will always be inherently slow with tables that have many columns. Ideally, you only want
toselect just the columns that are needed.
 

On 11/10/15, Jim Nasby <Jim.Nasby@bluetreble.com> wrote:
> On 11/10/15 9:39 AM, Mammarelli, Joanne T wrote:
>> Hi – same rookie user as before.
>>
>> We have one table
>>
>> 100,000 rows
>>
>> 80 columns
>>
>> When we try to retrieve the data (select * from table) using pgadmin, 
>> we get a 193456 ms retrieve time.
>>
>> When I ran a query analyze in the command prompt, we get a 316ms 
>> retrieve time.
>
> You mean EXPLAIN ANALYZE?
>
>> .. and finally.  When we retrieve the data from the command line, we 
>> get a 5720 ms retrieve time.
>
> What was psql doing with the output?
>
> Basically, pgAdmin and psql aren't meant for users to deal with huge 
> data sets, because humans don't deal well with huge data sets.
> --
> Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts 
> in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it 
> in Treble! http://BlueTreble.com
>
>
> --
> Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To 
> make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-general
>


--
*Melvin Davidson*
I reserve the right to fantasize.  Whether or not you wish to share my fantasy is entirely up to you.

pgsql-general by date:

Previous
From: Melvin Davidson
Date:
Subject: Re: Slow response if pulling through pgadmin
Next
From: Adrian Klaver
Date:
Subject: Re: Slow response if pulling through pgadmin