Re: external sort performance - Mailing list pgsql-performance

From Jeremy Harris
Subject Re: external sort performance
Date
Msg-id 4EC926C9.1030409@wizmail.org
Whole thread Raw
In response to Re: external sort performance  (Jon Nelson <jnelson+pgsql@jamponi.net>)
List pgsql-performance
On 2011-11-20 15:00, Jon Nelson wrote:
>  Do you happen to recall if disk I/O is
> counted as user or system time?

Neither, traditionally.  Those times are cpu times;
they only account for what the cpu was doing.
The disks could be working in parallel as a result
of cpu actions, and probably were - but the software
found work to do for the cpu.   You'd want to be
looking at iostat during the run to see how busy the
disks were.

As to why it takes 16 hours cpu to do the external
version but only 34 minutes for internal - some of that
will be down to data-shuffling in- and out- of disk files
which is nonetheless accounted to user-mode cpu time,
but some will be the plain inefficiency of the external
version having to effectively do work over many times
because it can't have a complete view of the problem at
hand at any one time.

--
Jeremy

pgsql-performance by date:

Previous
From: Jon Nelson
Date:
Subject: Re: external sort performance
Next
From: Rauan Maemirov
Date:
Subject: Re: Problems with FTS