Re: Bottlenecks with large number of relation segment files - Mailing list pgsql-general

From Florian Weimer
Subject Re: Bottlenecks with large number of relation segment files
Date
Msg-id 5200DBDB.4010906@redhat.com
Whole thread Raw
In response to Re: Bottlenecks with large number of relation segment files  (KONDO Mitsumasa <kondo.mitsumasa@lab.ntt.co.jp>)
Responses Re: Bottlenecks with large number of relation segment files  (KONDO Mitsumasa <kondo.mitsumasa@lab.ntt.co.jp>)
List pgsql-general
On 08/06/2013 12:28 PM, KONDO Mitsumasa wrote:
> (2013/08/05 20:38), Florian Weimer wrote:
>> On 08/05/2013 10:42 AM, John R Pierce wrote:
>>> On 8/5/2013 1:01 AM, KONDO Mitsumasa wrote:
>>>> When we open file, ext3 or ext4 file system seems to sequential search
>>>> inode for opening file in file directory.
>>>
>>> no, ext3/4 uses H-tree structures to search directories over 1 block
>>> long quite efficiently.
>>
>> And the Linux dentry cache is rather aggressive, so most of the time,
>> only the
>> in-memory hash table will be consulted.  (The dentry cache only gets
>> flushed on
>> severe memory pressure.)

> Are you really? When I put large number of files in same directory and
> open, it is very very slow. But open directory is not.

The first file name resolution is slow, but subsequent resolutions
typically happen from the dentry cache.  (The cache is not populated
when the directory is opened.)

--
Florian Weimer / Red Hat Product Security Team


pgsql-general by date:

Previous
From: "ascot.moss@gmail.com"
Date:
Subject: Re: psql: FATAL: the database system is starting up
Next
From: KONDO Mitsumasa
Date:
Subject: Re: Bottlenecks with large number of relation segment files