Re: Why we are going to have to go DirectIO - Mailing list pgsql-hackers

From Josh Berkus
Subject Re: Why we are going to have to go DirectIO
Date
Msg-id 529E2FC1.7030303@agliodbs.com
Whole thread Raw
In response to Why we are going to have to go DirectIO  (Josh Berkus <josh@agliodbs.com>)
Responses Re: Why we are going to have to go DirectIO
List pgsql-hackers
On 12/03/2013 10:59 AM, Joshua D. Drake wrote:
> This seems rather half cocked. I read the article. They found a problem,
> that really will only affect a reasonably small percentage of users,
> created a test case, reported it, and a patch was produced.

"Users with at least one file bigger than 50% of RAM" is unlikely to be
a small percentage.

> 
> Kind of like how we do it.

I like to think we'd have at least researched the existing literature on
2Q algorithms (which is extensive) before implementing our own.  Oh,
wait, we *did*.  Nor is this the first ill-considered performance hack
pushed into mainline kernels without any real testing.  It's not even
the first *that year*.

While I am angry over this -- no matter what Kernel.org fixes now, we're
going to have to live with their mistake for 3 years -- the DirectIO
thing isn't just me; when I've gone to Linux Kernel events to talk about
IO, that's the response I've gotten from most Linux hackers: "you
shouldn't be using the filesystem, use DirectIO and implement your own
storage."

That's why they don't feel that it's a problem to break the IO stack;
they really don't believe that anyone who cares about performance should
be using it.

-- 
Josh Berkus
PostgreSQL Experts Inc.
http://pgexperts.com



pgsql-hackers by date:

Previous
From: Pavel Stehule
Date:
Subject: Re: Problem with displaying "wide" tables in psql
Next
From: Stephen Frost
Date:
Subject: Re: Extension Templates S03E11