Re: fallocate / posix_fallocate for new WAL file creation (etc...) - Mailing list pgsql-hackers

From David Fetter
Subject Re: fallocate / posix_fallocate for new WAL file creation (etc...)
Date
Msg-id 20130514024137.GA24304@fetter.org
Whole thread Raw
In response to fallocate / posix_fallocate for new WAL file creation (etc...)  (Jon Nelson <jnelson+pgsql@jamponi.net>)
List pgsql-hackers
On Mon, May 13, 2013 at 08:54:39PM -0500, Jon Nelson wrote:
> Pertinent to another thread titled
> [HACKERS] corrupt pages detected by enabling checksums
> I hope to explore the possibility of using fallocate (or
> posix_fallocate) for new WAL file creation.
> 
> Most modern Linux filesystems support fast fallocate/posix_fallocate,
> reducing extent fragmentation (where extents are used) and frequently
> offering a pretty significant speed improvement. In my tests, using
> posix_fallocate (followed by pg_fsync) is at least 28 times quicker
> than using the current method (which writes zeroes followed by
> pg_fsync).
> 
> I have written up a patch to use posix_fallocate in new WAL file
> creation, including configuration by way of a GUC variable, but I've
> not contributed to the PostgreSQL project before. Therefore, I'm
> fairly certain the patch is not formatted properly or conforms to the
> appropriate style guides. Currently, the patch is based on 9.2, and is
> quite small in size - 3.6KiB.
> 
> Advice on how to proceed is appreciated.

Thanks for hopping in!

Please re-base the patch vs. git master, as new features like this go
there.  Please also to send along the tests you're doing so others can
riff.  Tests that find any weak points are also good.

Cheers,
David.
-- 
David Fetter <david@fetter.org> http://fetter.org/
Phone: +1 415 235 3778  AIM: dfetter666  Yahoo!: dfetter
Skype: davidfetter      XMPP: david.fetter@gmail.com
iCal: webcal://www.tripit.com/feed/ical/people/david74/tripit.ics

Remember to vote!
Consider donating to Postgres: http://www.postgresql.org/about/donate



pgsql-hackers by date:

Previous
From: Tom Lane
Date:
Subject: Re: commit fest schedule for 9.4
Next
From: Andrew Dunstan
Date:
Subject: Re: PostgreSQL 9.3 beta breaks some extensions "make install"