From: Bruce Momjian
Subject: Re: SSD + RAID
Date: ,
Msg-id: 200911300309.nAU39j318088@momjian.us
(view: Whole thread, Raw)
In response to: Re: SSD + RAID  (Ron Mayer)
Responses: Re: SSD + RAID  (Greg Smith)
Re: SSD + RAID  (Ron Mayer)
List: pgsql-performance

Tree view

SSD + RAID  (Laszlo Nagy, )
 Re: SSD + RAID  (Karl Denninger, )
  Re: SSD + RAID  (Laszlo Nagy, )
   Re: SSD + RAID  (Axel Rau, )
    Re: SSD + RAID  (Richard Neill, )
     Re: SSD + RAID  (Greg Smith, )
      Re: SSD + RAID  (Merlin Moncure, )
  Re: SSD + RAID  (Marcos Ortiz Valmaseda, )
 Re: SSD + RAID  (Scott Marlowe, )
  Re: SSD + RAID  (Merlin Moncure, )
   Re: SSD + RAID  (Scott Carey, )
    Re: SSD + RAID  (Merlin Moncure, )
 Re: SSD + RAID  (Heikki Linnakangas, )
  Re: SSD + RAID  (Merlin Moncure, )
   Re: SSD + RAID  (Heikki Linnakangas, )
    Re: SSD + RAID  (Merlin Moncure, )
     Re: SSD + RAID  (Heikki Linnakangas, )
      Re: SSD + RAID  (Merlin Moncure, )
  Re: SSD + RAID  (Laszlo Nagy, )
   Re: SSD + RAID  (Robert Haas, )
    Re: SSD + RAID  (Laszlo Nagy, )
 Re: SSD + RAID  (Greg Smith, )
  Re: SSD + RAID  (Karl Denninger, )
   Re: SSD + RAID  (Greg Smith, )
    Re: SSD + RAID  (Karl Denninger, )
     Re: SSD + RAID  (Scott Carey, )
      Re: SSD + RAID  (Tom Lane, )
       Re: SSD + RAID  (Jeff Janes, )
      Re: SSD + RAID  (Greg Smith, )
       Re: SSD + RAID  (Karl Denninger, )
    Re: SSD + RAID  (Brad Nicholson, )
     Re: SSD + RAID  (Dave Crooke, )
     Re: SSD + RAID  (Greg Smith, )
      Re: SSD + RAID  (Merlin Moncure, )
      Re: SSD + RAID  (Merlin Moncure, )
       Re: SSD + RAID  (Brad Nicholson, )
        Re: SSD + RAID  (Scott Marlowe, )
       Re: SSD + RAID  (Peter Eisentraut, )
       Re: SSD + RAID  (Greg Smith, )
        Re: SSD + RAID  (Merlin Moncure, )
         Re: SSD + RAID  (Greg Smith, )
          Re: SSD + RAID  (, )
           Re: SSD + RAID  (Scott Carey, )
            Re: SSD + RAID  (Merlin Moncure, )
             Re: SSD + RAID  (Scott Marlowe, )
              Re: SSD + RAID  (Greg Smith, )
               Re: SSD + RAID  (Merlin Moncure, )
                Re: SSD + RAID  (Scott Marlowe, )
        Re: SSD + RAID  (Mark Mielke, )
        Re: SSD + RAID  (Scott Carey, )
         Re: SSD + RAID  (Greg Smith, )
        Re: SSD + RAID  (Bruce Momjian, )
         Re: SSD + RAID  (Ron Mayer, )
          Re: SSD + RAID  (Bruce Momjian, )
           Re: SSD + RAID  (Greg Smith, )
            Re: SSD + RAID  (Bruce Momjian, )
             Re: SSD + RAID  (Ron Mayer, )
              Re: SSD + RAID  (Bruce Momjian, )
           Re: SSD + RAID  (Ron Mayer, )
  Re: SSD + RAID  (Merlin Moncure, )
  Re: SSD + RAID  (Matthew Wakeling, )
   Re: SSD + RAID  (Bruce Momjian, )
    Re: SSD + RAID  (Dan Langille, )
     Re: SSD + RAID  (Bruce Momjian, )
      Re: SSD + RAID  (Scott Carey, )
       Re: SSD + RAID  (Bruce Momjian, )
        Re: SSD + RAID  (Ron Mayer, )
         Re: SSD + RAID  (Greg Smith, )
          Re: SSD + RAID  (Arjen van der Meijden, )
           Re: SSD + RAID  (Greg Smith, )
            Re: SSD + RAID  (Mark Mielke, )
             Re: SSD + RAID  (Greg Smith, )
              Re: SSD + RAID  (Scott Marlowe, )
               Re: SSD + RAID  (Scott Marlowe, )
                Re: SSD + RAID  ("Pierre C", )
                 Re: SSD + RAID  (Nikolas Everett, )
                 Re: SSD + RAID  (Scott Carey, )
          Re: SSD + RAID  (Bruce Momjian, )
           Re: SSD + RAID  (Ron Mayer, )
            Re: SSD + RAID  (Greg Smith, )
            Re: SSD + RAID  (, )
             Re: SSD + RAID  (, )
              Re: SSD + RAID  (Aidan Van Dyk, )
               Re: SSD + RAID  (, )
                Re: SSD + RAID  (Mark Mielke, )
                Re: SSD + RAID  (Dave Crooke, )
          Re: SSD + RAID  (Bruce Momjian, )
           Re: SSD + RAID  (Greg Smith, )
            Re: SSD + RAID  (Bruce Momjian, )
             Re: SSD + RAID  (Ron Mayer, )
              Re: SSD + RAID  (Greg Smith, )
               Re: SSD + RAID  (Bruce Momjian, )
              Re: SSD + RAID  (Bruce Momjian, )
               Re: SSD + RAID  (Greg Smith, )
                Re: SSD + RAID  (Ron Mayer, )
               Re: SSD + RAID  ("Pierre C", )
         Re: SSD + RAID  (Bruce Momjian, )
 Re: SSD + RAID  ("Fernando Hevia", )
  Re: SSD + RAID  (Greg Smith, )
 Re: SSD + RAID  ("Kenny Gorman", )
  Re: SSD + RAID  (Kenny Gorman, )
 Re: SSD + RAID  (Lists, )
  Re: SSD + RAID  (Ivan Voras, )
   Re: SSD + RAID  (Laszlo Nagy, )
    Re: SSD + RAID  (Craig Ringer, )
     Re: SSD + RAID  (Laszlo Nagy, )
      Re: SSD + RAID  (Craig Ringer, )
       Re: SSD + RAID  (Laszlo Nagy, )
     Re: SSD + RAID  (Craig James, )
      Re: SSD + RAID  (Heikki Linnakangas, )
     Re: SSD + RAID  (Scott Carey, )
      Re: SSD + RAID  (Craig Ringer, )
       Re: SSD + RAID  (Anton Rommerskirchen, )
        Re: SSD + RAID  (Brad Nicholson, )
      Re: SSD + RAID  (Greg Smith, )
       Re: SSD + RAID  (Matthew Wakeling, )
       Re: SSD + RAID  (Scott Carey, )

Ron Mayer wrote:
> Bruce Momjian wrote:
> > Greg Smith wrote:
> >> A good test program that is a bit better at introducing and detecting
> >> the write cache issue is described at
> >> http://brad.livejournal.com/2116715.html
> >
> > Wow, I had not seen that tool before.  I have added a link to it from
> > our documentation, and also added a mention of our src/tools/fsync test
> > tool to our docs.
>
> One challenge with many of these test programs is that some
> filesystem (ext3 is one) will flush drive caches on fsync()
> *sometimes, but not always.   If your test program happens to do
> a sequence of commands that makes an fsync() actually flush a
> disk's caches, it might mislead you if your actual application
> has a different series of system calls.
>
> For example, ext3 fsync() will issue write barrier commands
> if the inode was modified; but not if the inode wasn't.
>
> See test program here:
> http://www.mail-archive.com//msg272253.html
> and read two paragraphs further to see how touching
> the inode makes ext3 fsync behave differently.

I thought our only problem was testing the I/O subsystem --- I never
suspected the file system might lie too.  That email indicates that a
large percentage of our install base is running on unreliable file
systems --- why have I not heard about this before?  Do the write
barriers allow data loss but prevent data inconsistency?  It sound like
they are effectively running with synchronous_commit = off.

--
  Bruce Momjian  <>        http://momjian.us
  EnterpriseDB                             http://enterprisedb.com

  + If your life is a hard drive, Christ can be your backup. +


pgsql-performance by date:

From: Greg Smith
Date:
Subject: Re: SSD + RAID
From: Ivan Voras
Date:
Subject: Re: Any have tested ZFS like PostgreSQL installation filesystem?