parallelisation provides postgres performance (script example + ppt slides) - Mailing list pgsql-performance

From Graeme B. Bell
Subject parallelisation provides postgres performance (script example + ppt slides)
Date
Msg-id 5DDC27B4-20CF-412F-B13F-FBFD3E522F9B@skogoglandskap.no
Whole thread Raw
List pgsql-performance
Hi all,

1. For those that don't like par_psql (http://github.com/gbb/par_psql), here's an alternative approach that uses the
GnuParallel command to organise parallelism for queries that take days to run usually. Short script and GIS-focused,
butmay give you a few ideas about how to parallelise your own code with Gnu Parallel.  

https://github.com/gbb/fast_map_intersection


2. Also, I gave a talk at FOSS4G Como about these tools, and how to get better performance from your DB with
parallelisation.May be helpful to people who are new to parallelisation / multi-core work with postgres.  

http://graemebell.net/foss4gcomo.pdf


Graeme Bell.

p.s.  (this version of the slides still has a few typos, which will be fixed soon when I get the source ppts back from
mycolleague's laptop). 

pgsql-performance by date:

Previous
From: "Graeme B. Bell"
Date:
Subject: Re: hyperthreadin low performance (and some discussion about benchmarking)
Next
From: Laurent Debacker
Date:
Subject: bitmap heap scan recheck for gin/fts with no lossy blocks