Postgres Pro
Downloads
Home   >   mailing lists

Re: Parallel GiST build on Cube - Mailing list pgsql-hackers

From Darafei "Komяpa" Praliaskouski
Subject Re: Parallel GiST build on Cube
Date
Msg-id CAC8Q8t+2YFhgu=Poj0ynz92MqRSP_6UDxhKSf0LQ_YarkA83ow@mail.gmail.com
Whole thread Raw
In response to Parallel GiST build on Cube  (Shyam Saladi <saladi@caltech.edu>)
List pgsql-hackers
Tree view
Hello,

These things for GIST I know that can help:
 - Fast sorting GIST build commitfest entry by Andrey Borodin, not parallel but faster - https://www.postgresql.org/message-id/flat/1A36620E-CAD8-4267-9067-FB31385E7C0D%40yandex-team.ru 
 - Fast sorting GIST build by Nikita Glukhov, reuses btree code so also parallel - https://github.com/postgres/postgres/compare/master...glukhovn:gist_btree_build 

These are very wanted for PostGIS which also indexes everything by 2-4 dimensional cubes and require improvements in core infrastructure and opclass.




On Mon, Apr 27, 2020 at 8:57 PM Shyam Saladi <saladi@caltech.edu> wrote:
Hello --

I regularly build GiST indexes on large databases. In recent times, as the size of the database has ballooned (30 million rows) along with the build time on a column of points in 3- and 8-dimensional space (0-volume cube). 

Is anyone working on (or already implemented) a parallel GiST build on Cube? If not, I'd like to try contributing this--any pointers from folks familiar with the backend of Cube? Any input would be great.

Thanks,
Shyam

--
NSF Graduate Research Fellow - Clemons Lab
Biochemistry and Molecular Biophysics
California Institute of Technology


--
Darafei Praliaskouski

pgsql-hackers by date:

Previous
From: Robert Haas
Date:
Subject: Re: tar-related code in PostgreSQL
Next
From: Alvaro Herrera
Date:
Subject: Re: [HACKERS] Restricting maximum keep segments by repslots