avoiding tuple copying in btree index builds - Mailing list pgsql-hackers

From Robert Haas
Subject avoiding tuple copying in btree index builds
Date
Msg-id CA+TgmobG=TfNiZFnVgmFqan9SS_rESCrwLAxqhcfLu+VXqQtzA@mail.gmail.com
Whole thread Raw
Responses Re: avoiding tuple copying in btree index builds  (Andres Freund <andres@2ndquadrant.com>)
List pgsql-hackers
Hi,

Today, I discovered that when building a btree index, the btree code
uses index_form_tuple() to create an index tuple from the heap tuple,
calls tuplesort_putindextuple() to copy that tuple into the sort's
memory context, and then frees the original one it built.  This seemed
inefficient, so I wrote a patch to eliminate the tuple copying.  It
works by adding a function tuplesort_putindextuplevalues(), which
builds the tuple in the sort's memory context and thus avoids the need
for a separate copy.  I'm not sure if that's the best approach, but
the optimization seems wortwhile.

I tested it by repeatedly executing "REINDEX INDEX
pgbench_accounts_pkey" on a PPC64 machine.  pgbench_accounts contains
10 million records.  With unpatched master as of
b2f7bd72c4d3e80065725c72e85778d5f4bdfd4a, I got times of 6.159s,
6.177s, and 6.201s.  With the attached patch, I got times of 5.787s,
5.972s, and 5.913s, a savings of almost 5%.  Not bad considering the
amount of work involved.

--
Robert Haas
EnterpriseDB: http://www.enterprisedb.com
The Enterprise PostgreSQL Company

Attachment

pgsql-hackers by date:

Previous
From: Fabrízio de Royes Mello
Date:
Subject: Re: TABLESPACE and directory for Foreign tables?
Next
From: Andres Freund
Date:
Subject: Re: New and interesting replication issues with 9.2.8 sync rep