RE: parallel data loading for pgbench -i - Mailing list pgsql-hackers

From Hayato Kuroda (Fujitsu)
Subject RE: parallel data loading for pgbench -i
Date
Msg-id OS9PR01MB12149E0E2CAAB378D264A35B1F5242@OS9PR01MB12149.jpnprd01.prod.outlook.com
Whole thread Raw
In response to Re: parallel data loading for pgbench -i  (Mircea Cadariu <cadariu.mircea@gmail.com>)
Responses Re: parallel data loading for pgbench -i
List pgsql-hackers
Dear Mircea,

Thanks for updating the patch. Now each worker looks like not to create each
child tables, just run TRUNCATE and COPY. But I'm unclear why the TRUNCATE is
needed here. Isn't they truncated in initGenerateDataClientSide()->initTruncateTables()
before launching threads?
Also, the current API is questionable. E.g., we cannot work in series if --partition is
specified. And I'm afraid OOM failure may be more likely to happen if the table has
many partitions.
Is it possible that we can have -p again for the initialization? We can require
partitions >= nthreads or partitions % nthreads == 0 at that time.


Best regards,
Hayato Kuroda
FUJITSU LIMITED


pgsql-hackers by date:

Previous
From: Chao Li
Date:
Subject: Re: Bug: Rule actions see wrong values for generated columns (NEW.gen reads OLD value)
Next
From: SATYANARAYANA NARLAPURAM
Date:
Subject: Re: Bug: Rule actions see wrong values for generated columns (NEW.gen reads OLD value)