Re: monitoring CREATE INDEX [CONCURRENTLY] - Mailing list pgsql-hackers
| From | Alvaro Herrera |
|---|---|
| Subject | Re: monitoring CREATE INDEX [CONCURRENTLY] |
| Date | |
| Msg-id | 20190329151244.GA28626@alvherre.pgsql Whole thread Raw |
| In response to | Re: monitoring CREATE INDEX [CONCURRENTLY] (Alvaro Herrera <alvherre@2ndquadrant.com>) |
| List | pgsql-hackers |
On 2019-Mar-29, Alvaro Herrera wrote:
> I just noticed that the CLUSTER calls index_build, which my patch
> modifies to include additional progress metrics; this means that during
> the index build phase, the metrics set by CLUSTER will be trashed by the
> ones my patch introduces.
Indeed:
pid | datid | datname | relid | command | phase | cluster_index_relid | heap_tuples_scanned |
heap_tuples_written| heap_blks_total | heap_blks_scanned | index_rebuild_count
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 162402 |
162402 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 460362 |
460362 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 754004 |
754004 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 1047058 |
1047058 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 1356296 |
1356296 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 1645321 |
1645321 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 1939920 |
1939920 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 2227450 |
2227450 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 2526116 |
2526116 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 2828468 |
2828468 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 3142982 |
3142982 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 3451494 |
3451494 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 3769799 |
3769799 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 4077513 |
4077513 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 4383255 |
4383255 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 4700286 |
4700286 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 5015468 |
5015468 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 5324951 |
5324951 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 5628172 |
5628172 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 5940862 |
5940862 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 6253778 |
6253778 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 6560474 |
6560474 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 6881248 |
6881248 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 7186555 |
7186555 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 7503888 |
7503888 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 7821706 |
7821706 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 8137334 |
8137334 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 8453280 |
8453280 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 8764097 |
8764097 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 9079908 |
9079908 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 9389465 |
9389465 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 9706288 |
9706288 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 10024875 |
10024875 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 10344875 |
10344875 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 10658531 |
10658531 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 10974097 |
10974097 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 11289868 |
11289868 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 11602965 |
11602965 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 11917624 |
11917624 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 12237998 |
12237998 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 12559406 |
12559406 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 12876413 |
12876413 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 13192793 |
13192793 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 13506188 |
13506188 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 13822722 |
13822722 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 14138624 |
14138624 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 14432335 |
14432335 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 16387 | 14753617 |
14753617 | 0 | 0 | 0
-->
pid | datid | datname | relid | command | phase | cluster_index_relid | heap_tuples_scanned |
heap_tuples_written| heap_blks_total | heap_blks_scanned | index_rebuild_count
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 743
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 4639
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 8938
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 13457
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 17806
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 22237
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 26594
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 30935
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 35362
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 39705
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 44126
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 48546
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 52966
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 57174
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 61536
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 65868
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 66193
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 66193
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 66193
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 66193
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 2 | 15000000 |
15000000 | 0 | 66372 | 66193
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 5 | 15000000 |
15000000 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 5 | 15000000 |
15000000 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 5 | 15000000 |
15000000 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 5 | 15000000 |
15000000 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 5 | 15000000 |
15000000 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 5 | 15000000 |
15000000 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 5 | 15000000 |
15000000 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 5 | 15000000 |
15000000 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 5 | 15000000 |
15000000 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 5 | 15000000 |
15000000 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 5 | 15000000 |
15000000 | 0 | 0 | 0
28457 | 12750 | alvherre | 16384 | CLUSTER | index scanning heap | 5 | 15000000 |
15000000 | 0 | 0 | 0
I suppose I can just pick non-overlapping numbers for those columns.
--
Álvaro Herrera https://www.2ndQuadrant.com/
PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services
pgsql-hackers by date: