Re: Yet another vectorized engine - Mailing list pgsql-hackers

From Konstantin Knizhnik
Subject Re: Yet another vectorized engine
Date
Msg-id d57ceed2-5491-b9cf-5314-4382d631bdf9@postgrespro.ru
Whole thread Raw
In response to Re: Yet another vectorized engine  (Konstantin Knizhnik <k.knizhnik@postgrespro.ru>)
List pgsql-hackers


On 25.02.2020 19:40, Konstantin Knizhnik wrote:
I have ported vectorize_engine  for zedstore (vertical table AM).
Results of TPCH-10G/Q1 are the following:

par.workers
PG9_6
vectorize=off
PG9_6
vectorize=on
master
vectorize=off
jit=on
master
vectorize=off
jit=off
master
vectorize=on
jit=on
master
vectorize=on
jit=off
zedstore vectorize=off
jit=on
zedstore vectorize=off
jit=off
zedstore vectorize=on
jit=on
zedstore vectorize=on
jit=off
0
36
20
16
25.5
15
17.5
18
26
17
19
4
10
-
57
-
-5
7
-
-


After correct calculation of used columns bitmapset and passing it to table_beginscan_with_column_projection function zedstore+vectorize_engine
show the best result (without parallel execution):


par.workers
PG9_6
vectorize=off
PG9_6
vectorize=on
master
vectorize=off
jit=on
master
vectorize=off
jit=off
master
vectorize=on
jit=on
master
vectorize=on
jit=off
zedstore vectorize=off
jit=on
zedstore vectorize=off
jit=off
zedstore vectorize=on
jit=on
zedstore vectorize=on
jit=off
0
36
20
16
25.5
15
17.5
18
26
14
16
4
10
-
57
-
-5
7
-
-


but still the difference with vanilla is minimal.


Profiler top is the following:
 
  16.30%  postgres  postgres             [.] zedstoream_getnexttile
   6.98%  postgres  postgres             [.] decode_chunk
   6.68%  postgres  liblz4.so.1.7.1      [.] LZ4_decompress_safe
   5.37%  postgres  vectorize_engine.so  [.] vfloat8_accum
   5.23%  postgres  postgres             [.] bpchareq

--
Konstantin Knizhnik
Postgres Professional: http://www.postgrespro.com
The Russian Postgres Company 

pgsql-hackers by date:

Previous
From: Michael Paquier
Date:
Subject: Re: [PATCH] pg_upgrade: report the reason for failing to open thecluster version file
Next
From: Hubert Zhang
Date:
Subject: Re: Yet another vectorized engine