pgsql: Support for optimizing and emitting code in LLVM JIT provider. - Mailing list pgsql-committers

From Andres Freund
Subject pgsql: Support for optimizing and emitting code in LLVM JIT provider.
Date
Msg-id E1ez4cY-00073B-Cj@gemulon.postgresql.org
Whole thread Raw
List pgsql-committers
Support for optimizing and emitting code in LLVM JIT provider.

This commit introduces the ability to actually generate code using
LLVM. In particular, this adds:

- Ability to emit code both in heavily optimized and largely
  unoptimized fashion
- Batching facility to allow functions to be defined in small
  increments, but optimized and emitted in executable form in larger
  batches (for performance and memory efficiency)
- Type and function declaration synchronization between runtime
  generated code and normal postgres code. This is critical to be able
  to access struct fields etc.
- Developer oriented jit_dump_bitcode GUC, for inspecting / debugging
  the generated code.
- per JitContext statistics of number of functions, time spent
  generating code, optimizing, and emitting it.  This will later be
  employed for EXPLAIN support.

This commit doesn't yet contain any code actually generating
functions. That'll follow in later commits.

Documentation for GUCs added, and for JIT in general, will be added in
later commits.

Author: Andres Freund, with contributions by Pierre Ducroquet
Testing-By: Thomas Munro, Peter Eisentraut
Discussion: https://postgr.es/m/20170901064131.tazjxwus3k2w3ybh@alap3.anarazel.de

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/b96d550eb03cfdb000def70912ec840dbe7f67da

Modified Files
--------------
.gitignore                           |   1 +
src/Makefile.global.in               |  21 ++
src/backend/common.mk                |   1 +
src/backend/jit/jit.c                |   1 +
src/backend/jit/llvm/Makefile        |  14 +-
src/backend/jit/llvm/llvmjit.c       | 588 +++++++++++++++++++++++++++++++++++
src/backend/jit/llvm/llvmjit_types.c |  60 ++++
src/backend/utils/misc/guc.c         |  11 +
src/include/jit/jit.h                |  21 ++
src/include/jit/llvmjit.h            |  30 ++
src/tools/pgindent/typedefs.list     |   3 +
11 files changed, 748 insertions(+), 3 deletions(-)


pgsql-committers by date:

Previous
From: Robert Haas
Date:
Subject: pgsql: Avoid creating a TOAST table for a partitioned table.
Next
From: Andres Freund
Date:
Subject: Re: pgsql: Add \if support to pgbench