2.6. Organizing ETL operations #
Determine how the OLAP data is added to storages and organize ETL operations for deployment scenarios.
You can add the OLAP data to storages in one of the following ways:
From analytical tables or directly from Parquet files using ETL operations.
This is the easiest and most reliable way, since it allows for transactional updates of the OLAP data and metadata.
Using SQL scripts and custom ETL operations.
It is recommended to use this way only for the use cases that cannot be implemented using ETL operations.
Important
If this way is used, responsibility for correct metadata data registration and integrity is not guaranteed.
Postgres Pro operations, temporary tables, and custom data conversion scripts can be used for implementing complex initial OLAP data processing within ETL operations.