A.7. Postgres Pro Shardman 14.12.2 #

Release date: 2024-08-01

This release provides new features, optimizations and bug fixes. Major changes are as follows:

A.7.1. Core and Extensions #

  • Added a possibility to create a global or sharded table like another global, sharded or local table. Creation of a table like a local table currently has certain limitations.

  • Fixed processing of the IF NOT EXISTS parameter of the CREATE TABLE command for sharded and global tables. Earlier a table with an incorrect structure could be created if a partitioned table with the same name existed on one of the cluster nodes.

  • Changed the default value of the num_parts storage parameter to 24 to achieve a more even data distribution for 2, 3, 4, 6, and 8-node clusters.

  • Added enable_merge_append configuration parameter that enables or disables the use of MergeAppend plans by the query planner. Specifically, this allows disabling the use of these plans when they are too expensive.

  • Added the pgpro_stats.track_shardman_connections configuration parameter that enables or disables Shardman-specific statement processing.

  • Enabled pushing down join queries with VALUES to a remote server.

  • Removed a limit of about 64K on the number of tables in a query.

  • Added the shardman.pg_stat_monitor view that provides statistics on the work of the distributed deadlock detector and of the prepared transaction resolution services.

  • Added the shardman.gv_stats_sdm_statements global view that allows accessing the aggregated statistics for the distributed queries.

  • Updated the pgpro_stats pgpro_stats_sdm_statements view to only contain statistics on queries involving sharded tables.

  • Upgraded supported version of pg_probackup to 2.8.2.

A.7.2. Management Utilities #

  • Implemented the ability to backup clusters with tablespaces. Now the tablespaces are located under the backup directory.

  • Enabled shardmanctl probackup restore a fully/partially working cluster from a backup made on a partially working cluster.

  • Added the --no-wait option for the shardmanctl shard add command that sets shardmanctl not to wait for the shard to start and lifts the lock on other commands.

  • Added the s|--scale option for the shardmanctl bench run command. It multiplies the number of generated rows by the scale factor.

  • Added the shardmanctl script command that executes non-transactional commands from a file or from the command-line on the specified shards.

  • Updated the sdmspec.json configuration file generated by the shardmanctl config generate command to exclude the parameters that depend on the hardware resources and the workload on the cluster node. These parameters are now set to their default values. Previously, cluster initialization could fail on nodes with lower capacity due to setting these values too high.

  • Enabled restoring other clusters from a cluster backup if they have the same topology. Added the shardmanctl config update ip command that updates the specified node IPs in the cluster.

  • Added the --log-format option to shardmand that specifies the log output format, json or text.

pdf