Part VII. Internals

This part contains assorted information that might be of use to Postgres Pro developers.

Table of Contents

54. Overview of Postgres Pro Internals
54.1. The Path of a Query
54.2. How Connections Are Established
54.3. The Parser Stage
54.4. The Postgres Pro Rule System
54.5. Planner/Optimizer
54.6. Executor
55. System Catalogs
55.1. Overview
55.2. pg_aggregate
55.3. pg_am
55.4. pg_amop
55.5. pg_amproc
55.6. pg_attrdef
55.7. pg_attribute
55.8. pg_authid
55.9. pg_auth_members
55.10. pg_cast
55.11. pg_class
55.12. pg_collation
55.13. pg_constraint
55.14. pg_conversion
55.15. pg_database
55.16. pg_db_role_setting
55.17. pg_default_acl
55.18. pg_depend
55.19. pg_description
55.20. pg_enum
55.21. pg_event_trigger
55.22. pg_extension
55.23. pg_foreign_data_wrapper
55.24. pg_foreign_server
55.25. pg_foreign_table
55.26. pg_index
55.27. pg_inherits
55.28. pg_init_privs
55.29. pg_language
55.30. pg_largeobject
55.31. pg_largeobject_metadata
55.32. pg_namespace
55.33. pg_opclass
55.34. pg_operator
55.35. pg_opfamily
55.36. pg_parameter_acl
55.37. pg_partitioned_table
55.38. pg_policy
55.39. pg_proc
55.40. pg_profile
55.41. pg_publication
55.42. pg_publication_namespace
55.43. pg_publication_rel
55.44. pg_range
55.45. pg_replication_origin
55.46. pg_rewrite
55.47. pg_role_password
55.48. pg_seclabel
55.49. pg_sequence
55.50. pg_shdepend
55.51. pg_shdescription
55.52. pg_shseclabel
55.53. pg_statistic
55.54. pg_statistic_ext
55.55. pg_statistic_ext_data
55.56. pg_subscription
55.57. pg_subscription_rel
55.58. pg_tablespace
55.59. pg_transform
55.60. pg_trigger
55.61. pg_ts_config
55.62. pg_ts_config_map
55.63. pg_ts_dict
55.64. pg_ts_parser
55.65. pg_ts_template
55.66. pg_type
55.67. pg_user_mapping
56. System Views
56.1. Overview
56.2. pg_available_extensions
56.3. pg_available_extension_versions
56.4. pg_backend_memory_contexts
56.5. pg_config
56.6. pg_cursors
56.7. pg_file_settings
56.8. pg_group
56.9. pg_hba_file_rules
56.10. pg_ident_file_mappings
56.11. pg_indexes
56.12. pg_locks
56.13. pg_matviews
56.14. pg_policies
56.15. pg_prepared_statements
56.16. pg_autoprepared_statements
56.17. pg_prepared_xacts
56.18. pg_publication_tables
56.19. pg_replication_origin_status
56.20. pg_replication_slots
56.21. pg_roles
56.22. pg_rules
56.23. pg_seclabels
56.24. pg_sequences
56.25. pg_settings
56.26. pg_shadow
56.27. pg_shmem_allocations
56.28. pg_stats
56.29. pg_stats_ext
56.30. pg_stats_ext_exprs
56.31. pg_stats_vacuum_database
56.32. pg_stats_vacuum_indexes
56.33. pg_stats_vacuum_tables
56.34. pg_tables
56.35. pg_timezone_abbrevs
56.36. pg_timezone_names
56.37. pg_user
56.38. pg_user_mappings
56.39. pg_views
57. Frontend/Backend Protocol
57.1. Overview
57.2. Message Flow
57.3. SASL Authentication
57.4. Streaming Replication Protocol
57.5. Logical Streaming Replication Protocol
57.6. Message Data Types
57.7. Message Formats
57.8. Error and Notice Message Fields
57.9. Logical Replication Message Formats
57.10. Summary of Changes since Protocol 2.0
58. Writing a Procedural Language Handler
59. Writing a Foreign Data Wrapper
59.1. Foreign Data Wrapper Functions
59.2. Foreign Data Wrapper Callback Routines
59.3. Foreign Data Wrapper Helper Functions
59.4. Foreign Data Wrapper Query Planning
59.5. Row Locking in Foreign Data Wrappers
60. Writing a Table Sampling Method
60.1. Sampling Method Support Functions
61. Writing a Custom Scan Provider
61.1. Creating Custom Scan Paths
61.2. Creating Custom Scan Plans
61.3. Executing Custom Scans
62. Genetic Query Optimizer
62.1. Query Handling as a Complex Optimization Problem
62.2. Genetic Algorithms
62.3. Genetic Query Optimization (GEQO) in Postgres Pro
62.4. Further Reading
63. Table Access Method Interface Definition
64. Index Access Method Interface Definition
64.1. Basic API Structure for Indexes
64.2. Index Access Method Functions
64.3. Index Scanning
64.4. Index Locking Considerations
64.5. Index Uniqueness Checks
64.6. Index Cost Estimation Functions
65. Generic WAL Records
66. Custom WAL Resource Managers
67. B-Tree Indexes
67.1. Introduction
67.2. Behavior of B-Tree Operator Classes
67.3. B-Tree Support Functions
67.4. Implementation
68. GiST Indexes
68.1. Introduction
68.2. Built-in Operator Classes
68.3. Extensibility
68.4. Implementation
68.5. Examples
69. SP-GiST Indexes
69.1. Introduction
69.2. Built-in Operator Classes
69.3. Extensibility
69.4. Implementation
70. GIN Indexes
70.1. Introduction
70.2. Built-in Operator Classes
70.3. Extensibility
70.4. Implementation
70.5. GIN Tips and Tricks
70.6. Limitations
70.7. Examples
71. BRIN Indexes
71.1. Introduction
71.2. Built-in Operator Classes
71.3. Extensibility
72. Hash Indexes
72.1. Overview
72.2. Implementation
73. Database Physical Storage
73.1. Database File Layout
73.2. TOAST
73.3. Free Space Map
73.4. Visibility Map
73.5. The Initialization Fork
73.6. Database Page Layout
73.7. Heap-Only Tuples (HOT)
74. Transaction Processing
74.1. Transactions and Identifiers
74.2. Transactions and Locking
74.3. Subtransactions
74.4. Two-Phase Transactions
75. How the Planner Uses Statistics
75.1. Row Estimation Examples
75.2. Multivariate Statistics Examples
75.3. Planner Statistics and Security
76. Real-Time Query Replanning
76.1. How It Works
77. Backup Manifest Format
77.1. Backup Manifest Top-level Object
77.2. Backup Manifest File Object
77.3. Backup Manifest WAL Range Object