From 934430003ebeaad681ee4c03c0803242fa329032 Mon Sep 17 00:00:00 2001 From: Hanefi Onaldi Date: Tue, 2 May 2023 11:29:24 +0300 Subject: [PATCH] Changelog entries for 11.3.0 (#6856) In this release, I tried something different. I experimented with adding the PR number and title to the changelog right before each changelog entry. This way, it is easier to track where a particular changelog entry comes from. After reviews are over, I plan to remove those lines with PR numbers and titles. I went through all the PRs that are merged after 11.2.0 release and came up with a list of PRs that may need help with changelog entries. You can see details on PRs grouped in several sections below. ## PRs with missing entries The following PRs below do not have a changelog entry. If you think that this is a mistake, please share it in this PR along with a suggestion on what the changelog item should be. PR #6846 : fix 3 flaky tests in failure schedule PR #6844 : Add CPU usage to citus_stat_tenants PR #6833 : Fix citus_stat_tenants period updating bug PR #6787 : Add more tests for ddl coverage PR #6842 : Add build-cdc-* temporary directories to .gitignore PR #6841 : Add build-cdc-* temporary directories to .gitignore PR #6840 : Bump Citus to 12.0devel PR #6824 : Fixes flakiness in multi_metadata_sync test PR #6811 : Backport identity column improvements to v11.2 PR #6830 : In run_test.py actually return worker_count PR #6825 : Fixes flakiness in multi_cluster_management test PR #6816 : Refactor run_test.py PR #6817 : Explicitly disallow local rels when inserting into dist table PR #6821 : Rename citus stats tenants PR #6822 : Add some more tests for initial sql support PR #6819 : Fix flakyness in citus_split_shard_by_split_points_deferred_drop PR #6814 : Make python-regress based tests runnable with run_test.py PR #6813 : Fix flaky multi_mx_schema_support test PR #6720 : Convert columnar tap tests to pytest PR #6812 : Revoke statistics permissions from public and grant them to pg_monitor PR #6769 : Citus stats tenants guc PR #6807 : Fix the incorrect (constant) value passed to pointer-to-bool parameter, pass a NULL as the value is not used PR #6797 : Attribute local queries and cached plans on local execution PR #6796 : Parse the annotation string correctly PR #6762 : Add logs to citus_stats_tenants PR #6773 : Add initial sql support for distributed tables that don't have a shard key PR #6792 : Disentangle MERGE planning code from the modify-planning code path PR #6761 : Citus stats tenants collector view PR #6791 : Make 8 more tests runnable multiple times via run_test.py PR #6786 : Refactor some of the planning code to accommodate a new planning path for MERGE SQL PR #6789 : Rename AllRelations.. functions to AllDistributedRelations.. PR #6788 : Actually skip arbitrary_configs_router & nested_execution for AllNullDistKeyDefaultConfig PR #6783 : Add a config for arbitrary config tests where all the tables are null-shard-key tables PR #6784 : Fix attach partition: citus local to null distributed PR #6782 : Add an arbitrary config test heavily based on multi_router_planner_fast_path.sql PR #6781 : Decide what to do with router planner error at one place PR #6778 : Support partitioning for dist tables with null dist keys PR #6766 : fix pip lock file PR #6764 : Make workerCount configurable for regression tests PR #6745 : Add support for creating distributed tables with a null shard key PR #6696 : This implements MERGE phase-III PR #6767 : Add pytest depedencies to Pipfile PR #6760 : Decide core distribution params in CreateCitusTable PR #6759 : Add multi_create_fdw into minimal_schedule PR #6743 : Replace CITUS_TABLE_WITH_NO_DIST_KEY checks with HasDistributionKey() PR #6751 : Stabilize single_node.sql and others that report illegal node removal PR #6742 : Refactor CreateDistributedTable() PR #6747 : Remove unused lock functions PR #6744 : Fix multiple output version arbitrary config tests PR #6741 : Stabilize single node tests PR #6740 : Fix string eval bug in migration files check PR #6736 : Make run_test.py and create_test.py importable without errors PR #6734 : Don't blanket ignore flake8 E402 error PR #6737 : Fixes bookworm packaging pipeline problem PR #6735 : Fix run_test.py on python 3.9 PR #6733 : MERGE: In deparser, add missing check for RETURNING clause. PR #6714 : Remove auto_explain workaround in citus explain hook for ALTER TABLE PR #6719 : Fix flaky test PR #6718 : Add more powerfull dependency tracking to run_test.py PR #6710 : Install non-vulnerable cryptography package PR #6711 : Support compilation and run tests on latest PG versions PR #6700 : Add auto-formatting and linting to our python code PR #6707 : Allow multi_insert_select to run repeatably PR #6708 : Fix flakyness in failure_create_distributed_table_non_empty PR #6698 : Miscellaneous cleanup PR #6704 : Update README for 11.2 PR #6703 : Fix dubious ownership error from git PR #6690 : Bump Citus to 11.3devel ## Too long changelog entries The following PRs have changelog entries that are too long to fit in a single line. I'd expect authors to supply at changelog entries in `DESCRIPTION:` lines that are at most 78 characters. If you want to supply multi-line changelog items, you can have multiple lines that start with `DESCRIPTION:` instead. PR #6837 : fixes update propagation bug when `citus_set_coordinator_host` is called more than once PR #6738 : Identity column implementation refactorings PR #6756 : Schedule parallel shard moves in background rebalancer by removing task dependencies between shard moves across colocation groups. PR #6793 : Add a GUC to disallow planning the queries that reference non-colocated tables via router planner PR #6726 : fix memory leak during altering distributed table with a lot of partition and shards PR #6722 : fix memory leak during distribution of a table with a lot of partitions PR #6693 : prevent memory leak during ConvertTable with a lot of partitions ## Empty changelog entries. The following PR had an empty `DESCRIPTION:` line. This generates an empty changelog line that needs to be removed manually. Please either provide a short entry, or remove `DESCRIPTION:` line completely. PR #6810 : Make CDC decoder an independent extension PR #6827 : Makefile changes to build CDC in builddir for pgoutput and wal2json. --------- Co-authored-by: Onur Tirtir --- CHANGELOG.md | 68 ++++++++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 68 insertions(+) diff --git a/CHANGELOG.md b/CHANGELOG.md index 4fdfae3ae..c72e64cbf 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -1,3 +1,71 @@ +### citus v11.3.0 (May 2, 2023) ### + +* Introduces CDC implementation for Citus using logical replication + (#6623, #6810, #6827) + +* Adds support for `MERGE` command on co-located distributed tables joined on + distribution column (#6696, #6733) + +* Adds the view `citus_stats_tenants` that monitor statistics on tenant usages + (#6725) + +* Adds the GUC `citus.max_background_task_executors_per_node` to control number + of background task executors involving a node (#6771) + +* Allows parallel shard moves in background rebalancer (#6756) + +* Introduces the GUC `citus.metadata_sync_mode` that introduces nontransactional + mode for metadata sync (#6728, #6889) + +* Propagates CREATE/ALTER/DROP PUBLICATION statements for distributed tables + (#6776) + +* Adds the GUC `citus.enable_non_colocated_router_query_pushdown` to ensure + generating a consistent distributed plan for the queries that reference + non-colocated distributed tables when set to "false" (#6793) + +* Checks if all moves are able to be done via logical replication for rebalancer + (#6754) + +* Correctly reports shard size in `citus_shards` view (#6748) + +* Fixes a bug in shard copy operations (#6721) + +* Fixes a bug that prevents enforcing identity column restrictions on worker + nodes (#6738) + +* Fixes a bug with `INSERT .. SELECT` queries with identity columns (#6802) + +* Fixes an issue that caused some queries with custom aggregates to fail (#6805) + +* Fixes an issue when `citus_set_coordinator_host` is called more than once + (#6837) + +* Fixes an uninitialized memory access in shard split API (#6845) + +* Fixes memory leak and max allocation block errors during metadata syncing + (#6728) + +* Fixes memory leak in `undistribute_table` (#6693) + +* Fixes memory leak in `alter_distributed_table` (#6726) + +* Fixes memory leak in `create_distributed_table` (#6722) + +* Fixes memory leak issue with query results that returns single row (#6724) + +* Improves rebalancer when shard groups have placement count less than worker + count (#6739) + +* Makes sure to stop maintenance daemon when dropping a database even without + Citus extension (#6688) + +* Prevents using `alter_distributed_table` and `undistribute_table` UDFs when a + table has identity columns (#6738) + +* Prevents using identity columns on data types other than `bigint` on + distributed tables (#6738) + ### citus v11.2.1 (April 20, 2023) ### * Correctly reports shard size in `citus_shards` view (#6748)