Commit Graph

4738 Commits (fe5c985e1d6474636c1e7ddfdb03d611393f5a28)

Author SHA1 Message Date
Onur Tirtir fe5c985e1d
Remove HAS_TABLEAM config since we dropped pg11 support (#4862)
* Remove HAS_TABLEAM config

* Drop columnar_ensure_objects_exist

* Not call columnar_ensure_objects_exist in citus_finish_pg_upgrade
2021-04-13 10:51:26 +03:00
Onur Tirtir 716cc629f1
Refactor ColumnarReadNextRow for better readability (#4823) 2021-04-13 10:44:00 +03:00
jeff-davis 3efdfdd791
Columnar: make projectedColumnList an integer list. (#4869)
Co-authored-by: Jeff Davis <jefdavi@microsoft.com>
2021-04-12 19:07:21 -07:00
Ahmet Gedemenli d74d358a45
Refactor size queries with new enum SizeQueryType (#4898)
* Refactor size queries with new enum SizeQueryType

* Polish
2021-04-12 17:14:29 +03:00
SaitTalhaNisanci b453563e88
Warm up connections params hash (#4872)
ConnParams(AuthInfo and PoolInfo) gets a snapshot, which will block the
remote connectinos to localhost. And the release of snapshot will be
blocked by the snapshot. This leads to a deadlock.

We warm up the conn params hash before starting a new transaction so
that the entries will already be there when we start a new transaction.
Hence GetConnParams will not get a snapshot.
2021-04-12 13:08:38 +03:00
Ahmet Gedemenli a1a394dbc9
Merge pull request #4894 from citusdata/add-comment-to-postprocess-create-table
Update func comment for PostprocessCreateTableStmt
2021-04-10 20:03:20 +03:00
Ahmet Gedemenli caef0463b0 Update func comment for PostprocessCreateTableStmt 2021-04-09 13:41:59 +03:00
Ahmet Gedemenli 52e467a9a0
Error out if inheriting a distributed table (#4871)
* Error out if inheriting a distributed table

* Add test inheriting a distirbuted table
2021-04-07 11:21:06 +03:00
Ahmet Gedemenli e4c4a9b683
Fix error message for local table joins (#4870)
* Fix error message for local table joins

* Fix error messages for regression tests expected outputs
2021-04-06 16:18:28 +03:00
Ahmet Gedemenli b3ef3194e3
Merge pull request #4866 from citusdata/fix-shard-not-found-issue-for-public-schema
Fix shard not found issue for public schema
2021-04-06 10:37:36 +03:00
Ahmet Gedemenli 48a6a5b128 Add test for public shard not found issue 2021-04-06 10:29:17 +03:00
Ahmet Gedemenli d530d79d73 Fix tests for public schema 2021-04-06 10:29:17 +03:00
Ahmet Gedemenli 840c879572 Remove redundant if statement for schema name 2021-04-06 10:29:17 +03:00
jeff-davis 063e673038
Columnar: use clause Vars for chunk group filtering. (#4856)
* Columnar: use clause Vars for chunk group filtering.

This solves #4780 and also provides a cleaner separation between chunk
group filtering and projection pushdown.

* Columnar: sort and deduplicate Vars pulled from clauses.

* Columnar: cleanup variable names.

* Columnar: remove alternate test output.

* Columnar: do not recurse when looking for whereClauseVars.

Co-authored-by: Jeff Davis <jefdavi@microsoft.com>
2021-04-01 12:27:28 -07:00
Onur Tirtir 57c3e226cb
Use pg13, not pg11 in CONTRIBUTING.md (#4864) 2021-04-01 16:25:01 +03:00
Halil Ozan Akgül 67bc990c1c
Merge pull request #4827 from citusdata/shard-count-parameter-in-distribution
Adds shard_count parameter to create_distributed_table
2021-03-30 12:15:54 +03:00
Halil Ozan Akgul a5038046f9 Adds shard_count parameter to create_distributed_table 2021-03-29 16:22:49 +03:00
Hanefi Onaldi 76a1ddac94
Merge pull request #4612 from citusdata/clean-before-upgrade-tests 2021-03-29 13:17:19 +03:00
Hanefi Önaldı 797538750f Delete all upgrade test artifacts before citus-upgrade-local 2021-03-27 00:46:06 +03:00
SaitTalhaNisanci 3c2efe287e
Merge pull request #4799 from citusdata/drop/pg11
Drop postgres 11 support
2021-03-25 12:46:05 +03:00
Onur Tirtir 7081690480
Add check-columnar-vg regression test target (#4737) 2021-03-25 11:55:58 +03:00
SaitTalhaNisanci 9437d21601
Merge pull request #4848 from citusdata/ignore/modifiedVersions
Ignore config and version modified
2021-03-25 11:48:43 +03:00
SaitTalhaNisanci 3a3171cd04 Ignore temporary output files 2021-03-25 09:59:21 +03:00
SaitTalhaNisanci 03832f353c Drop postgres 11 support 2021-03-25 09:20:28 +03:00
jeff-davis 248c6cb91a
Columnar: do not bother building unnecessary RestrictInfo. (#4852)
Co-authored-by: Jeff Davis <jefdavi@microsoft.com>
2021-03-24 16:05:08 -07:00
Onur Tirtir c01507a91b
Remove columnar/.gitignore (#4825) 2021-03-24 13:04:14 +03:00
Hanefi Onaldi 1b7a1357f1
Merge pull request #4844 from citusdata/update-cl-833
Update Changelog for 8.3.3
2021-03-23 20:25:04 +03:00
Hanefi Onaldi 4a9655e833 Update Changelog for 8.3.3 2021-03-23 19:58:37 +03:00
Nils Dijk 1c1999ed7b
incorporate the fixopen fix for osx users on bigsur (#4837)
comparable to https://github.com/citusdata/tools/pull/88

this patch adds checks to the perl script running the testing harness of citus to start the postgres instances via the fixopen binary when present to work around `Interrupted System` call errors on OSX Big Sur.
2021-03-22 16:22:08 +01:00
Nils Dijk 787ee97867
Tests: foreign key non colocated tests (#4841)
Earlier versions of Citus (pre 9.0) had a bug where a user was able to get in a situation where a foreign key between two non-colocated tables was allowed. This was caused by the wrongful scoping together with only setting to on of a boolean variable in a loop, causing the `true` from an earlier iteration to leak into a new iteration.

This was 'by accident' solved in a refactor that was executed in the preparation of the 9.0 release. Only recently we had a user running into this and it was tracked down to this behaviour.

Given the dire situation a user could get them self into when running into this bug we have backported a fix to the latest 8.3 release branch.

To make sure this regression does not happen anymore in the future I propose we add the tests from the backport to our mainline.

For reference: https://github.com/citusdata/citus/pull/4840
2021-03-22 15:33:56 +01:00
Marco Slot 6876e87f31
Merge pull request #4838 from citusdata/dependabot/pip/src/test/regress/jinja2-2.11.3
Bump jinja2 from 2.11.2 to 2.11.3 in /src/test/regress
2021-03-22 11:03:55 +01:00
dependabot[bot] a1aedc41f1
Bump jinja2 from 2.11.2 to 2.11.3 in /src/test/regress
Bumps [jinja2](https://github.com/pallets/jinja) from 2.11.2 to 2.11.3.
- [Release notes](https://github.com/pallets/jinja/releases)
- [Changelog](https://github.com/pallets/jinja/blob/master/CHANGES.rst)
- [Commits](https://github.com/pallets/jinja/compare/2.11.2...2.11.3)

Signed-off-by: dependabot[bot] <support@github.com>
2021-03-20 05:51:26 +00:00
Marco Slot 28719ae79b
Merge pull request #4835 from citusdata/marcocitus/fix-configure
Apply #4834 to configure as well
2021-03-18 14:52:02 +01:00
Marco Slot 4ad88a7a89
Merge pull request #4834 from ProsperWorks/master
More precise error messages for ./configure.
2021-03-18 14:22:09 +01:00
Marco Slot 1e11a34d00 Apply #4834 to configure as well 2021-03-18 01:35:34 +01:00
jhwillett 8bcf3b9887 More precise error messages for ./configure --without-lz4 and --without-zstd. 2021-03-17 12:52:04 -07:00
SaitTalhaNisanci b4620bed87
Merge pull request #4822 from citusdata/changelog/10.0-3
Update CHANGELOG for 10.0.3
2021-03-17 17:54:32 +03:00
Önder Kalacı b5f4320164
Make sure that single task local executions start coordinated transaction (#4831)
With https://github.com/citusdata/citus/pull/4806 we enabled
2PC for any non-read-only local task. However, if the execution
is a single task, enabling 2PC (CoordinatedTransactionShouldUse2PC)
hits an assertion as we are not in a coordinated transaction.

There is no downside of using a coordinated transaction for single
task local queries.
2021-03-17 12:20:57 +01:00
Ahmet Gedemenli 4558132239
Merge pull request #4830 from citusdata/add-udf-citus-get-active-worker-nodes
Add udf citus_get_active_worker_nodes
2021-03-17 13:39:30 +03:00
Ahmet Gedemenli 5e5db9eefa Add udf citus_get_active_worker_nodes 2021-03-17 13:15:59 +03:00
Sait Talha Nisanci 92130ae2a2 Update CHANGELOG for 10.0.3 2021-03-17 11:21:36 +03:00
Marco Slot 946f529826
Merge pull request #4820 from citusdata/marcocitus/copy-guc
Introduce citus.remote_copy_flush_threshold GUC
2021-03-16 19:05:10 +01:00
Marco Slot 43f600bc46
Merge pull request #4808 from citusdata/marcocitus/connection-lifetime 2021-03-16 14:58:06 +01:00
Marco Slot fbc2147e11 Replace MAX_PUT_COPY_DATA_BUFFER_SIZE by citus.remote_copy_flush_threshold GUC 2021-03-16 06:00:38 +01:00
Marco Slot 1646fca445 Add GUC to set maximum connection lifetime 2021-03-16 01:57:57 +01:00
jeff-davis 3b12556401
Columnar: cleanup (#4814)
* Columnar: fix misnamed file.

* Columnar: make compression not dependent on columnar.h.

* Columnar: rename columnar_metadata_tables.c to columnar_metadata.c.

* Columnar: make customscan not depend on columnar.h.

Co-authored-by: Jeff Davis <jefdavi@microsoft.com>
2021-03-15 11:34:39 -07:00
Onur Tirtir b2a7bafcc4
Fix flaky test in multi_foreign_key_relation_graph (#4819) 2021-03-15 17:55:04 +03:00
Marco Slot 7d8d5cad98
Merge pull request #4817 from citusdata/marcocitus/fix-warning
Remove unnecessary AtEOXact_Files call
2021-03-15 09:58:41 +01:00
Marco Slot 6c5d263b7a Remove unnecessary AtEOXact_Files call 2021-03-15 09:34:02 +01:00
Onur Tirtir 1d3e075e62
Support temporary columnar tables (#4766) 2021-03-12 12:01:36 +03:00