Commit Graph

5301 Commits (99d3e7db2c31ae4a11afb74415db87be582671da)

Author SHA1 Message Date
Ahmet Gedemenli 99d3e7db2c Revert multi_master_delete_protocol 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli 9c798908b4 Revert tests 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli e5fe479eb5 Revert&Adjust fkey tests 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli 5611915300 Style 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli c29c2d0263 Remove the global variable autoConverted, use parameter 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli 91bc5158a4 Remove AutoConvertedViaCatalog 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli 21a184f2e7 Check on cache value, not catalog 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli 9cbb33a448 Move new column to version 11 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli e695e04219 Reset autoConverted field for cache 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli 6ef8075bdd Style 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli 6f042365bd Fix test outputs 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli 0d0cd9222c Rebase & Update tests 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli 2b9fbce19e Fix tests 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli 5783c498eb Add test 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli 8f5bc36b38 Check the relation itself, if no fkey is found 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli 7e8185b3ce Style 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli 4fe5cbfb49 Fix mx test 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli 31573a01d7 Style 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli 4a6dbf886c Fix tests: Columnar, failure and MX 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli cdcb2c4049 Fix tests: multi-1 and MX 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli e07d5c8530 Cover cases: ALTER TABLE .. ADD CONSTRAINT .. 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli 2d20fa37ad Mark the given table as not auto-converted 2021-10-27 19:21:37 +03:00
Ahmet Gedemenli a231822de0 Add column autoconverted to sql scripts 2021-10-27 19:21:36 +03:00
Ahmet Gedemenli 3f44d6ea72 Introduce new column for pg_dist_partition: autoconverted 2021-10-27 19:21:36 +03:00
Ahmet Gedemenli 2cfac21382 Dont auto-undistribute user-added citus local tables - Refactor 2021-10-27 19:21:36 +03:00
Nils Dijk f4297f774a
Bump mitmproxy version (#5334)
There is a vulnerability in mitmproxy with the version we are using.

It would be hard to exploit anything with regards to the artifacts we ship as its only used in our test suite. Still its good hygiene to _not_ use software with known vulnerabilities.

This PR updates the version of python, mitmproxy and the crypto libraries used.
The latest version of mitmproxy for python 3.6 is not patched, hence the upgrade of python.
For our CI images this cascades into upgrading debian as well :)

For CI we bake these versions in our images so we need to update them as well.

Changes to the CI images: https://github.com/citusdata/the-process/pull/65
2021-10-27 17:57:13 +02:00
Jelte Fennema a8cbeb1047
Fix docs of arbitrary configs (#5413)
The old command would run none of the tests. The new command runs all of
the tests for the given configs.
2021-10-27 17:16:24 +02:00
Philip Dubé 44204ec9f1
Merge pull request #5401 from citusdata/fix-typos
Fix typos. Spurred spotting "connectios" in logs
2021-10-25 15:33:16 +00:00
Philip Dubé cc50682158 Fix typos. Spurred spotting "connectios" in logs 2021-10-25 13:54:09 +00:00
Jelte Fennema 3bdbfc3edf
Fix duplicate typedef which can cause compile failures (#5406)
ColumnarScanDesc is already defined in columnar_tableam.h. Redifining it
again causes a compiler error on some C compilers.

Useful reference: https://bugzilla.redhat.com/show_bug.cgi?id=767538

Fixes #5404
2021-10-25 12:20:13 +00:00
Önder Kalacı fc00ddee4e
Merge pull request #5386 from citusdata/simplify_2pc_decision
Simplify 2PC decision in the executor
2021-10-23 09:35:22 +02:00
Onder Kalaci ce4c4540c5 Simplify 2PC decision in the executor
It seems like the decision for 2PC is more complicated than
it should be.

With this change, we do one behavioral change. In essense,
before this commit, when a SELECT task with replication factor > 1
is executed, the executor was triggering 2PC. And, in fact,
the transaction manager (`ConnectionModifiedPlacement()`) was
able to understand not to trigger 2PC when no modification happens.

However, for transaction blocks like:
BEGIN;
-- a command that triggers 2PC
-- A SELECT command on replication > 1
..
COMMIT;

The SELECT was used to be qualified as required 2PC. And, as a side-effect
the executor was setting `xactProperties.errorOnAnyFailure = true;`

So, the commands was failing at the time of execution. Now, they fail at
the end of the transaction.
2021-10-23 09:06:28 +02:00
Önder Kalacı 8664e6873f
Merge pull request #5381 from citusdata/do_not_mark_placements_invalid
Drop support Inactive Shard States
2021-10-23 09:04:50 +02:00
Onder Kalaci 575bb6dde9 Drop support for Inactive Shard placements
Given that we do all operations via 2PC, there is no way
for any placement to be marked as INACTIVE.
2021-10-22 18:03:35 +02:00
Önder Kalacı b3299de81c
Drop support for citus.multi_shard_commit_protocol (#5380)
In the past, we allowed users to manually switch to 1PC
(e.g., one phase commit). However, with this commit, we
don't. All multi-shard modifications are done via 2PC.
2021-10-21 14:01:28 +02:00
Marco Slot e4760e348a
Merge pull request #5389 from citusdata/marcocitus/remove-master_get_table_metadata 2021-10-21 12:21:40 +02:00
Marco Slot df43868369 Remove PG11 expected upgrade_list_citus_objects output 2021-10-21 12:08:05 +02:00
Marco Slot dafba6c242 Deprecate master_get_table_metadata UDF 2021-10-21 12:08:05 +02:00
Marco Slot 3b7641b32d
Merge pull request #5396 from citusdata/marcocitus/opclass-parameters
Support operator class parameters in indexes
2021-10-21 10:38:11 +02:00
Marco Slot defb97b7f5 Support operator class parameters in indexes 2021-10-20 17:03:59 +02:00
Önder Kalacı 3f726c72e0
When replication factor > 1, all modifications are done via 2PC (#5379)
With Citus 9.0, we introduced `citus.single_shard_commit_protocol` which
defaults to 2PC.

With this commit, we prevent any user to set it to 1PC and drop support
for `citus.single_shard_commit_protocol`.

Although this might add some overhead for users, it is already the default
behaviour (so less likely) and marking placements as INVALID is much
worse.
2021-10-20 01:39:03 -07:00
Sait Talha Nisanci a851211dbc Run tests sequentially 2021-10-19 18:35:26 +03:00
Marco Slot 641ef9bd6f Fix flappy subquery_append test 2021-10-19 15:29:01 +02:00
Sait Talha Nisanci 56abd3d501 Increase parallelism 2021-10-19 15:38:58 +03:00
Marco Slot d9e36820f4
Merge pull request #5361 from citusdata/marcocitus/remove-append-4 2021-10-19 12:50:22 +02:00
Marco Slot 096660d61d Remove master_apply_delete_command 2021-10-18 22:29:37 +02:00
Marco Slot 9571311c65
Merge pull request #5359 from citusdata/marcocitus/remove-append-3 2021-10-18 22:07:41 +02:00
Marco Slot bece86b2f7 Add some subquery on append-distributed table tests 2021-10-18 21:11:16 +02:00
Marco Slot 93e79b9262 Never allow co-located joins of append-distributed tables 2021-10-18 21:11:16 +02:00
Marco Slot b97e5081c7 Disable co-located joins for append-distributed tables 2021-10-18 21:11:16 +02:00