Commit Graph

6859 Commits (3ec61f914e76c54816a3807b241e1318bb41e154)

Author SHA1 Message Date
Gokhan Gulbiz 16d03c9a19
Cleanup 2023-08-18 13:47:07 +03:00
Gokhan Gulbiz 3a40fce4ba
Naming refactorings 2023-08-18 13:05:38 +03:00
Gokhan Gulbiz 7d7f282ecf
Fix double quote 2023-08-18 10:04:11 +03:00
Gokhan Gulbiz 088d70a82a
Cleanup 2023-08-18 10:02:22 +03:00
Gokhan Gulbiz 609fbc8fde
Diff markdown 2023-08-18 09:39:16 +03:00
Naisila Puka 682dca1f12
Adds PG16Beta3 support (#6952)
DESCRIPTION: Adds PG16Beta3 support

This is the final commit that adds
PG16 compatibility with Citus's current features.

You can use Citus community with PG16Beta3. This commit:

- Enables PG16 in the configure script.
- Adds PG16 tests to CI using test images that have 16beta3
- Skips wal2json cdc test since wal2json package is not available for PG16 yet
- Fixes an isolation test

Several PG16 Compatibility commits have been merged before this final one.
All these subtasks are done https://github.com/citusdata/citus/issues/7017
See the list below:

1 - 42d956888d
Resolve compilation issues
2 - 0d503dd5ac
Ruleutils and successful CREATE EXTENSION
3 - 907d72e60d
Some test outputs
4 - 7c6b4ce103
Outer join checks, subscription password, crash fixes
5 - 6056cb2c29
get_relation_info hook to avoid crash from adjusted partitioning
6 - b36c431abb
Rework PlannedStmt and Query's Permission Info
7 - ee3153fe50
More test output fixes
8 - 2c50b5f7ff
varnullingrels additions
9 - b2291374b4
More test output fixes
10- a2315fdc67
New options to vacuum and analyze
11- 9fa72545e2
Fix AM dependency and grant's admin option
12- 2d6cf8e79a
One more outer join check

Stay tuned for PG16 new features in Citus :)
2023-08-17 21:02:59 +03:00
Naisila Puka 2d6cf8e79a
PG16 compatibility - one more outer join check (#7126)
PG16 compatibility - part 11

Check out part 1 42d956888d
part 2 0d503dd5ac
part 3 907d72e60d
part 4 7c6b4ce103
part 5 6056cb2c29
part 6 b36c431abb
part 7 ee3153fe50
part 8 2c50b5f7ff
part 9 b2291374b4
part 10 a2315fdc67
part 11 9fa72545e2

This commit is in the series of PG16 compatibility commits.
We already took care of the majority of necessary outer join checks
in part 4 7c6b4ce103
However, In RelationInfoContainsOnlyRecurringTuples,
we need to add one more check of whether we are dealing
with an outer join RTE using IsRelOptOuterJoin function.
This prevents an outer join crash in sqlancer_failures.sql test.

We expect one more commit of PG compatibility with Citus's current
features are regression tests sanity.
2023-08-17 19:07:18 +03:00
Gokhan Gulbiz f67f468296
better wildcard usage 2023-08-17 17:37:44 +03:00
Gokhan Gulbiz 13ceea3274
narrow down upload path 2023-08-17 17:29:30 +03:00
Gokhan Gulbiz 903196c8a2
minor fixes 2023-08-17 17:22:54 +03:00
Gokhan Gulbiz 136382472a
fix wildcard path 2023-08-17 17:00:13 +03:00
Gokhan Gulbiz 451d6d8eda
fix step summary 2023-08-17 16:40:19 +03:00
Gokhan Gulbiz f655f6d360
Set timeout 2023-08-17 16:24:57 +03:00
Gokhan Gulbiz 5626f58a9b
Fix log processing 2023-08-17 16:04:59 +03:00
Gokhan Gulbiz 59dbf06153
cdc and tap tests 2023-08-17 15:31:19 +03:00
Gokhan Gulbiz c9c2d87654
Update matrix 2023-08-17 15:00:03 +03:00
zhjwpku b10320be6f
fix wrong type convertion (#7116)
partitionMethod and replicationModel are both type char, there seems
meaningless to convert them to type Oid implicitly.
2023-08-17 13:53:43 +02:00
Gokhan Gulbiz c0a19983d8
Update matrix 2023-08-17 14:52:06 +03:00
Gokhan Gulbiz f02882765a
Env var fix 2023-08-17 14:42:11 +03:00
Gokhan Gulbiz 1bc08df1a0
Naming 2023-08-17 14:38:02 +03:00
Gokhan Gulbiz fb937db14a
Add PG_MAJOR as Github Env Var 2023-08-17 14:31:52 +03:00
Gokhan Gulbiz f14938a095
Add PG_MAJOR as Github Env Var 2023-08-17 14:30:20 +03:00
Gokhan Gulbiz 5afb9a1496
Add PG_MAJOR as Github Env Var 2023-08-17 14:18:03 +03:00
Gokhan Gulbiz 4dd0a8aa62
Test 2023-08-17 13:57:43 +03:00
Gokhan Gulbiz c77306d26d
Try to evaluate env variable case-sensitivity 2023-08-17 13:50:18 +03:00
Gokhan Gulbiz 20f8baabe8
Do not override PG_MAJOR 2023-08-17 13:45:07 +03:00
Gokhan Gulbiz 0e3a292204
Use env variable for PG_MAJOR 2023-08-17 13:44:16 +03:00
Gokhan Gulbiz 0fd2e9bfa2
Reorganize failtester matrix 2023-08-17 13:11:03 +03:00
Gokhan Gulbiz 97a8a31cef
Include check-failure in matrix 2023-08-17 12:53:55 +03:00
Gokhan Gulbiz e5b55814b3
Merge remote-tracking branch 'origin/main' into circleci-gha-migration 2023-08-17 12:51:03 +03:00
Gokhan Gulbiz f4bc9796f2
Fetch all branches to be able to run git diff.. 2023-08-17 12:31:30 +03:00
Gokhan Gulbiz 0ba0c685b3
Set user to root for sql snapshots 2023-08-17 12:20:46 +03:00
Gokhan Gulbiz 6127fe3556
Fix newline issues 2023-08-17 12:20:27 +03:00
Gokhan Gulbiz cf62647396
Safe directory configuration 2023-08-17 12:17:17 +03:00
Gokhan Gulbiz 812077e74d
Change default user to circleci 2023-08-17 12:11:30 +03:00
Gokhan Gulbiz c1ff845ae3
Run container image with root user 2023-08-17 12:07:56 +03:00
Gokhan Gulbiz 01e2596b2c
Fix for check-sql-snapshots and check-style issues 2023-08-17 12:06:28 +03:00
Gokhan Gulbiz 91e3229be7
Stack trace and upload covarage run always 2023-08-17 12:01:44 +03:00
Naisila Puka a5ce601c07
Bump PG14 and PG15 versions for CI tests (#7111)
Postgres got minor updates on Aug10, this commit starts using the
images with the latest version for our tests, namely 14.9 and 15.4.

Depends on https://github.com/citusdata/the-process/pull/147

For CI images, we needed to regenerate Pipfile.lock, mainly because of an issue
with pyyaml version: https://github.com/yaml/pyyaml/issues/601

We also needed to remove a failing test in subquery_local_tables.sql.
Relevant PG commit:
b0e390e6d1
b0e390e6d1d68b92e9983840941f8f6d9e083fe0
Issue: https://github.com/citusdata/citus/issues/7119
For joins where consider_join_pushdown is false, we cannot get the
information that we used to get, which prevents doing the distributed planning.
Team already contacted PG committers for this.
Until then, we remove the test from the schedule.
2023-08-17 11:53:19 +03:00
Gokhan Gulbiz 9c47dbabd8
Matrix customization for failtester 2023-08-17 11:53:01 +03:00
Naisila Puka 9fa72545e2
PG16 compatibility - fix AM dependency and grant's admin option (#7113)
PG16 compatibility - part 11

Check out part 1 42d956888d
part 2 0d503dd5ac
part 3 907d72e60d
part 4 7c6b4ce103
part 5 6056cb2c29
part 6 b36c431abb
part 7 ee3153fe50
part 8 2c50b5f7ff
part 9 b2291374b4
part 10 a2315fdc67

This commit is in the series of PG16 compatibility commits. It fixes
AM dependency and grant's admin option:

- Fix with admin option in grants 
grantstmt->admin_opt no longer exists in PG16
instead, grantstmt has a list of options, one of them is admin option.
Relevant PG commit:
e3ce2de09d
e3ce2de09d814f8770b2e3b3c152b7671bcdb83f

- Fix pg_depend entry to AMs after ALTER TABLE .. SET ACCESS METHOD 
Relevant PG commit:
97d8910104
97d89101045fac8cb36f4ef6c08526ea0841a596


More PG16 compatibility commits are coming soon:
We are very close to merging "PG16Beta3 Support - Regression tests sanity"
2023-08-17 11:22:34 +03:00
Naisila Puka 71c475af52
Fix GetUndistributableDependency (#7124)
This is a leftover task from merging enterprise to community.
Roles are distributed in community now, the comment is stale and the
check is redundant.
2023-08-17 10:57:22 +03:00
Gokhan Gulbiz a52e4a09ca
Fix artifacts path 2023-08-17 10:17:07 +03:00
Gokhan Gulbiz 0ed6ea1d4f
Minor fixes 2023-08-16 20:06:08 +03:00
Gokhan Gulbiz fbe76753b0
Fix downloaded artifacts folder 2023-08-16 19:42:07 +03:00
Gokhan Gulbiz 6005499df5
Fix invalid attribute 2023-08-16 19:31:06 +03:00
Gokhan Gulbiz acc18ec533
download artifact path fix 2023-08-16 19:29:10 +03:00
Gokhan Gulbiz 204df4bb4d
download artifact path fix 2023-08-16 19:07:23 +03:00
Gokhan Gulbiz 58da0c56c8
Artifact upload optimization 2023-08-16 19:04:13 +03:00
Gokhan Gulbiz 80db3f11c2
naming 2023-08-16 18:56:28 +03:00