Commit Graph

2241 Commits (02c144378c3794c488c1fe19925eda64958ea2e9)

Author SHA1 Message Date
Marco Slot 02c144378c Add DESCRIPTION to PR template 2018-12-12 05:35:12 +01:00
Jason Petersen 92893e9601
Fix control file version 2018-12-11 18:50:20 -07:00
Jason Petersen bd0d1f05e7
Bump SQL version
Should have been done when the release-8.0 branch was created…
2018-12-11 10:40:15 -07:00
Hanefi Onaldi f12676e7b3
Added changelog entry for 7.5.4 (#2538) 2018-12-11 16:27:37 +03:00
Burak Velioglu 7aaf6b2cb3
Merge pull request #2533 from citusdata/fix_function_oid
Fix function oid
2018-12-10 14:33:50 +03:00
velioglu 90704d9a52 Fix getting function oid to get hll_add_agg id 2018-12-10 14:16:19 +03:00
velioglu 3e0cff94a6 Add FunctionOidExtended function 2018-12-10 11:59:41 +03:00
Nils Dijk 4af40eee76 Enable SSL by default during installation of citus 2018-12-07 11:23:19 -07:00
Burak Velioglu fd3b0044b4
Merge pull request #2523 from citusdata/disable_hashagg_hll
Adds support for disabling hash agg with hll functions on coordinator
2018-12-07 19:16:19 +03:00
velioglu 8764a19464 Adds support for disabling hash agg with hll functions on coordinator query 2018-12-07 18:49:25 +03:00
Marco Slot 298613824e
Merge pull request #2496 from citusdata/limit_transmit
Only allow transmit from pgsql_job_cache directory
2018-12-06 16:25:47 +01:00
Marco Slot 9cf91c438b Only allow transmit from pgsql_job_cache directory 2018-12-05 10:18:27 +01:00
Marco Slot 2967d8e65f
Merge pull request #2520 from citusdata/remove_memcpy
Remove odd memcpy usage in BuildCachedShardList
2018-12-04 19:32:33 +01:00
Marco Slot 7c2a2d08af
Merge pull request #2511 from citusdata/planner_readme
Expand planner readme
2018-12-04 14:29:37 +01:00
Marco Slot 70fb9c851b Remove odd memcpy usag in BuildCachedShardList 2018-12-04 14:09:10 +01:00
Marco Slot 96b091a1e5
Merge pull request #2516 from citusdata/security-audit
Review some strcpy/memcpy/strprintf/sscanf usage in the code.
2018-12-04 13:08:18 +01:00
Önder Kalacı cb119f4f73
Merge pull request #2514 from citusdata/fix_total_procs
Ensure to use initialized MaxBackends
2018-12-04 11:41:30 +01:00
Marco Slot 0388324fbe Expand planner readme 2018-12-04 09:55:19 +01:00
Dimitri Fontaine d1b182de7d Replace calls to unsafe functions like memcpy and sscanf
In answer to a security audit, we double check buffer sizes and avoid
known-dangerous operations such as sscanf.
2018-12-04 08:54:43 +01:00
Onder Kalaci 621ccf3946 Ensure to use initialized MaxBackends
Postgresql loads shared libraries before calculating MaxBackends.
However, Citus relies on MaxBackends being set. Thus, with this
commit we use the same steps to calculate MaxBackends while
Citus is being loaded (e.g., PG_Init is called).

Note that this is safe since all the elements that are used to
calculate MaxBackends are PGC_POSTMASTER gucs and a constant
value.
2018-12-03 13:25:51 +03:00
Onder Kalaci b6ebd791a6 Sort task list for multi-task explain outputs
This is purely for ensuring that regression tests do not randomly fail.
2018-11-30 11:19:37 -07:00
Önder Kalacı 89d32af3ad
Merge pull request #2509 from citusdata/fix_partitioning_test
Make sure the explain output for partition wise join is stable
2018-11-30 15:16:01 +01:00
Onder Kalaci 18c9badff5 Make sure the explain output for partition wise join is stable
We disable bunch of planning options on the workers. This might be
risky if any concurrent test relies on EXPLAIN OUTPUT as well. Still,
we want to keep this test, so we should try to not parallelize this
test with such test.
2018-11-30 16:44:57 +03:00
Burak Velioglu e2c4efbaa4
Merge pull request #2305 from citusdata/insert_select_onconflict
INSERT...SELECT via coordinator with ON CONFLICT/RETURNING
2018-11-30 16:23:49 +03:00
Marco Slot 8893cc141d Support INSERT...SELECT with ON CONFLICT or RETURNING via coordinator
Before this commit, Citus supported INSERT...SELECT queries with
ON CONFLICT or RETURNING clauses only for pushdownable ones, since
queries supported via coordinator were utilizing COPY infrastructure
of PG to send selected tuples to the target worker nodes.

After this PR, INSERT...SELECT queries with ON CONFLICT or RETURNING
clauses will be performed in two phases via coordinator. In the first
phase selected tuples will be saved to the intermediate table which
is colocated with target table of the INSERT...SELECT query. Note that,
a utility function to save results to the colocated intermediate result
also implemented as a part of this commit. In the second phase, INSERT..
SELECT query is directly run on the worker node using the intermediate
table as the source table.
2018-11-30 15:29:12 +03:00
Hanefi Onaldi a9c299473b
Merge pull request #2507 from citusdata/error_out_grouping_sets_in_subqueries
Error out when a subquery has grouping set clause
2018-11-30 15:14:45 +03:00
Hanefi Onaldi 088a2ef66a throw an error when a subquery has grouping set clause 2018-11-30 13:11:32 +03:00
Önder Kalacı 5a8c79430e
Merge pull request #2508 from citusdata/fix_citus_stat_activity
Ensure that citus_dist_activity test outputs do not change
2018-11-30 10:19:27 +01:00
Onder Kalaci a15f168ce4 Ensure that citus_dist_activity test outputs do not change
Since there is no lock ordering among the query that is executed
and the select from the view, we prefer to add a timeout before
priting the activity.
2018-11-30 11:46:17 +03:00
Nils Dijk e17d98b0e3
Merge pull request #2486 from citusdata/fix/create-distributed-table-as-owner
Fix create_distributed_table as non-table-owner
2018-11-29 16:16:34 +01:00
Nils Dijk 9309e63156
create_distributed_table as user, change table ownership during create 2018-11-29 14:20:42 +01:00
Nils Dijk 6aa191f72c
remove table_ddl_command_array and test master_get_table_ddl_events 2018-11-29 14:20:42 +01:00
Murat Tuncer cc2422efee
Merge pull request #2505 from citusdata/fix_stat_statements_view
Fix citus_stat_statements view
2018-11-29 16:16:52 +03:00
Murat Tuncer fd868ec268 Fix citus_stat_statements view
Join between pg_stat_statements and citus_query_stats should
include queryid, dbid, userid instead of just queryid.
2018-11-29 14:49:16 +03:00
Marco Slot a378a11da0
Merge pull request #2493 from citusdata/allow-adding-node-in-any-group
Refrain from having a strong opinion on maxGroupId.
2018-11-28 16:25:15 +01:00
Marco Slot 435a036328
Merge pull request #2494 from citusdata/notsolocky
Relax multi-shard modify locks when enable_deadlock_prevention is disabled
2018-11-28 15:21:44 +01:00
Jason Petersen e8f3b32b64
Add changelog entry for 8.0.1 2018-11-27 23:09:41 -07:00
Jason Petersen 70a65c0d10 Add changelog entry for 7.5.3 2018-11-27 21:28:50 -07:00
Dimitri Fontaine 5ae2d03881 Refrain from having a strong opinion on maxGroupId.
When initializing a Citus formation automatically from an external piece of
software such as Citus-HA, the following process process may be used:

  - decide on the groupId in the external software
  - SELECT * FROM master_add_inactive_node('localhost', 9701, groupid => X)

When Citus checks for maxGroupId, it forbids other software to pick their
own group Ids to ues with the master_add_inactive_node() API.

This patch removes the extra testing around maxGroupId.
2018-11-28 04:29:15 +01:00
Marco Slot 0393910c65 Shard IDs in isolation_citus_dist_stat_activity output changed 2018-11-28 02:59:50 +01:00
Marco Slot aff37cf1bc Control multi-shard modify locks with enable_deadlock_prevention 2018-11-28 02:59:50 +01:00
Marco Slot 6fd5c73444
Merge pull request #2492 from citusdata/udf_cleanup
Clean up UDFs and revoke unnecessary permissions
2018-11-26 14:21:34 +01:00
Marco Slot 1ec5b6c890 Remove old worker_hash_partition_table API 2018-11-26 14:40:37 +01:00
Marco Slot 5a63deab2e Clean up UDFs and remove unnecessary permissions 2018-11-26 14:40:37 +01:00
hanefi 27930aa462
Merge pull request #2488 from citusdata/validate_constraint
Validate Constraint Support
2018-11-26 15:20:01 +03:00
Hanefi Onaldi 448b241ab4 validate query isolation tests 2018-11-26 14:04:51 +03:00
Hanefi Onaldi 4edb193f25 make the tests parallelizeable
helper view table_fkeys_in_workers now allows filtering by schema so that a test case can print out foreign keys in its schema only
2018-11-26 14:04:51 +03:00
Hanefi Onaldi b3d897039a constraint validation regression tests 2018-11-26 14:04:51 +03:00
Hanefi Onaldi 7db6991dc0 propagate validate queries to workers 2018-11-26 14:04:51 +03:00
Marco Slot 2afbb89673
Merge pull request #2490 from citusdata/fix_tt_protocol
Check ownership in task-tracker protocol functions
2018-11-26 11:45:50 +01:00