Commit Graph

2662 Commits (ea2e010d42cd65a16643649f3e0020f490773bcc)

Author SHA1 Message Date
Murat Tuncer 3b95a03c3e
Merge branch 'master' into fix_spinlock_use 2018-12-25 14:41:21 +03:00
Hadi Moshayedi 38579d52d0
Speed-up run_command_on_shards(). (#2564)
We were establishing connections synchronously. Establishing
connections asynchronously results in some parallelization, saving
hundreds of milliseconds.

In a test I did, this decreased the query time from 150ms to 40ms.
2018-12-24 08:47:01 -05:00
Murat Tuncer 9671bc3cbb Make sure spinlock is not left unreleased when an exception is thrown
A spinlock is not released when an exception is thrown after
spinlock is acquired. This has caused infinite wait and eventual
crash in maintenance daemon.

This work moves the code than can fail to the outside of spinlock
scope so that in the case of failure spinlock is not left locked
since it was not locked in the first place.
2018-12-24 15:47:21 +03:00
Hanefi Onaldi fb497ddad1
Bump 8.2devel on master (#2567) 2018-12-24 13:49:50 +03:00
Jason Petersen 9da2254bfb
Merge pull request #2541 from citusdata/disable_appveyor
Disable appveyor

cr: @jasonmp85
2018-12-21 16:40:40 -07:00
Onder Kalaci 8dee92bad2
Revert adb4669 2018-12-21 15:36:41 -07:00
Onder Kalaci 9fff7d28a7
Revert 4925521 2018-12-21 15:36:40 -07:00
Jason Petersen ca83c48097
Merge pull request #2559 from citusdata/concurrent_concurrently
Execute CREATE INDEX CONCURRENTLY in parallel

cr: @jasonmp85
2018-12-21 15:36:17 -07:00
Marco Slot 2e4029973c
Remove sequential create index concurrently test 2018-12-21 14:03:00 -07:00
Marco Slot 1b1c6374f7
Execute CREATE INDEX CONCURRENTLY concurrently 2018-12-21 14:02:59 -07:00
Hadi Moshayedi eb398580f7
Git ignore LLVM bitcode files. (#2565) 2018-12-21 14:55:24 -05:00
Marco Slot 6ca91c1332
Merge pull request #2563 from citusdata/transactions_pgmonitor
Restrict visibility of get_*_active_transactions functions to pg_monitor
2018-12-21 14:40:34 +01:00
Marco Slot 8a54999c5c
Merge pull request #2561 from citusdata/run-time-bound-check
Move an assert-only array-bound check to run-time.
2018-12-20 17:09:04 +01:00
Marco Slot 3ff2b47366 Restrict visibility of get_*_active_transactions functions to pg_monitor 2018-12-19 18:32:42 +01:00
Dimitri Fontaine 6a1a2b8458 Move an assert-only array-bound check to run-time.
When the bound-check fails at run-time, better abort with an error message
rather than trying to user memory we did not allocate.
2018-12-19 06:12:05 +01:00
Marco Slot 13f4a0ac9f Stabilize failure test shard IDs 2018-12-19 04:26:46 +01:00
Marco Slot 5b9376a7f8 Check ownership before taking locks in distributed table creation 2018-12-18 15:32:07 +01:00
Hanefi Onaldi 88717f31b3
Citus 8.1.0 changelog 1545053355 (#2553)
* Add changelog entry for 8.1.0
2018-12-18 14:48:34 +03:00
Hanefi Onaldi 878af61fa6
Add changelog entry for 8.0.2 (#2546) 2018-12-14 16:54:31 +03:00
Nils Dijk 595179706c
Merge pull request #2540 from citusdata/fix/enforce-tls
upgrade default ssl_ciphers to more restrictive on extension creation
2018-12-12 15:56:59 +01:00
Nils Dijk 694992e946
upgrade default ssl_ciphers to more restrictive on extension creation
Show ssl_ciphers in ssl_by_default_test
2018-12-12 15:33:15 +01:00
Marco Slot 02c144378c Add DESCRIPTION to PR template 2018-12-12 05:35:12 +01:00
Jason Petersen 92893e9601
Fix control file version 2018-12-11 18:50:20 -07:00
Jason Petersen bd0d1f05e7
Bump SQL version
Should have been done when the release-8.0 branch was created…
2018-12-11 10:40:15 -07:00
Hanefi Onaldi f12676e7b3
Added changelog entry for 7.5.4 (#2538) 2018-12-11 16:27:37 +03:00
Burak Velioglu 7aaf6b2cb3
Merge pull request #2533 from citusdata/fix_function_oid
Fix function oid
2018-12-10 14:33:50 +03:00
velioglu 90704d9a52 Fix getting function oid to get hll_add_agg id 2018-12-10 14:16:19 +03:00
velioglu 3e0cff94a6 Add FunctionOidExtended function 2018-12-10 11:59:41 +03:00
Nils Dijk 4af40eee76 Enable SSL by default during installation of citus 2018-12-07 11:23:19 -07:00
Burak Velioglu fd3b0044b4
Merge pull request #2523 from citusdata/disable_hashagg_hll
Adds support for disabling hash agg with hll functions on coordinator
2018-12-07 19:16:19 +03:00
velioglu 8764a19464 Adds support for disabling hash agg with hll functions on coordinator query 2018-12-07 18:49:25 +03:00
Marco Slot 298613824e
Merge pull request #2496 from citusdata/limit_transmit
Only allow transmit from pgsql_job_cache directory
2018-12-06 16:25:47 +01:00
Marco Slot 9cf91c438b Only allow transmit from pgsql_job_cache directory 2018-12-05 10:18:27 +01:00
Marco Slot 2967d8e65f
Merge pull request #2520 from citusdata/remove_memcpy
Remove odd memcpy usage in BuildCachedShardList
2018-12-04 19:32:33 +01:00
Marco Slot 7c2a2d08af
Merge pull request #2511 from citusdata/planner_readme
Expand planner readme
2018-12-04 14:29:37 +01:00
Marco Slot 70fb9c851b Remove odd memcpy usag in BuildCachedShardList 2018-12-04 14:09:10 +01:00
Marco Slot 96b091a1e5
Merge pull request #2516 from citusdata/security-audit
Review some strcpy/memcpy/strprintf/sscanf usage in the code.
2018-12-04 13:08:18 +01:00
Önder Kalacı cb119f4f73
Merge pull request #2514 from citusdata/fix_total_procs
Ensure to use initialized MaxBackends
2018-12-04 11:41:30 +01:00
Marco Slot 0388324fbe Expand planner readme 2018-12-04 09:55:19 +01:00
Dimitri Fontaine d1b182de7d Replace calls to unsafe functions like memcpy and sscanf
In answer to a security audit, we double check buffer sizes and avoid
known-dangerous operations such as sscanf.
2018-12-04 08:54:43 +01:00
Onder Kalaci 621ccf3946 Ensure to use initialized MaxBackends
Postgresql loads shared libraries before calculating MaxBackends.
However, Citus relies on MaxBackends being set. Thus, with this
commit we use the same steps to calculate MaxBackends while
Citus is being loaded (e.g., PG_Init is called).

Note that this is safe since all the elements that are used to
calculate MaxBackends are PGC_POSTMASTER gucs and a constant
value.
2018-12-03 13:25:51 +03:00
Onder Kalaci b6ebd791a6 Sort task list for multi-task explain outputs
This is purely for ensuring that regression tests do not randomly fail.
2018-11-30 11:19:37 -07:00
Önder Kalacı 89d32af3ad
Merge pull request #2509 from citusdata/fix_partitioning_test
Make sure the explain output for partition wise join is stable
2018-11-30 15:16:01 +01:00
Onder Kalaci 18c9badff5 Make sure the explain output for partition wise join is stable
We disable bunch of planning options on the workers. This might be
risky if any concurrent test relies on EXPLAIN OUTPUT as well. Still,
we want to keep this test, so we should try to not parallelize this
test with such test.
2018-11-30 16:44:57 +03:00
Burak Velioglu e2c4efbaa4
Merge pull request #2305 from citusdata/insert_select_onconflict
INSERT...SELECT via coordinator with ON CONFLICT/RETURNING
2018-11-30 16:23:49 +03:00
Marco Slot 8893cc141d Support INSERT...SELECT with ON CONFLICT or RETURNING via coordinator
Before this commit, Citus supported INSERT...SELECT queries with
ON CONFLICT or RETURNING clauses only for pushdownable ones, since
queries supported via coordinator were utilizing COPY infrastructure
of PG to send selected tuples to the target worker nodes.

After this PR, INSERT...SELECT queries with ON CONFLICT or RETURNING
clauses will be performed in two phases via coordinator. In the first
phase selected tuples will be saved to the intermediate table which
is colocated with target table of the INSERT...SELECT query. Note that,
a utility function to save results to the colocated intermediate result
also implemented as a part of this commit. In the second phase, INSERT..
SELECT query is directly run on the worker node using the intermediate
table as the source table.
2018-11-30 15:29:12 +03:00
Hanefi Onaldi a9c299473b
Merge pull request #2507 from citusdata/error_out_grouping_sets_in_subqueries
Error out when a subquery has grouping set clause
2018-11-30 15:14:45 +03:00
Hanefi Onaldi 088a2ef66a throw an error when a subquery has grouping set clause 2018-11-30 13:11:32 +03:00
Önder Kalacı 5a8c79430e
Merge pull request #2508 from citusdata/fix_citus_stat_activity
Ensure that citus_dist_activity test outputs do not change
2018-11-30 10:19:27 +01:00
Onder Kalaci a15f168ce4 Ensure that citus_dist_activity test outputs do not change
Since there is no lock ordering among the query that is executed
and the select from the view, we prefer to add a timeout before
priting the activity.
2018-11-30 11:46:17 +03:00