external
/
citus
mirror of https://github.com/citusdata/citus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,614 Commits
637 Branches
162 Tags
96 MiB
Commit Graph

4614 Commits (union_all_join)

Author SHA1 Message Date
Onder Kalaci 68bda043c9 WIP 2021-02-15 18:50:59 +01:00
Onder Kalaci 6c903cd6f7 WIP 2021-02-15 18:44:04 +01:00
SaitTalhaNisanci 0f1ce7a913
Not skip relation in conversion if it doesn't have RelationRestriction (#4685) 
We would exclude tables without relationRestriction from conversion
candidates in local-distributed table joins. This could leave a leftover
local table which should have been converted to a subquery.

Ideally I would expect that in each call to CreateDistributedPlan we
would pass a new plan id, but that seems like a bigger change.
 2021-02-12 12:33:55 +03:00
Hadi Moshayedi 0f613ac31c
Merge pull request #4702 from citusdata/metadata_changes 
Move stripe.chunk_count to last position
 2021-02-11 21:06:57 -08:00
Hadi Moshayedi e690d8b79b Move stripe.chunk_count to last position 2021-02-11 17:00:44 -08:00
Hadi Moshayedi 1c4081ea5f
Merge pull request #4699 from citusdata/readme 
Columnar: update README to compare with cstore_fdw.
 2021-02-11 11:13:26 -08:00
Jeff Davis b96673de69 Columnar: update README to compare with cstore_fdw. 2021-02-11 10:47:27 -08:00
Hadi Moshayedi 277a773f5e
Merge pull request #4698 from citusdata/chunk-group-num 
Columnar: rename chunk_num -> chunk_group_num.
 2021-02-11 10:18:13 -08:00
Jeff Davis 1f1c3c362b Columnar: rename chunk_num -> chunk_group_num. 2021-02-11 09:27:00 -08:00
Önder Kalacı 1b5244c410
Merge pull request #4683 from citusdata/int_results_on_separate_conns 
Do not re-use connections for colocated intermediate results during COPY
 2021-02-11 16:40:28 +01:00
Onder Kalaci f297c96ec5 Add regression tests for COPY into colocated intermediate results 
To add the tests without too much data, make the copy switchover
configurable.
 2021-02-11 15:41:06 +01:00
Onder Kalaci 5d5a357487 Do not connection re-use for intermediate results 
/*
 * Colocated intermediate results are just files and not required to use
 * the same connections with their co-located shards. So, we are free to
 * use any connection we can get.
 *
 * Also, the current connection re-use logic does not know how to handle
 * intermediate results as the intermediate results always truncates the
 * existing files. That's why, we use one connection per intermediate
 * result.
 */
 2021-02-11 15:41:06 +01:00
Ahmet Gedemenli 01fb8f8124
Merge pull request #4674 from citusdata/fix-dropping-fkey 
Fix dropping fkey when distributing table
 2021-02-11 15:59:00 +03:00
Ahmet Gedemenli c8e83d1f26 Fix dropping fkey when distributing table 2021-02-11 15:48:35 +03:00
SaitTalhaNisanci 847b79078f
Not consider subplans in restriction list (#4679) 
* Not consider subplans in restriction list

* Not consider sublink, alternative subplan in restrictions
 2021-02-11 15:04:07 +03:00
Hadi Moshayedi 1d4b2e3fd0
Merge pull request #4680 from citusdata/fix_deadlock 
Don't include stripe reservation locks in lock graph
 2021-02-10 13:27:10 -08:00
Hadi Moshayedi c3dcd6b9f8 Columnar: don't include stripe reservation locks in lock graph. 2021-02-10 10:20:20 -08:00
Hadi Moshayedi 841d25bae9 Release metadata locks early 2021-02-10 10:20:12 -08:00
Onur Tirtir 7170ed287c
Merge pull request #4677 from citusdata/test-long-name-citus-local 
Test adding local table with long name to metadata
 2021-02-10 18:17:20 +03:00
Onur Tirtir ec7ab68f3b Test adding local table with long name to metadata 2021-02-10 18:05:04 +03:00
Onur Tirtir 9f619a85d6
Fix EXPLAIN ANALYZE exec when query returns no cols (#4672) 
We do not include dummy column if original task didn't return any
columns.
Otherwise, number of columns that original task returned wouldn't
match number of columns returned by worker_save_query_explain_analyze.
 2021-02-10 17:59:47 +03:00
Hadi Moshayedi 29d340331e
Merge pull request #4630 from citusdata/fix_4626 
Columnar: Fix zero column tables
 2021-02-09 23:12:08 -08:00
Hadi Moshayedi 52297804ae Fix zero column tables 2021-02-09 23:05:11 -08:00
Hadi Moshayedi d06f6658da
Merge pull request #4681 from citusdata/metadata_changes 
Columnar metadata changes
 2021-02-09 23:04:44 -08:00
Hadi Moshayedi 2d09c76b76 Rename storageid to storage_id 2021-02-09 19:57:04 -08:00
Hadi Moshayedi 8270b598b6 Rename stripeid, chunkid, and attnum 2021-02-09 19:50:50 -08:00
Hadi Moshayedi 9114fd4050 Move chunk.value_count to last position 2021-02-09 19:43:34 -08:00
Hadi Moshayedi ba937bf316
Merge pull request #4659 from citusdata/chunk_group 
Columnar: add chunk_group metadata table
 2021-02-09 14:21:36 -08:00
Hadi Moshayedi be90c20457 Fix write path for zero column tables 2021-02-09 14:14:06 -08:00
Hadi Moshayedi c8d61a31e2 Columnar: chunk_group metadata table 2021-02-09 14:11:58 -08:00
Önder Kalacı c2480343c7
Merge pull request #4666 from citusdata/write_to_local 
Allow local execution for co-located intermediate results in COPY
 2021-02-09 15:34:50 +01:00
Onder Kalaci c804c9aa21 Allow local execution for intermediate results in COPY 
When COPY is used for copying into co-located files, it was
not allowed to use local execution. The primary reason was
Citus treating co-located intermediate results as co-located
shards, and COPY into the distributed table was done via
"format result". And, local execution of such COPY commands
was not implemented.

With this change, we implement support for local execution with
"format result". To do that, we use the buffer for every file
on shardState->copyOutState, similar to how local copy on
shards are implemented. In fact, the logic is similar to
local copy on shards, but instead of writing to the shards,
Citus writes the results to a file.

The logic relies on LOCAL_COPY_FLUSH_THRESHOLD, and flushes
only when the size exceeds the threshold. But, unlike local
copy on shards, in this case we write the headers and footers
just once.
 2021-02-09 15:00:06 +01:00
Hadi Moshayedi 1d3b866df5
Merge pull request #4667 from citusdata/private-structs 
Columnar: make read and write state private.
 2021-02-08 10:24:02 -08:00
Jeff Davis 2ea31c899e Columnar: make read and write state private. 2021-02-08 10:11:57 -08:00
Hanefi Onaldi 353b080474
Fix Semmle errors (#4636) 
Co-authored-by: Halil Ozan Akgül <hozanakgul@gmail.com>
 2021-02-08 18:37:44 +03:00
SaitTalhaNisanci e96da4886f
Sort results in citus_shards and give raw size (#4649) 
* Sort results in citus_shards and give raw size

Sort results so that it is consistent and also similar to citus_tables.

Use raw size in the output so that doing operations on the size is
easier.

* Change column ordering
 2021-02-08 15:29:42 +03:00
Hadi Moshayedi 2a927522b9
Merge pull request #4655 from citusdata/fix_isolation 
Normalize isolation_metadata_sync_deadlock
 2021-02-06 16:13:37 -08:00
Hadi Moshayedi 3e6b54b964 Normalize isolation_metadata_sync_deadlock 2021-02-06 15:59:28 -08:00
Hadi Moshayedi eff8cffaf3
Columnar: improve naming of limit config variables. (#4653) 
* Rename chunk_row_count to chunk_group_row_limit

* Rename stripe_row_count to stripe_row_limit

* Undo couple of renames
 2021-02-06 09:04:04 -08:00
Hadi Moshayedi a7da38e71f
Merge pull request #4650 from citusdata/seq-permissions 
Columnar: Call nextval_internal instead of DirectFunctionCall.
 2021-02-06 02:53:10 -08:00
Jeff Davis b1882d4400 Columnar: Call nextval_internal instead of DirectFunctionCall. 2021-02-06 01:45:30 -08:00
Hadi Moshayedi 2c372b7b0e
Merge pull request #4654 from citusdata/fix_isolation 
Make isolation_metadata_sync_deadlock more resilient
 2021-02-06 01:44:27 -08:00
Hadi Moshayedi 4e53314e3f Make isolation_metadata_sync_deadlock more resilient 2021-02-06 01:05:24 -08:00
Hadi Moshayedi 75d9e4a206
Merge pull request #4645 from citusdata/fix-chunks 
Columnar: don't double count chunks filtered
 2021-02-05 11:04:31 -08:00
Hadi Moshayedi 0a9fd91d8f Use 'Chunk Groups' in EXPLAIN ANALYZE of columnar scan 2021-02-05 10:58:01 -08:00
Hadi Moshayedi 1d311b0709 Columnar: don't double count chunks filtered 2021-02-05 10:58:01 -08:00
Halil Ozan Akgül cbb95af2c2
Merge pull request #4580 from citusdata/convert-relabeltype-into-collateexpr-in-deparser 
Convert relabeltype into collateexpr in deparser
 2021-02-05 13:33:02 +03:00
Ahmet Gedemenli 5dd2a3da03 Convert RelabelTypes into CollateExprs in get_rule_expr function 2021-02-05 12:06:46 +03:00
Ahmet Gedemenli f96e93ab67
Merge pull request #4631 from citusdata/rename-master-parameter-for-dist-stat-activity 
Rename master to citus for dist stat activity cols
 2021-02-04 15:42:37 +03:00
Ahmet Gedemenli 503171d2f2
Merge branch 'master' into rename-master-parameter-for-dist-stat-activity 2021-02-04 15:37:13 +03:00