Commit Graph

2857 Commits (fix_120_custom_aggregates_distribute_multiarg)

Author SHA1 Message Date
Philip Dubé 9abe31e34d mark_aggregate_for_distributed_execution: EnsureSuperUser for AGGREGATION_STRATEGY_COMBINE 2019-10-21 19:35:19 +00:00
Philip Dubé 8fe885b457 Update citus_finish_pg_upgrade with aggregation_strategy column 2019-10-18 20:55:20 +00:00
Philip Dubé 205f48f432 Add input validation testing for mark_aggregate_for_distributed_execution 2019-10-18 20:42:47 +00:00
Philip Dubé 005b4d00f7 Fix attributes on mark_aggregate_for_distributed_execution 2019-10-18 20:41:45 +00:00
Philip Dubé 79fde86d6c Fix regression in distributing sum aggregation 2019-10-18 20:29:47 +00:00
Philip Dubé 04b5dc39bc distributed_functions: test aggregation strategies 2019-10-18 20:29:12 +00:00
Philip Dubé 364b33a22d mark_aggregate_for_distributed_execution: Add some parameter validation 2019-10-18 18:45:40 +00:00
Philip Dubé 9b3260f4df AGGREGATE_STRATEGY_COMMUTE 2019-10-18 18:45:40 +00:00
Philip Dubé a720929a8b Remove print debugging 2019-10-18 18:45:40 +00:00
Philip Dubé f5b038e2bc Fixes from testing. Seems to be working 2019-10-18 18:45:40 +00:00
Philip Dubé 070ffc785f Fix compile issues 2019-10-18 18:45:40 +00:00
Philip Dubé 1545cb312c Sketched out rest of how mark_aggregate_for_distributed_execution should look like 2019-10-18 18:45:40 +00:00
Philip Dubé 020921f1eb Fixes from testing with create_distributed_function 2019-10-18 18:45:40 +00:00
Philip Dubé 47318ee7e0 Fix logging messages a bit 2019-10-18 18:45:40 +00:00
Philip Dubé 79f4fdbc89 Use pg_dist_object, remove pg_dist_enabled_custom_aggregates 2019-10-18 18:45:40 +00:00
Philip Dubé ec4f8b23e7 Update expected/multi_metadata_access 2019-10-18 18:45:40 +00:00
Philip Dubé dd5916ef3a Move custom aggregates into a not-default path, add pg_dist_enabled_custom_aggregates to have a set of allowed aggregates as it's possible for aggregates to not be compatible with this implementation 2019-10-18 18:45:40 +00:00
Philip Dubé 9d19f2d810 aggregate_utils: remove elog debugging 2019-10-18 18:45:40 +00:00
Philip Dubé d1aefe240b Now able to figure out that the average of 1,2,3 is 2. Next: clean up all the logspam, make sure value_init is being handled properly everywhere 2019-10-18 18:45:40 +00:00
Philip Dubé 5b25204dda Gets as far as calling array_send, which seems to be getting an invalid array, maybe a memory context issue 2019-10-18 18:45:40 +00:00
Philip Dubé 22c6dc7f84 Fix compiling against pg12 2019-10-18 18:45:40 +00:00
Philip Dubé 17ed25e09a Fix multi_logical_optimizer merge regression. aggregate_utils still needs fixing 2019-10-18 18:45:40 +00:00
Philip Dubé 5d6ee5104b Get things working enough that code is executing & giving nonsense like avg() wanting to create arrays with 16777216 dimensions 2019-10-18 18:45:40 +00:00
Philip Dubé 1a7bf4ca2c Initial sketch of aggregate expression transforms 2019-10-18 18:45:40 +00:00
Philip Dubé c801889e08 return the right bytes 2019-10-18 18:45:40 +00:00
Philip Dubé baef1d2f85 Clean up code to point that it compiles 2019-10-18 18:45:40 +00:00
Philip Dubé 186f632f88 ReleaseSysCache in logical_optimizer 2019-10-18 18:45:40 +00:00
Philip Dubé a82fa8831c First rough draft of aggregate logic done. Still need query rewriting logic before being able to test 2019-10-18 18:45:40 +00:00
Philip Dubé 77fc5f91ab Pseudocode mostly restored from deleting my repo yesterday, started writing broken pseudo-C 2019-10-18 18:45:40 +00:00
Philip Dubé 40a5e3128b Initial custom aggregates. Very WIP. Only a branch because I like backups. Will squash someday 2019-10-18 18:45:40 +00:00
Philip Dubé c32bd459f4 create_distributed_function: accept aggregates 2019-10-18 18:45:40 +00:00
Halil Ozan Akgül 210a6cc04b
Merge pull request #3111 from citusdata/refresh_materialized_view_with_subquery
Refresh Materialized View with Subquery
2019-10-17 16:07:35 +03:00
Halil Ozan Akgul 5f04ac774f Adds the tests for refresh materialized views 2019-10-17 16:00:56 +03:00
Önder Kalacı e065933928 Remove all the non-adaptive test schedules (#3112)
Just because we'll remove the executors soon, and it doesn't
make sense to keep them running.

I'll remove the tests files with a follow-up commit, but it seems
safe to remove them from circleci now.
2019-10-17 10:39:31 +03:00
Jelte Fennema 7abedc38b0
Support subqueries in HAVING (#3098)
Areas for further optimization:
- Don't save subquery results to a local file on the coordinator when the subquery is not in the having clause
- Push the the HAVING with subquery to the workers if there's a group by on the distribution column
- Don't push down the results to the workers when we don't push down the HAVING clause, only the coordinator needs it

Fixes #520
Fixes #756
Closes #2047
2019-10-16 16:40:14 +02:00
Onur TIRTIR 3bfb2a078b
Make changes on if-statement in ExtractRangeTableList for furhter walker types (#3110) 2019-10-16 15:50:09 +03:00
Onur TIRTIR d5f83dc110
Refactor range table walkers (#3109) 2019-10-16 01:20:49 +03:00
SaitTalhaNisanci 94a7e6475c
Remove copyright years (#2918)
* Update year as 2012-2019

* Remove copyright years
2019-10-15 17:44:30 +03:00
Jelte Fennema 9b2f4d71ac
Make sure some MX tests use defined shard_ids (#3103) 2019-10-12 22:46:14 +02:00
Philip Dubé 74cb168205 Remove Postgres 10 support 2019-10-11 21:56:56 +00:00
SaitTalhaNisanci 95633416f7 remove pg10 from pg upgrade tests (#3102) 2019-10-11 10:30:06 +02:00
Hadi Moshayedi 3fb9c63890
Merge pull request #3100 from citusdata/fix_typo
Fix a typo
2019-10-10 11:16:11 -07:00
Hadi Moshayedi b50d216536 Fix a typo 2019-10-10 10:44:41 -07:00
Philip Dubé 4063e7ca67 CALL delegation: apply strip_implicit_coercions to distribution argument 2019-10-10 17:42:43 +00:00
Philip Dubé 7ffd78b6e0 isolation_multiuser_locking
Introduce a test which checks that locks are only acquired when a user has necessary permissions
Currently tests REINDEX, CREATE INDEX, TRUNCATE
2019-10-10 16:58:41 +00:00
Philip Dubé dd490b6376 Cache whether an object is in pg_dist_object. Avoids redundant lookups for non-distributed objects 2019-10-10 14:50:38 +00:00
Hanefi Onaldi 2a47cff7b7
Bump citus to 9.0.0 2019-10-09 11:33:58 +03:00
Jelte Fennema f0f702c604
Add sane editorconfig settings (#3051)
- UNIX line endings
- utf8
- newline at end of file
- trim trailing whitespace
2019-10-08 15:07:01 +02:00
SaitTalhaNisanci 83667436f7
add support to run citus upgrade tests locally (#3083)
* add support to run citus upgrade tests locally

* dont build tars if they already exist

* use current code instead of master for upgrade

* always build the current code

* copy the current citus code to have isolated citus upgrade tests

* fix configure and simplify copy
2019-10-08 15:32:44 +03:00
Nils Dijk 4a4a220945
Fix enum add value order and pg12 (#3082)
DESCRIPTION: Fix order for enum values and correctly support pg12

PG 12 introduces `ALTER TYPE ... ADD VALUE ...` during transactions. Earlier versions would error out when called in a transaction, hence we connect to workers outside of the transaction which could cause inconsistencies on pg12 now that postgres doesn't error with this syntax anymore.

During the implementation of this fix it became apparent there was an error with the ordering of enum labels when the type was recreated. A patch and test have been included.
2019-10-07 17:16:19 +02:00