Commit Graph

1097 Commits (290f9a63019f8597c2d649962d873d04736e13d3)

Author SHA1 Message Date
Marco Slot 290f9a6301 Move INSERT ... SELECT planning logic into one place 2017-06-29 15:03:14 +02:00
Önder Kalacı ad4f94bb7e Merge pull request #1463 from citusdata/partition_distributed_table_utils
Add some utility functions for partitioned tables
2017-06-28 09:50:30 +03:00
Onder Kalaci dc9b63504e Add some utility functions for partitioned tables
This commit is intended to be a base for supporting declarative partitioning
on distributed tables. Here we add the following utility functions and their
unit tests:

  * Very basic functions including differnentiating partitioned tables and
    partitions, listing the partitions
  * Generating the PARTITION BY (expr) and adding this to the DDL events
    of partitioned tables
  * Ability to generate text representations of the ranges for partitions
  * Ability to generate the `ALTER TABLE parent_table ATTACH PARTITION
    partition_table FOR VALUES value_range`
  * Ability to apply add shard ids to the above command using
    `worker_apply_inter_shard_ddl_command()`
  * Ability to generate `ALTER TABLE parent_table DETACH PARTITION`
2017-06-28 09:39:55 +03:00
Andres Freund e3dc462b93 Merge pull request #1470 from citusdata/remove_95
Remove 9.5 support.
2017-06-27 14:00:29 -07:00
Andres Freund 99795dc7c5 Update CONTRIBUTING.md to default to 9.6.
9.5 was not supported anymore, and 10 is not released yet. So 9.6
seems appropriate for now.
2017-06-26 18:09:23 -07:00
Andres Freund 3ab288bf66 Remove version check from pg_regress_multi.pl
The check is not necessary anymore after f59cf2b818.
2017-06-26 18:07:43 -07:00
Andres Freund 80483bcab2 Remove 9.5 references from comments in schedule files.
Replace with version-less reference, no point in repeating this for
every release.
2017-06-26 18:04:32 -07:00
Andres Freund 82b7cf7a8e fixup! Remove 9.5 specific C files. 2017-06-26 17:36:58 -07:00
Andres Freund 1a728f747b Remove 9.5 regression test output files. 2017-06-26 12:17:46 -07:00
Andres Freund c9c26ad81f Remove 9.5 related node wrappers.
Now that all branches support the extensible node infrastructure, we
don't need our wrappers anymore.
2017-06-26 08:46:32 -07:00
Andres Freund 7733154be0 Fix code only enabled for 9.5.
There's still supporting wrappers used, a subsequent commit will
remove those.

This also removes the already unused tuplecount_t define.
2017-06-26 08:46:32 -07:00
Andres Freund 0f3d41702e Remove 9.5 specific C files. 2017-06-26 08:46:32 -07:00
Andres Freund 92c3a56b5c Remove 9.5 support from configure and travis.
This effectively disables 9.5 support, but all the supporting code is
still there.  Subsequent commits will remove that.
2017-06-26 08:46:32 -07:00
Jason Petersen 05aef7ce29 Support PostgreSQL 10 (#1379)
Adds support for PostgreSQL 10 by copying in the requisite ruleutils
and updating all API usages to conform with changes in PostgreSQL 10.
Most changes are fairly minor but they are numerous. One particular
obstacle was the change in \d behavior in PostgreSQL 10's psql; I had
to add SQL implementations (views, mostly) to mimic the pre-10 output.
2017-06-26 02:35:46 -06:00
Andres Freund d2e772e6af Merge pull request #1461 from citusdata/feature/maintenanced
Add automatically started per-database Maintenance Worker
2017-06-23 12:12:31 -07:00
Andres Freund 2e7e40dc66 Add some tests checking that maintenance daemon gets started.
The 2nd database one is a bit slow, but also shows something
important, so we might want to keep it?
2017-06-23 11:53:39 -07:00
Andres Freund 62e7b67dc1 Introduce per-database maintenance process.
This will be used for deadlock detection, prepared transaction
recovery amongst others, but currently is just idling around.
2017-06-23 11:53:39 -07:00
Andres Freund 81f92d44d2 Minimal infrastructure for per-backend citus initialization. 2017-06-23 11:20:10 -07:00
Andres Freund 0df00a0955 Force cache invalidation machinery to be initialized earlier.
Previously it was not guaranteed that invalidations were registered
after creating the extension, only if the extension was used
afterwards.
2017-06-23 11:20:10 -07:00
Andres Freund 31b610a359 Centralized metadata_cache cache variables into one struct, to avoid missing resets.
E.g. extensionOwner was already missed.
2017-06-23 11:20:10 -07:00
Marco Slot d4295587aa Fix spuriously failing regression test 2017-06-23 10:06:15 +02:00
Marco Slot 8616088034 Merge pull request #1468 from citusdata/test_column_name
Add weird column name test for create_distributed_table
2017-06-22 17:14:17 +02:00
Marco Slot 5f84d8e0c4 Add weird column name to create_distributed_table test 2017-06-22 16:27:39 +02:00
Marco Slot 8178c770ef Merge pull request #1402 from citusdata/local_insert_select
Perform INSERT..SELECT via coordinator if it cannot be pushed down
2017-06-22 16:23:34 +02:00
Marco Slot 9d14e70716 Clarify error message when copying NULL value into table 2017-06-22 15:48:24 +02:00
Marco Slot f1c6c966f0 Execute INSERT..SELECT via coordinator if it cannot be pushed down
Add a second implementation of INSERT INTO distributed_table SELECT ... that is used if
the query cannot be pushed down. The basic idea is to execute the SELECT query separately
and pass the results into the distributed table using a CopyDestReceiver, which is also
used for COPY and create_distributed_table. When planning the SELECT, we go through
planner hooks again, which means the SELECT can also be a distributed query.

EXPLAIN is supported, but EXPLAIN ANALYZE is not because preventing double execution was
a lot more complicated in this case.
2017-06-22 15:46:30 +02:00
Marco Slot 688f5a11c7 Support quoted column-names in COPY logic 2017-06-22 15:45:57 +02:00
Marco Slot 7675d21151 Simplify router planner call path 2017-06-22 15:45:57 +02:00
Murat Tuncer 49e9f13963 Remove fall back to select if poll is not available (#1466)
poll is supported on all relevant systems, there is no
need to have a fall back mechanism to use select()
2017-06-22 12:11:18 +03:00
Jason Petersen ffaae84fa5 Don't call PostProcessUtility for local commands
It is intended only to aid in processing of distributed DDL commands,
but as written could execute during local CREATE INDEX CONCURRENTLY
commands.
2017-06-19 15:56:03 -06:00
Burak Yücesoy 2d7244eeb9 Merge pull request #1416 from citusdata/test_cache
Use cached PostgreSQL build to reduce testing time
2017-06-19 17:37:01 +03:00
Burak Yucesoy 907e913150 Use cached PostgreSQL build to reduce testing time
With this PR, we started to cache custom compiled PostgreSQL builds. If there
are no new commits to the related PostgreSQL branches, we will use already
compiled binaries to reduce testing time.
2017-06-19 11:12:41 +03:00
Burak Velioglu 1127844fb4 Merge pull request #1454 from citusdata/phase_out_execute_remote_query
Phase out execute remote query and command
2017-06-16 11:48:12 +03:00
velioglu 0cf67a3164 Delete ExecuteRemoteCommand function 2017-06-15 17:11:19 +03:00
velioglu 8706181b8a Convert DropShardsFromWorker to the new connection API 2017-06-15 15:24:06 +03:00
velioglu c8cebb91bb Convert TableDDLCommandList function to the new connection API 2017-06-14 17:29:58 +03:00
velioglu 1b07d9d396 Convert RemoteTableOwner function to the new connection API 2017-06-14 17:29:58 +03:00
velioglu 34eb8e78f7 Convert worker_fetch_foreign_file to new connection API 2017-06-14 17:29:58 +03:00
velioglu 0049f7334a Convert DistributedTableSizeOnWorker function to new connection API 2017-06-14 17:29:58 +03:00
Marco Slot 5230914bd3 Merge pull request #1435 from citusdata/unlogged_tables
Support unlogged tables
2017-06-14 14:42:42 +02:00
Marco Slot a6eb469ff5 Add support for unlogged distributed tables 2017-06-14 13:50:00 +02:00
Burak Velioglu fdbfde4952 Merge pull request #1448 from citusdata/fix_drop_shard_connection
Use placement connection to drop shards instead of node connection
2017-06-14 14:34:10 +03:00
velioglu 57bb512069 Use placement connection to drop shards instead of node connection 2017-06-14 14:14:59 +03:00
Marco Slot d71ef91705 Merge pull request #1441 from citusdata/remove_copy_xact_check
Allow COPY after a multi-shard command
2017-06-09 14:19:06 +02:00
Marco Slot 7396cbe9e2 Allow COPY after a multi-shard command
This change removes the XactModificationLevel check at the start of COPY
that was made redundant by consistently using GetPlacementConnection.
2017-06-09 13:54:58 +02:00
Jason Petersen 5353705dc3 Add ORDER clause to subquery test missing it 2017-06-08 18:30:14 -06:00
Jason Petersen d8083e5cb5 Remove tracked files from gitignore
Causes very hard-to-debug test failures.
2017-06-08 17:39:31 -06:00
Brian Cloutier 286916fa75 Add instructions for using citus_indent (#1434) 2017-06-05 13:21:47 +03:00
Metin Döşlü 2c508b4c89 Merge pull request #1431 from jmunsch/jmunsch_errmsg
Update to errmsg for mixed location insert into
2017-06-02 10:48:49 +03:00
jmunsch 2192638000 Clarify error message for local and distributed query plans. 2017-06-01 11:52:49 -07:00