Commit Graph

153 Commits (8b14839c0f0b9ab9310db30ad8c13fc4fa9ea3a1)

Author SHA1 Message Date
Gokhan Gulbiz 1774385e90
revert 16core vm 2023-08-22 09:51:27 +03:00
Gokhan Gulbiz e39a421d54
16core 2023-08-21 22:27:32 +03:00
Gokhan Gulbiz 2a6dbc6e4c
32core vm for test-citus 2023-08-21 22:21:56 +03:00
Gokhan Gulbiz 601a5f09b2
32core vm for build 2023-08-21 22:21:15 +03:00
Gokhan Gulbiz 7779d8926a
Fix condition check 2023-08-21 22:09:56 +03:00
Gokhan Gulbiz 5fe3ae718c
16core vm 2023-08-21 21:56:27 +03:00
Gokhan Gulbiz 2ed1e760d1
Cleanup 2023-08-21 21:56:18 +03:00
Gokhan Gulbiz abe4c4223b
fix condition 2023-08-21 18:26:23 +03:00
Gokhan Gulbiz 95c9d26de1
skip_installation for test-citus-upgrade 2023-08-21 18:05:40 +03:00
Gokhan Gulbiz e3689c57dd
Fix test-arbitrary-configs 2023-08-21 17:23:23 +03:00
Gokhan Gulbiz f4a358e557
Fix path and permissions 2023-08-21 16:51:39 +03:00
Gokhan Gulbiz 27b47a2671
Path fix 2023-08-21 16:31:26 +03:00
Gokhan Gulbiz 4aab1376b1
fixe upgrade tests 2023-08-21 16:19:42 +03:00
Gokhan Gulbiz 0af5f401c9
Minor updates 2023-08-21 15:49:41 +03:00
Gokhan Gulbiz 035c6da84e
minor fixes 2023-08-21 15:20:12 +03:00
Gokhan Gulbiz ef206716ba
Fix install extension 2023-08-21 15:11:32 +03:00
Gokhan Gulbiz 5f0f5cda90
Fix install extension 2023-08-21 13:14:40 +03:00
Gokhan Gulbiz ac17f07609
Fix install extension 2023-08-21 13:08:01 +03:00
Gokhan Gulbiz b691fc098b
Fix install extension 2023-08-21 12:59:43 +03:00
Gokhan Gulbiz d877f2d2a1
Fix install extension 2023-08-21 12:42:25 +03:00
Gokhan Gulbiz a80186d7f8
Fix install_extension 2023-08-21 12:33:15 +03:00
Gokhan Gulbiz de7d896ac4
Enable test-citus 2023-08-21 11:37:19 +03:00
Gokhan Gulbiz 2f65a2c770
Fix test-arbitrary-configs 2023-08-21 11:36:39 +03:00
Gokhan Gulbiz c46eeb2e86
Fix test-citus-upgrade 2023-08-21 11:31:02 +03:00
Gokhan Gulbiz 0a63f31d65
fix test-flakyness 2023-08-21 11:28:24 +03:00
Gokhan Gulbiz d2d79070b3
Fix test-arbitrary-config 2023-08-21 11:15:06 +03:00
Gokhan Gulbiz 76196d5fa1
test-flakyness 2023-08-21 11:14:40 +03:00
Gokhan Gulbiz 114574b365
tpcc_benchmark 2023-08-21 11:14:14 +03:00
Gokhan Gulbiz 698a5f0766
ch_benchmark 2023-08-21 11:13:59 +03:00
Gokhan Gulbiz 5c4852d37a
upload-coverage 2023-08-21 11:13:43 +03:00
Gokhan Gulbiz 16a55cb11f
test-citus-upgrade 2023-08-21 11:13:19 +03:00
Gokhan Gulbiz a9c4bb55f7
Remove empty new line 2023-08-21 11:12:39 +03:00
Gokhan Gulbiz 072d7be441
Remove workflow env variables. 2023-08-21 11:12:07 +03:00
Gokhan Gulbiz eb73c20630
Parallelism 2023-08-21 09:59:39 +03:00
Gokhan Gulbiz 9419b4b6cb
fix parallelization 2023-08-18 16:28:30 +03:00
Gokhan Gulbiz 5347a5107e
fix 2023-08-18 15:38:33 +03:00
Gokhan Gulbiz b7e6eff7e0
check-query-generator and pgupgrade 2023-08-18 15:30:27 +03:00
Gokhan Gulbiz 48ec1b81d9
test-arbitrary-configs 2023-08-18 14:13:45 +03:00
Gokhan Gulbiz dd088d3b3f
Refactoring 2023-08-18 14:12:50 +03:00
Gokhan Gulbiz c1904c46c0
Cleanup 2023-08-18 14:03:32 +03:00
Gokhan Gulbiz 16d03c9a19
Cleanup 2023-08-18 13:47:07 +03:00
Gokhan Gulbiz 3a40fce4ba
Naming refactorings 2023-08-18 13:05:38 +03:00
Gokhan Gulbiz 7d7f282ecf
Fix double quote 2023-08-18 10:04:11 +03:00
Gokhan Gulbiz 088d70a82a
Cleanup 2023-08-18 10:02:22 +03:00
Gokhan Gulbiz 609fbc8fde
Diff markdown 2023-08-18 09:39:16 +03:00
Gokhan Gulbiz f67f468296
better wildcard usage 2023-08-17 17:37:44 +03:00
Gokhan Gulbiz 13ceea3274
narrow down upload path 2023-08-17 17:29:30 +03:00
Gokhan Gulbiz 903196c8a2
minor fixes 2023-08-17 17:22:54 +03:00
Gokhan Gulbiz 136382472a
fix wildcard path 2023-08-17 17:00:13 +03:00
Gokhan Gulbiz 451d6d8eda
fix step summary 2023-08-17 16:40:19 +03:00
Gokhan Gulbiz f655f6d360
Set timeout 2023-08-17 16:24:57 +03:00
Gokhan Gulbiz 5626f58a9b
Fix log processing 2023-08-17 16:04:59 +03:00
Gokhan Gulbiz 59dbf06153
cdc and tap tests 2023-08-17 15:31:19 +03:00
Gokhan Gulbiz c9c2d87654
Update matrix 2023-08-17 15:00:03 +03:00
Gokhan Gulbiz c0a19983d8
Update matrix 2023-08-17 14:52:06 +03:00
Gokhan Gulbiz f02882765a
Env var fix 2023-08-17 14:42:11 +03:00
Gokhan Gulbiz 1bc08df1a0
Naming 2023-08-17 14:38:02 +03:00
Gokhan Gulbiz fb937db14a
Add PG_MAJOR as Github Env Var 2023-08-17 14:31:52 +03:00
Gokhan Gulbiz f14938a095
Add PG_MAJOR as Github Env Var 2023-08-17 14:30:20 +03:00
Gokhan Gulbiz 5afb9a1496
Add PG_MAJOR as Github Env Var 2023-08-17 14:18:03 +03:00
Gokhan Gulbiz 4dd0a8aa62
Test 2023-08-17 13:57:43 +03:00
Gokhan Gulbiz c77306d26d
Try to evaluate env variable case-sensitivity 2023-08-17 13:50:18 +03:00
Gokhan Gulbiz 20f8baabe8
Do not override PG_MAJOR 2023-08-17 13:45:07 +03:00
Gokhan Gulbiz 0e3a292204
Use env variable for PG_MAJOR 2023-08-17 13:44:16 +03:00
Gokhan Gulbiz 0fd2e9bfa2
Reorganize failtester matrix 2023-08-17 13:11:03 +03:00
Gokhan Gulbiz 97a8a31cef
Include check-failure in matrix 2023-08-17 12:53:55 +03:00
Gokhan Gulbiz f4bc9796f2
Fetch all branches to be able to run git diff.. 2023-08-17 12:31:30 +03:00
Gokhan Gulbiz 0ba0c685b3
Set user to root for sql snapshots 2023-08-17 12:20:46 +03:00
Gokhan Gulbiz 6127fe3556
Fix newline issues 2023-08-17 12:20:27 +03:00
Gokhan Gulbiz cf62647396
Safe directory configuration 2023-08-17 12:17:17 +03:00
Gokhan Gulbiz 812077e74d
Change default user to circleci 2023-08-17 12:11:30 +03:00
Gokhan Gulbiz c1ff845ae3
Run container image with root user 2023-08-17 12:07:56 +03:00
Gokhan Gulbiz 01e2596b2c
Fix for check-sql-snapshots and check-style issues 2023-08-17 12:06:28 +03:00
Gokhan Gulbiz 91e3229be7
Stack trace and upload covarage run always 2023-08-17 12:01:44 +03:00
Gokhan Gulbiz 9c47dbabd8
Matrix customization for failtester 2023-08-17 11:53:01 +03:00
Gokhan Gulbiz a52e4a09ca
Fix artifacts path 2023-08-17 10:17:07 +03:00
Gokhan Gulbiz 0ed6ea1d4f
Minor fixes 2023-08-16 20:06:08 +03:00
Gokhan Gulbiz fbe76753b0
Fix downloaded artifacts folder 2023-08-16 19:42:07 +03:00
Gokhan Gulbiz 6005499df5
Fix invalid attribute 2023-08-16 19:31:06 +03:00
Gokhan Gulbiz acc18ec533
download artifact path fix 2023-08-16 19:29:10 +03:00
Gokhan Gulbiz 204df4bb4d
download artifact path fix 2023-08-16 19:07:23 +03:00
Gokhan Gulbiz 58da0c56c8
Artifact upload optimization 2023-08-16 19:04:13 +03:00
Gokhan Gulbiz 80db3f11c2
naming 2023-08-16 18:56:28 +03:00
Gokhan Gulbiz a5a65ccb4b
Fix container image suffix 2023-08-16 18:54:58 +03:00
Gokhan Gulbiz 6f883f3f80
Use root user for container images 2023-08-16 18:46:05 +03:00
Gokhan Gulbiz 1d21f505f2
Fix parameter binding 2023-08-16 18:43:37 +03:00
Gokhan Gulbiz 13b62fe32f
Fix file path 2023-08-16 18:40:12 +03:00
Gokhan Gulbiz 488271f2ad
Fix image suffix. 2023-08-16 18:32:54 +03:00
Gokhan Gulbiz 2c9375b7bf
Initial commit for citus testing on GHA 2023-08-16 18:20:30 +03:00
Gokhan Gulbiz 48a987e12c
Reorganize upload artifact folder structure 2023-08-16 18:19:32 +03:00
Gokhan Gulbiz b3adf9c462
Reorganize env variables and inputs. 2023-08-16 18:18:51 +03:00
Gokhan Gulbiz f5c680fdc9
Reorder required params. 2023-08-07 15:27:34 +03:00
Gokhan Gulbiz 50dd50f4b5
Flaky test debugging on GHA 2023-08-07 15:23:42 +03:00
Gürkan İndibay 3f0e1efb5a
Fixes error surpressions in packaging pipelines (#7054)
DESCRIPTION: PR description that will go into the change log, up to 78
characters

There are 4 errors arised recently and I fixed them in this PR. Problems
and fixes are as below:
1. When executing make step in packaging pipeline, if it gets error, we
can not detect it since there are additional operations after make in
one line.
With this fix, now if an error occured after make execution, we can
detect and see the step red and failed here,

2. Recently we started to get the error ` fatal: detected dubious
ownership in repository at '/__w/citus/citus' ` as below

https://github.com/citusdata/citus/actions/runs/5542692968/jobs/10117706723#step:7:9
There is a fix for that one as well.

3. fixed the requirements issue arised related to urllib3 library
version
4. Getting errors with centos-8 docker image with the new postgres-dev
packages. Now, changed centos-8 image with almalinux-8 and now it works
2023-07-24 14:44:27 +03:00
Gürkan İndibay 7b8e614039
Fixes bookworm packaging pipeline problem (#6737)
Recently, I changed Python execution structure into virtual. Therefore,
now there is no need change built in python for the images. Since Github
is provisioning images with specific permissions, this issue caused
error.
With this PR, I removed unnecessary installation of pip and setuptools
in container docker image
Additionally, removed some unnecessary sudos and used ap-get instead of
apt in one place
2023-02-27 15:28:36 +03:00
Hanefi Onaldi 414a95e259
Create CodeQL workflow for static analysis (#5868)
Introducing a new Github Actions Workflow to run our statical analysis
tool, CodeQL.

Relevant Github docs page:
https://docs.github.com/en/code-security/code-scanning/automatically-scanning-your-code-for-vulnerabilities-and-errors/customizing-code-scanning

The Github action that we use for security scanning:
https://github.com/github/codeql-action
2023-02-07 15:25:17 +03:00
Gürkan İndibay d919506076
Fixes validate Output phase of packaging pipeline (#6678)
Pyenv is installed in our container images but I found out that pyenv is
not being activated since it is activated from ~/bashrc script and in
GitHub Actions (GHA) this script is not being executed
Since pyenv is not activated, default python versions comes from docker
images is being used and in this case we get errors for python version
3.11.
Additionally, $HOME directory is /github/home for containers executed
under GHA and our pyenv installation is under /root directory which is
normally home directory for our packaging containers
This PR activates usage of pyenv and additionally uses pyenv virtualenv
feature to execute validate_output function in isolation

---------

Co-authored-by: Onur Tirtir <onurcantirtir@gmail.com>
2023-01-31 13:59:09 +03:00
Jelte Fennema 17775dad5d
Only run package builds on pull requests (#6605)
Recently a package test build pipeline was introduced, to build citus on
all OS that we build packages for. However, every pull request would run
each build twice. This fixes that by only running it for the pull
request event, not for the push event.

Example of duplicate run:

![image](https://user-images.githubusercontent.com/1162278/211028723-8c0e8aa0-e267-4665-811c-6cecd4286621.png)
2023-01-06 16:02:49 +00:00
Gokhan Gulbiz 556161be32
Fix make recipe mapping in test runner (#6561) 2022-12-14 12:57:13 +03:00
Gürkan İndibay c2193608c9
Add jobs to test builds on different distros (#6499)
With this PR, citus code will be tested in all packaging environments. 
Sometimes, there can be compile errors which blocks packaging and in
this case unplanned delays may occur.
By testing the code in packaging environments, I'm aiming to detect any
compilation errors before packaging.

Co-authored-by: Onur Tirtir <onurcantirtir@gmail.com>
Co-authored-by: Hanefi Onaldi <Hanefi.Onaldi@microsoft.com>
2022-12-01 19:11:41 +03:00