1
0
mirror of synced 2026-01-18 15:02:51 -05:00
Commit Graph

553 Commits

Author SHA1 Message Date
Benoit Moriceau
adf2c5ff8e Bmoric/remove dep connector worker (#17977)
* test [ci skip]

* Autogenerated files

* Add missing annotation

* Remove unused json2Schema block from worker

* Move tess

* Missing deps and format

* Fix test build

* TMP

* Add missing dependencies

* PR comments

* Tmp

* [ci skip] Tmp

* Fix acceptance test and add the seed dependency

* Fix build

* For diff

* tmp

* Build pass

* make the worker to be  on the platform only

* fix setting.yaml

* remove dependency

* Fix pmd

* Fix Cron

* Add chart

* Fix cron

* Fix server build.gradle

* Fix jar conflict

* PR comments

* Add cron micronaut environemnt

* Update required build path

* remove all dependencies on worker

* Typo

* Add gradle exclusions

* Add exclusion to avoid conflict

* more exclusion

* Move more class

* Exclude worker from the general build

* Fix connector build
2022-10-18 11:51:25 -07:00
github-actions[bot]
d4351ee3b4 Bump helm chart version reference to 0.40.24 (#18081)
* Bump helm chart version reference to 0.40.24

* Update .gitignore

Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
Co-authored-by: Kyryl Skobylko <xpuska513@gmail.com>
2022-10-18 10:35:14 +03:00
Kyryl Skobylko
e4f8e75410 Update helm release workflow (#18048)
* Update workflow

* Update trigger rules

* fix: Update release workflow with abillity to add tags

* Update workflow
2022-10-17 20:28:06 +03:00
Benoit Moriceau
18c328da2b Bmoric/build platform if connector pg changed (#18014)
* Trigger platform build when the connectors use in the Acceptance test are updated

* Remove the ci skip when publish
2022-10-14 14:55:39 -07:00
Conor
19f74282be ci: upload test results to github for analysis (#17953)
* ci: upload test results to github for analysis

* fix: filter down to only test folders
2022-10-13 19:38:03 -05:00
Davin Chia
21352b6003 Trigger the connectors build if there are worker changes. (#17976)
Since the connector module is dependent on the worker module, also trigger the connector builds if anything in the worker file directory changes.
2022-10-13 17:21:02 -07:00
Davin Chia
719cd554bd Start testing buildpulse. (#17712)
Buildpulse.io is a tool for detecting flaky tests that integrates well with GHA. Flaky tests are something we want to start figuring out more of.

This PR starts pushing platform tests to buildpulse so we can start trialing out this tool.

The idea is to try this out for a couple of weeks (enough time to see if this tool actually can detect flaky tests) and decide if this serves our needs.
2022-10-09 14:41:30 -07:00
andriikorotkov
371da13827 Test e2e testing tool commands (#17722)
* test pull request for testing testing-tool commands

* test pull request for testing testing-tool commands

* add command for run testing tool in main repo

* small changes for test e2e testing tool commands

* small changes for test e2e testing tool commands
2022-10-07 16:18:20 +03:00
andriikorotkov
0bec9404eb Testing tool commands for run scenarios (#17550)
* test pull request for testing testing-tool commands

* test pull request for testing testing-tool commands

* add command for run testing tool in main repo
2022-10-07 14:07:38 +03:00
Conor
58cc7051c2 remove sonar-scan workflow (#17609) 2022-10-05 11:30:21 -05:00
andriikorotkov
4a6bc22280 Update testing-tool help commands (#17553)
* add github action for help-full command processing

* test pull request for testing testing-tool commands

* test pull request for testing testing-tool commands
2022-10-04 13:30:49 +03:00
andriikorotkov
c2507303b6 add github action for help-full command processing (#17502) 2022-10-04 11:40:14 +03:00
Tim Roes
ee9bd2e141 Cleanup labeling actions (#17278) 2022-09-29 22:03:36 +02:00
Topher Lubaway
c22f7a312e Case fix (#17361) 2022-09-28 17:34:55 -05:00
Topher Lubaway
7fad702ce0 Toph cleans up labellers ii (#17330)
* Further testing

This reverts commit 83cdf198f1.

* Moves find_valid_pat into single job

* Removes duplicate find_valid_pat

* Moves find_valid_pat to single job

* New name for FE notifier
2022-09-28 11:18:37 -05:00
Topher Lubaway
83cdf198f1 Revert "Cleans up label actions && fix broken action (#17324)" (#17329)
This reverts commit dd95d3ad59.
2022-09-28 10:06:36 -05:00
Topher Lubaway
dd95d3ad59 Cleans up label actions && fix broken action (#17324)
* Cleans up label actions

Also fixes my very silly implementation

* removes unsused output

* Keep titles the same across jerbs
2022-09-28 10:00:32 -05:00
Topher Lubaway
9379a9ba94 Toph increases rate limit for shared issues (#17265)
* Adds second PAT for issue labeller

also renames the file to be more clear to outsiders

* Adds reference to code that runs

took me some time to find, saving others

* comment cleanup

* use find_valid_pat output for both actions
2022-09-27 13:58:22 -05:00
Topher Lubaway
6ddf32a84c More clear direction on flaky test (#17085) 2022-09-23 09:31:59 -05:00
Topher Lubaway
5a582952ad Revert "SSH debugging of jerbs (#16822)" (#16832)
This reverts commit f32d593929.
2022-09-16 15:30:57 -05:00
Topher Lubaway
f32d593929 SSH debugging of jerbs (#16822) 2022-09-16 14:56:52 -05:00
Topher Lubaway
421558e1c6 reverts test runner name change (#16823) 2022-09-16 14:09:26 -05:00
Topher Lubaway
1328e81f3b Matches test runner name to beta action runner (#16821)
done via GH org level settings UI
2022-09-16 13:49:01 -05:00
Topher Lubaway
57c58db8ae kube test get more power and limits total run time (#16817)
* kube test get more power and limits total run time

using a beta test of GH workers for speed
context: https://github.com/airbytehq/airbyte-cloud/issues/2737
         https://github.com/airbytehq/airbyte-cloud/issues/2787

* Changes timeout to 40
2022-09-16 13:23:21 -05:00
Edmundo Ruiz Ghanem
09f3baf284 Update Chromatic action to auto-accept changes (#16697) 2022-09-14 10:12:36 -04:00
Kyryl Skobylko
cc965b3340 fix: disable helm ac for now (#16593) 2022-09-12 16:58:01 +03:00
Michael Siega
7671103aad remove references to disabled helm tests which are breaking the build (#16591) 2022-09-12 15:53:13 +02:00
Davin Chia
c19811fc89 Disable Helm tests as they are breaking the build. (#16568)
* Disable Helm tests.
2022-09-09 23:12:07 -07:00
Kyryl Skobylko
5524bbf76d fix: fix pulish helm workflow (#16532) 2022-09-09 16:19:01 +03:00
Kyryl Skobylko
3b807c8e35 fix: Update oss charts. Add acceptance tests for helm (#16131)
* fix: revert extraEnv. Move updated extraEnv to env_vars

* fix: Add node pool selector feature for gke deployments

* fix: hotfix. Fix webapp values and imagepullsecrets

* fix: remove nodeSelector duplicate

* fix: revert imagePullSecrets changes

* fix nit

* fix: fix bootloader imagepullsecrets

* fix: fix image pull secrets again...

* feat: add acceptance tests for helm

* add step to install unzip

* fix incorrect command spelling(helm)

* update slack notification sending for Airbyte CI workflow

* Rename Helm E2E test report name

* fix: Update helm charts

* fix: fix temporal DB Port bug

* fix nits

* do a small testing for sake of science

* Update test chart.yaml with note block

* Revert changes for AC tests

* fix: Include #16166

* fix: add metrics to the ci workflow

* fix: revert changes for temporal service. move them to server service;

* fix: revert fullstory deletion

* fix: change way of defining image tag and make it to be set in global values. Add values.yaml.test for integration testing and local deployment

* fix: udpate docs, update values.yaml

* fix: fix helpers.tpl in all subcharts

* Update chart docs

Co-authored-by: Davin Chia <davinchia@gmail.com>
2022-09-09 15:58:58 +03:00
Edmundo Ruiz Ghanem
81e8a5184d 🪟 🔧 Publish webapp storybook to chromatic in CI (#16169)
* Add Publish to storybook step in webapp gradle workflow

* Set fetch-dept to 0 for airbyte webapp build

* Fix typo in chromatic config

* Fix typo when you've been writing too much css

* Fix storybook build path in gradle workflow

* Use full path in chromatic action

* Try another path configuration for chromatic workflow action

* Use label ot token in storybook deploy

* Back to github_token

* Move Storybook deploy to separate job

* Fix run command in publish storybook workflow

* Rollback publish storybook as separate step from build-frontend, add correct github token to step

* Let the chromatic step  build the storybook

* Restore storybookBuildDir on publish to chromatic step

* Add exitOnceUploaded to chromatic action
2022-09-08 14:46:48 -04:00
Tim Chan
a4621f8c96 use refactored find a pat script that writes token to env (not base64 encoded) (#16321) 2022-09-06 09:30:32 -07:00
Miles Armstrong
5ccea654ad Add airbyte-metrics to list of charts to be packaged (#16270) 2022-09-05 18:42:15 -03:00
Jimmy Ma
f8f06febc6 Fix github action syntax (#16277) 2022-09-02 11:58:37 -07:00
Liren Tu
fd547c64d7 🐛 Avro related destinations: fix field name clashing with combined restrict (#16243)
* Add test case for allOf and oneOf

* Bump version

* Add pr id

* Bump gcs version

* Bump dest jdbc

* Bump redshift

* Bump snowflake

* Bump databricks

* Bump bigquery

* Revert "Bump dest jdbc"

This reverts commit f10497e96a.

* Use a new pat to avoid api rate limit

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* Revert databricks bump

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-01 18:06:27 -07:00
Conor
21ddc93731 chore: cleanup actions and workflows (#16139)
* chore: cleanup actions

* Update .github/workflows/shared-issues.yml

Co-authored-by: Topher Lubaway <asimplechris@gmail.com>

* Update .github/workflows/shared-issues.yml

Co-authored-by: Topher Lubaway <asimplechris@gmail.com>

* Update .github/workflows/shared-pulls.yml

Co-authored-by: Topher Lubaway <asimplechris@gmail.com>

* Update .github/workflows/test-performance-command.yml

Co-authored-by: Topher Lubaway <asimplechris@gmail.com>

Co-authored-by: Topher Lubaway <asimplechris@gmail.com>
2022-09-01 08:46:50 -05:00
Conor
cd2860f617 chore: cleanup dormant workflows (#16022)
* chore: cleanup dormant workflows

* fix: restore performance test

* fix: add back GKE acceptance test

* ci: add cron to GKE Kube Acceptance Test
2022-08-31 09:52:40 -05:00
Davin Chia
2967dfaaaa Revert "Use a valid pat for slash command dispatch (#16144)" (#16156)
This reverts commit a4628916b4.
2022-08-30 19:03:11 -07:00
Liren Tu
a4628916b4 Use a valid pat for slash command dispatch (#16144) 2022-08-30 14:39:10 -07:00
Conor
6074ad5d83 feat: tools to identify and clean up unused workflows (#16019)
* feat: tools to identify and clean up unused workflows

* fix: shorten title

Co-authored-by: Topher Lubaway <asimplechris@gmail.com>

* fix: make slack token optional

* fix: review comments

* ci: remove todo's in workflow run for merge

Co-authored-by: Topher Lubaway <asimplechris@gmail.com>
2022-08-29 13:45:38 -05:00
Yevhen Sukhomud
c402264664 11815 New github action to test projects that depend on the project being changed (#15783)
* 11815 New github action to test projects that depend on the project being changed
2022-08-25 10:00:19 +07:00
Evan Tahler
66a0ebe8cf Remove "prerelease" label from Github versions (#15864) 2022-08-22 17:06:41 -07:00
Topher Lubaway
1258ab4e34 Revert "Adds PAT check to shared pr check (#15453)" (#15511)
This reverts commit 06a18d4f02.
2022-08-10 09:05:14 -05:00
Topher Lubaway
06a18d4f02 Adds PAT check to shared pr check (#15453)
* Adds PAT check to shared pr check

* Name change

* Removes "safe_to_push" string

* Adds OCTAVIA_PAT and uses the found PAT

found PAT was not used in all locales, so this could have still failed
on an expired OCTAVIA_PAT before this change
2022-08-09 13:33:20 -05:00
Davin Chia
fd0b7699a4 Add JUnit Test Reports to build outputs. (#15271)
It's difficult today to parse all the logs from tests. Engineers waste time scrolling through the log outputs and looking for the relevant stack trace.

This PR adds an action to generate a JUnit report so devs can understand test results at a glance. This generates 3 reports for each of the main build jobs when the build completes. We leave the frontend build out since this is aggregated by cypress.

See https://github.com/airbytehq/airbyte/pull/15271/checks?check_run_id=7683783016 for an example of how this works.

Use the https://github.com/dorny/test-reporter action and configure this to look at the Jacoco test report output for top level and second level builds. Note that most of the parameters into the action don't work.

Comment out the trap commands to output logs. Though this can be useful for debugging, there is little practical use in the day-to-day, and results in extremely noisy logs.
2022-08-08 17:04:36 -07:00
Serhii Chvaliuk
19a6884b84 source-acceptance-test added (#15237)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-08-03 17:45:31 +03:00
Davin Chia
ce2fd86acb Fix terminate workflow by using JQ Args. (#15160)
This is failing today since we aren't injecting the bash variables correctly into JQ. This PR makes it so.

We also increase the time limit to 4 hours to accommodate long running test jobs.
2022-08-01 08:47:57 -07:00
Serhii Chvaliuk
c5a98f3ecf GitHub Actions - workflow Connector Integration Tests - add retry (#14452)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-08-01 17:37:20 +03:00
Kyryl Skobylko
4b2793cb16 fix: fix helm publish workflow (#14884)
* fix: fix wrong directory invocation in workflow

* fix: Increase waiting time for repo sync call

* fix: fix workflow

* fix: fix helm publish workflow
2022-07-20 18:02:34 +03:00
Kyryl Skobylko
ba38df4398 fix: fix wrong directory invocation in publish helm charts workflow (#14883)
* fix: fix wrong directory invocation in workflow

* fix: Increase waiting time for repo sync call

* fix: fix workflow
2022-07-20 18:00:10 +03:00