1
0
mirror of synced 2026-01-05 03:04:38 -05:00
Commit Graph

535 Commits

Author SHA1 Message Date
Topher Lubaway
6ddf32a84c More clear direction on flaky test (#17085) 2022-09-23 09:31:59 -05:00
Topher Lubaway
5a582952ad Revert "SSH debugging of jerbs (#16822)" (#16832)
This reverts commit f32d593929.
2022-09-16 15:30:57 -05:00
Topher Lubaway
f32d593929 SSH debugging of jerbs (#16822) 2022-09-16 14:56:52 -05:00
Topher Lubaway
421558e1c6 reverts test runner name change (#16823) 2022-09-16 14:09:26 -05:00
Topher Lubaway
1328e81f3b Matches test runner name to beta action runner (#16821)
done via GH org level settings UI
2022-09-16 13:49:01 -05:00
Topher Lubaway
57c58db8ae kube test get more power and limits total run time (#16817)
* kube test get more power and limits total run time

using a beta test of GH workers for speed
context: https://github.com/airbytehq/airbyte-cloud/issues/2737
         https://github.com/airbytehq/airbyte-cloud/issues/2787

* Changes timeout to 40
2022-09-16 13:23:21 -05:00
Edmundo Ruiz Ghanem
09f3baf284 Update Chromatic action to auto-accept changes (#16697) 2022-09-14 10:12:36 -04:00
Kyryl Skobylko
cc965b3340 fix: disable helm ac for now (#16593) 2022-09-12 16:58:01 +03:00
Michael Siega
7671103aad remove references to disabled helm tests which are breaking the build (#16591) 2022-09-12 15:53:13 +02:00
Davin Chia
c19811fc89 Disable Helm tests as they are breaking the build. (#16568)
* Disable Helm tests.
2022-09-09 23:12:07 -07:00
Kyryl Skobylko
5524bbf76d fix: fix pulish helm workflow (#16532) 2022-09-09 16:19:01 +03:00
Kyryl Skobylko
3b807c8e35 fix: Update oss charts. Add acceptance tests for helm (#16131)
* fix: revert extraEnv. Move updated extraEnv to env_vars

* fix: Add node pool selector feature for gke deployments

* fix: hotfix. Fix webapp values and imagepullsecrets

* fix: remove nodeSelector duplicate

* fix: revert imagePullSecrets changes

* fix nit

* fix: fix bootloader imagepullsecrets

* fix: fix image pull secrets again...

* feat: add acceptance tests for helm

* add step to install unzip

* fix incorrect command spelling(helm)

* update slack notification sending for Airbyte CI workflow

* Rename Helm E2E test report name

* fix: Update helm charts

* fix: fix temporal DB Port bug

* fix nits

* do a small testing for sake of science

* Update test chart.yaml with note block

* Revert changes for AC tests

* fix: Include #16166

* fix: add metrics to the ci workflow

* fix: revert changes for temporal service. move them to server service;

* fix: revert fullstory deletion

* fix: change way of defining image tag and make it to be set in global values. Add values.yaml.test for integration testing and local deployment

* fix: udpate docs, update values.yaml

* fix: fix helpers.tpl in all subcharts

* Update chart docs

Co-authored-by: Davin Chia <davinchia@gmail.com>
2022-09-09 15:58:58 +03:00
Edmundo Ruiz Ghanem
81e8a5184d 🪟 🔧 Publish webapp storybook to chromatic in CI (#16169)
* Add Publish to storybook step in webapp gradle workflow

* Set fetch-dept to 0 for airbyte webapp build

* Fix typo in chromatic config

* Fix typo when you've been writing too much css

* Fix storybook build path in gradle workflow

* Use full path in chromatic action

* Try another path configuration for chromatic workflow action

* Use label ot token in storybook deploy

* Back to github_token

* Move Storybook deploy to separate job

* Fix run command in publish storybook workflow

* Rollback publish storybook as separate step from build-frontend, add correct github token to step

* Let the chromatic step  build the storybook

* Restore storybookBuildDir on publish to chromatic step

* Add exitOnceUploaded to chromatic action
2022-09-08 14:46:48 -04:00
Tim Chan
a4621f8c96 use refactored find a pat script that writes token to env (not base64 encoded) (#16321) 2022-09-06 09:30:32 -07:00
Miles Armstrong
5ccea654ad Add airbyte-metrics to list of charts to be packaged (#16270) 2022-09-05 18:42:15 -03:00
Jimmy Ma
f8f06febc6 Fix github action syntax (#16277) 2022-09-02 11:58:37 -07:00
Liren Tu
fd547c64d7 🐛 Avro related destinations: fix field name clashing with combined restrict (#16243)
* Add test case for allOf and oneOf

* Bump version

* Add pr id

* Bump gcs version

* Bump dest jdbc

* Bump redshift

* Bump snowflake

* Bump databricks

* Bump bigquery

* Revert "Bump dest jdbc"

This reverts commit f10497e96a.

* Use a new pat to avoid api rate limit

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* Revert databricks bump

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-01 18:06:27 -07:00
Conor
21ddc93731 chore: cleanup actions and workflows (#16139)
* chore: cleanup actions

* Update .github/workflows/shared-issues.yml

Co-authored-by: Topher Lubaway <asimplechris@gmail.com>

* Update .github/workflows/shared-issues.yml

Co-authored-by: Topher Lubaway <asimplechris@gmail.com>

* Update .github/workflows/shared-pulls.yml

Co-authored-by: Topher Lubaway <asimplechris@gmail.com>

* Update .github/workflows/test-performance-command.yml

Co-authored-by: Topher Lubaway <asimplechris@gmail.com>

Co-authored-by: Topher Lubaway <asimplechris@gmail.com>
2022-09-01 08:46:50 -05:00
Conor
cd2860f617 chore: cleanup dormant workflows (#16022)
* chore: cleanup dormant workflows

* fix: restore performance test

* fix: add back GKE acceptance test

* ci: add cron to GKE Kube Acceptance Test
2022-08-31 09:52:40 -05:00
Davin Chia
2967dfaaaa Revert "Use a valid pat for slash command dispatch (#16144)" (#16156)
This reverts commit a4628916b4.
2022-08-30 19:03:11 -07:00
Liren Tu
a4628916b4 Use a valid pat for slash command dispatch (#16144) 2022-08-30 14:39:10 -07:00
Conor
6074ad5d83 feat: tools to identify and clean up unused workflows (#16019)
* feat: tools to identify and clean up unused workflows

* fix: shorten title

Co-authored-by: Topher Lubaway <asimplechris@gmail.com>

* fix: make slack token optional

* fix: review comments

* ci: remove todo's in workflow run for merge

Co-authored-by: Topher Lubaway <asimplechris@gmail.com>
2022-08-29 13:45:38 -05:00
Yevhen Sukhomud
c402264664 11815 New github action to test projects that depend on the project being changed (#15783)
* 11815 New github action to test projects that depend on the project being changed
2022-08-25 10:00:19 +07:00
Evan Tahler
66a0ebe8cf Remove "prerelease" label from Github versions (#15864) 2022-08-22 17:06:41 -07:00
Topher Lubaway
1258ab4e34 Revert "Adds PAT check to shared pr check (#15453)" (#15511)
This reverts commit 06a18d4f02.
2022-08-10 09:05:14 -05:00
Topher Lubaway
06a18d4f02 Adds PAT check to shared pr check (#15453)
* Adds PAT check to shared pr check

* Name change

* Removes "safe_to_push" string

* Adds OCTAVIA_PAT and uses the found PAT

found PAT was not used in all locales, so this could have still failed
on an expired OCTAVIA_PAT before this change
2022-08-09 13:33:20 -05:00
Davin Chia
fd0b7699a4 Add JUnit Test Reports to build outputs. (#15271)
It's difficult today to parse all the logs from tests. Engineers waste time scrolling through the log outputs and looking for the relevant stack trace.

This PR adds an action to generate a JUnit report so devs can understand test results at a glance. This generates 3 reports for each of the main build jobs when the build completes. We leave the frontend build out since this is aggregated by cypress.

See https://github.com/airbytehq/airbyte/pull/15271/checks?check_run_id=7683783016 for an example of how this works.

Use the https://github.com/dorny/test-reporter action and configure this to look at the Jacoco test report output for top level and second level builds. Note that most of the parameters into the action don't work.

Comment out the trap commands to output logs. Though this can be useful for debugging, there is little practical use in the day-to-day, and results in extremely noisy logs.
2022-08-08 17:04:36 -07:00
Serhii Chvaliuk
19a6884b84 source-acceptance-test added (#15237)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-08-03 17:45:31 +03:00
Davin Chia
ce2fd86acb Fix terminate workflow by using JQ Args. (#15160)
This is failing today since we aren't injecting the bash variables correctly into JQ. This PR makes it so.

We also increase the time limit to 4 hours to accommodate long running test jobs.
2022-08-01 08:47:57 -07:00
Serhii Chvaliuk
c5a98f3ecf GitHub Actions - workflow Connector Integration Tests - add retry (#14452)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-08-01 17:37:20 +03:00
Kyryl Skobylko
4b2793cb16 fix: fix helm publish workflow (#14884)
* fix: fix wrong directory invocation in workflow

* fix: Increase waiting time for repo sync call

* fix: fix workflow

* fix: fix helm publish workflow
2022-07-20 18:02:34 +03:00
Kyryl Skobylko
ba38df4398 fix: fix wrong directory invocation in publish helm charts workflow (#14883)
* fix: fix wrong directory invocation in workflow

* fix: Increase waiting time for repo sync call

* fix: fix workflow
2022-07-20 18:00:10 +03:00
Kyryl Skobylko
c7774a5bf3 Refactor OSS Helm Charts (#14794)
* Add refactored helm charts

* Add mkver.conf

* Remove unused workflow debug info

* Add newline

* Add switch for rendering main chart templates

* Update .bumpversion.cfg

* Replace repository in main chart

* Update helm-docs. Remove commented values. Replace placeholders to more sensable. Update workflow

* Update workflow

* Update workflow

* Update workflow

* Update workflow

* Update workflow

* Update test workflow

* Update test workflow

* Disable on push for main workflow. Add test action for test workflow

* Delete test workflow. Update main workflow

* Remove mkver.conf since its not used no more

* Reference appVersion instead of manually set image tag

* Revert image pull secrets

* Bump appVersion to the latest

* Update values.yaml
2022-07-20 17:32:24 +03:00
Evan Tahler
dd97278a9c Skip CI when bumping connector version with /publish command (#14771) 2022-07-18 08:13:21 -07:00
Marcos Marx
a2ec5cda13 rollback publish command skip-test option (#14643) 2022-07-13 09:45:54 -03:00
Edward Gao
6b897c46e5 Fix normalization integration test workflow (#14454) 2022-07-06 09:14:54 -07:00
Tim Roes
798020552f Generate api client automatically on spec change (#14387) 2022-07-06 12:28:26 +02:00
Edward Gao
bb74373c8b Run some DATs as part of base-normalization tests (#14312) 2022-07-01 14:55:23 -07:00
Pedro S. Lopez
d2e9a79597 fix sentry org slug change (#14218) 2022-06-28 12:02:56 -04:00
Peter Hu
adc04a24f6 workflow for publishing artifacts for cloud (#14199) 2022-06-28 08:59:04 -07:00
Davin Chia
5c8969f52b Use correct bash comment symbol. (#14183) 2022-06-27 08:30:59 -07:00
Davin Chia
93181daa7b Increase instance termination time limit to 3 hours to accommodate connector builds. (#14181) 2022-06-27 08:25:25 -07:00
George Claireaux
542ea7132d update sentry release script (#14123) 2022-06-24 17:18:58 +01:00
Sherif A. Nada
40b43adf73 Remove skiptests option (#14100) 2022-06-24 08:22:23 -07:00
George Claireaux
fb6ddc48eb make table headers look less like successes (#13999) 2022-06-22 14:03:21 +01:00
George Claireaux
dd2d5d0129 in case runners fail to spin up, this needs to run on github-hosted (#13996) 2022-06-22 11:45:00 +01:00
Peter Hu
bcc20b4db1 publish oss for cloud (#13978)
workflow to publish oss artifacts that cloud needs to build against
use docker buildx to create arm images for local development
2022-06-21 14:30:42 -07:00
Topher Lubaway
7acf0c54df Adds test for new workflow (#13986)
* Adds test for new workflow

* Adds airbyte repo

* remove testing line
2022-06-21 14:58:27 -05:00
George Claireaux
e7dae06168 Enhance /publish to allow for multiple connectors and parallel execution (#13864)
* start

* revert

* azblob

* bq

* bq denorm

* megapublish baaaabyyyy

* fix needs

* matrix connectors

* auto-bump connector version

* dont failfast and max parallel 5

* multi runno

* minor

* testing matrix agents

* name

* testing multi agents

* tmp fix

* new multi agents

* multi test

* tryy

* let's do this

* magico

* fix

* label test

* couple more connector bumps

* temp

* things

* check this

* lets gooo

* more connectors

* Delete TEMP-testing-command.yml

* auto-bump connector version

* added comment describing bash part

* running single thread

* catch sentry cli

* auto-bump connector version

* destinations

* + snowflake

* saved

* auto-bump connector version

* auto-bump connector version

* java source bumps

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* remove twice-defined methods

* label things

* revert action

* using the new test action

* point at action

* wrong tag on action

* update pool label

* update to use new ec2-github-runner fork

* this needs to be more generic than publisher

* change publish to run on pool

* add comment about runner-pool usage

* updated publish command docs for multi & parallel connector runs

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* unbump failed publish versions

* missed dockerfiles

* remove failed docs

* mssql fix

* overhauled the git comment output

* bumping a test connector that should work

* slight order switcheroo

* output connectors properly in first message

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-21 18:40:33 +01:00
Topher Lubaway
5e1f968751 Adds zombie removal tool (#13718)
* Adds zombie removal tool

* Corrects endpoint adds comments

* Adds API links

* Changes search logic, fixes escape character

* Corrects help text
2022-06-13 13:28:32 -05:00