1
0
mirror of synced 2025-12-26 05:05:18 -05:00
Commit Graph

1157 Commits

Author SHA1 Message Date
Augustin
6988679424 up-to-date: fix quote escape in workflow (#47444)
## Motivation
The single quote escaping syntax  used in GHA workflow to run `airbyte-ci` was wrong.
Separating `schedule` triggers from `workflow_dispatch` triggers makes it easier to get the syntax right.

### Workflow and Command Updates:

* [`.github/workflows/connectors_up_to_date.yml`](diffhunk://#diff-2d17c6d9c0d58a040bfab9725e36051d4330b78f1a76e2f9fb024f673b7a74d4L14-R14): Added a new metadata query to exclude `source-declarative-manifest` from the `connectors-options` input. Updated the workflow to handle both `workflow_dispatch` and `schedule` events separately. [[1]](diffhunk://#diff-2d17c6d9c0d58a040bfab9725e36051d4330b78f1a76e2f9fb024f673b7a74d4L14-R14) [[2]](diffhunk://#diff-2d17c6d9c0d58a040bfab9725e36051d4330b78f1a76e2f9fb024f673b7a74d4L28-R30) [[3]](diffhunk://#diff-2d17c6d9c0d58a040bfab9725e36051d4330b78f1a76e2f9fb024f673b7a74d4L42-R59)

### Documentation Changes:

* [`airbyte-ci/connectors/pipelines/README.md`](diffhunk://#diff-62eccd92928fbcd3d285983bfdaa2b0d4ca49016cb9c2f63d6d9fc968c59c541L528): Removed the `--ignore-connector` option from the documentation and added an entry to the changelog explaining the removal. [[1]](diffhunk://#diff-62eccd92928fbcd3d285983bfdaa2b0d4ca49016cb9c2f63d6d9fc968c59c541L528) [[2]](diffhunk://#diff-62eccd92928fbcd3d285983bfdaa2b0d4ca49016cb9c2f63d6d9fc968c59c541R853)

### Codebase Simplification:

* [`airbyte-ci/connectors/pipelines/pipelines/airbyte_ci/connectors/up_to_date/commands.py`](diffhunk://#diff-e6ca381b7841536a83b88d6b45f24bbcdbe304f88248787054817373d8f73544L52-L57): Removed the `--ignore-connector` option and its related logic from the `up_to_date` command. [[1]](diffhunk://#diff-e6ca381b7841536a83b88d6b45f24bbcdbe304f88248787054817373d8f73544L52-L57) [[2]](diffhunk://#diff-e6ca381b7841536a83b88d6b45f24bbcdbe304f88248787054817373d8f73544L66-L75)

### Version Bump:

* [`airbyte-ci/connectors/pipelines/pyproject.toml`](diffhunk://#diff-087e2c37602bbd6824f875004abddcb4e1a374da12bf84201671ed0900882ce0L7-R7): Updated the version from `4.41.6` to `4.41.7`.
2024-10-28 11:55:02 +01:00
Augustin
b1b2f9c744 up-to-date: ignore RC from the up to date pipeline (#47360) 2024-10-26 12:20:53 +02:00
Edward Gao
32691add91 Bulk load CDK: switch to passing path around in integration tests (#46978) 2024-10-22 18:56:49 +03:00
Augustin
3d3f27db3f [fix] finalize workflow: better interpolation (#46967) 2024-10-17 10:02:50 -04:00
Augustin
40ee0298f5 Use multiple Dagger token to namespace caching (#46965)
## What
The Dagger team created a bunch of additional token to use their distributed cache.
We want multiple token to "namespace" the cache per use case so that for instance  `airbyte-ci format` can pull the couple images it uses from it, instead of downloading the full cache which has all the connector testing related layers.

Rationale:
* `DAGGER_CLOUD_TOKEN_CACHE_5`: internal python packages testing
* `DAGGER_CLOUD_TOKEN_CACHE_4`: community CI only
* `DAGGER_CLOUD_TOKEN_CACHE_3`: connector build/testing/publish
* `DAGGER_CLOUD_TOKEN_CACHE_2`: light jobs like `format` or `version increment check`
2024-10-17 12:22:08 +02:00
Catherine Noll
24b5b106f6 chore(auto-merge): increase frequency to every 2 hours (#46910) 2024-10-15 06:52:12 -04:00
Natik Gadzhi
b9f4154d1c chore(airbyte-cdk): remove codeflash to reduce repo noise (#46727) 2024-10-11 12:20:37 -07:00
Edward Gao
251b6b2368 Bulk CDK: gradle tweaks (#46548) 2024-10-07 11:08:09 -07:00
Edward Gao
4c680b49cd Bulk Load CDK: Add integration test using in-memory mock destination (#45634) 2024-10-03 16:58:24 -07:00
Natik Gadzhi
d96d47d2bd fix(airbyte-ci): fix progressive rollout finalize steps bugs (#46278)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2024-10-01 13:18:13 +00:00
Catherine Noll
6f3f3b7bcd fix: connector rollout publish pipeline fix GHA inputs (#46251) 2024-09-30 05:23:22 -04:00
Natik Gadzhi
412b0a690c fix(bump-version): quotes around changelog line (#46257) 2024-09-29 16:35:18 -07:00
Natik Gadzhi
de732e31f3 fix(bump-version): typo in command yaml filename (#46256) 2024-09-29 16:25:39 -07:00
Natik Gadzhi
ef87001fbe feat(ci workflows): introducing bump-version workflow! (#46252) 2024-09-29 16:18:55 -07:00
Natik Gadzhi
95aaf8a211 airbyte-ci: connector progressive rollout finalize / rollback steps + gh actions (#45868)
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
2024-09-25 23:11:24 +00:00
Marius Posta
c3c842340a .github: fix airbyte-ci-release.yml (#45361) 2024-09-10 07:47:39 -07:00
Ella Rohm-Ensing
011f40b782 Revert "fix: allow review requirements check on forks (#44404)" (#45175) 2024-09-05 10:55:45 -07:00
Evan Tahler
7debf35327 Bulk CDK alerts go to the right slack channel (#44867) 2024-08-28 23:08:08 +00:00
Augustin
708a9a1d42 cdk connectors test: fix regression test run (#44849) 2024-08-28 11:25:21 +02:00
Augustin
a32e94e3cc community-ci: support regression tests on forks (#44813) 2024-08-28 08:58:24 +02:00
Alexandre Girard
b034e7d444 feat(ci) Run codeflash in on PRs modifying the Python CDK (#44427)
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
2024-08-26 09:22:01 -05:00
Ella Rohm-Ensing
c7a6731b3c fix: allow review requirements check on forks (#44404) 2024-08-23 13:36:29 -07:00
Artem Inzhyyants
9603c3c595 feat(Airbyte-ci): add command generate-erd-schema (#43310)
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
Co-authored-by: maxi297 <maxime@airbyte.io>
Co-authored-by: Maxime Carbonneau-Leclerc <3360483+maxi297@users.noreply.github.com>
2024-08-20 12:10:14 -04:00
Catherine Noll
f86b1caa90 Live tests: surface --should-read-with-state to GHAs (#44173) 2024-08-16 11:36:46 -04:00
Augustin
42c9bc1a01 airbyte-ci: ignore archived connectors on up-to-date and don't fail publish when no connector is selected (#43970) 2024-08-13 21:50:55 +00:00
Augustin
d8ced0f33b airbyte-ci: ignore source-declarative-manifest in up-to-date (#43969) 2024-08-13 13:40:04 +02:00
Catherine Noll
49e027738b CDK Connectors Tests: Fix NotGitRepo error (#43394) 2024-08-12 12:36:21 -04:00
Augustin
99b1814345 publish-connectors: add comment with link to PD (#43846) 2024-08-12 16:24:02 +02:00
Augustin
3f5e0f2260 publish pipeline: send pager duty alert on worfklow failure (#43420) 2024-08-12 09:59:33 -04:00
Augustin
6e5068cfdd connector publish pipeline: increase retry delay (#43719) 2024-08-12 10:18:38 +02:00
Augustin
0f4d0e3fa5 auto-merge/up-to-date: change tokens (#43710) 2024-08-11 08:07:49 +02:00
Ben Church
eb74cba528 feat(bump-version): bump-version support for explicit version (#42970) 2024-08-09 09:08:49 -07:00
Marius Posta
2c5d5080cf .github: fix bulk cdk publish workflow trigger (#43372) 2024-08-07 11:58:25 -07:00
Marius Posta
0bf02cfd53 bulk-cdk: re-export boms, clean up github workflow (#43371) 2024-08-07 13:52:22 -05:00
Marius Posta
359833011c gradle,.github: add bulk cdk publish workflow (#43361) 2024-08-07 10:22:30 -07:00
Augustin
85762c302d airbyte-ci: trigger test on doc change (#42046) 2024-08-07 15:00:25 +02:00
Ella Rohm-Ensing
018c538c31 fix: use python 3.10 to generate connector builder update CDK pr (#42988) 2024-08-02 13:31:14 -07:00
Augustin
9ef365ee56 airbyte-ci: retry publish on failure (#42959) 2024-08-02 17:29:09 +02:00
Catherine Noll
24cf9677a4 airbyte-ci: run live tests against connection listed in metadata (#42574) 2024-08-01 23:00:49 -04:00
Augustin
e4833f6ecc airbyte-ci: send publish failures to a dedicated slack channel (#42849) 2024-07-30 08:25:11 +00:00
Augustin
71aac2a44e Do not auto-resolve publish failures in Instatus (#42500) 2024-07-25 12:53:52 +02:00
Catherine Noll
d3a98a60ff airbyte-ci: send regression test status to GHA (#42077) 2024-07-24 12:14:58 -04:00
Artem Inzhyyants
559394bebb GH Actions: update mypy version (#42489)
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
2024-07-24 15:51:15 +02:00
Catherine Noll
548c16cf1e Live/regression tests: add support for selecting from a subset of connections (#42044) 2024-07-17 11:07:21 -04:00
Catherine Noll
5390270f04 airbyte-ci: new step for skipping regression test approval (#42038) 2024-07-17 07:40:00 -04:00
Catherine Noll
f7688474fd airbyte-ci: send status check when skipped (#41676) 2024-07-17 07:01:42 -04:00
Natik Gadzhi
9ff9b29e93 chore: mention tooling team instead of extensibility on connector publishing alerts (#41655) 2024-07-12 14:57:16 -07:00
Catherine Noll
bbe94ee844 Regression test manual approval workflow: update status check name (#41663) 2024-07-12 07:34:46 -04:00
Catherine Noll
95d4218e8f Regression tests approval workflow: make permissions workflow-level (#41643) 2024-07-11 14:33:48 -04:00
Catherine Noll
728be464c1 Regression tests approval workflow: add issues: write permission (#41641) 2024-07-11 13:07:52 -05:00