1
0
mirror of synced 2025-12-26 05:05:18 -05:00
Commit Graph

1174 Commits

Author SHA1 Message Date
Natik Gadzhi
3f45e06e63 feat(ci): use pre-commit instead of airbyte-ci format (#49806) 2024-12-18 14:03:45 -08:00
Aaron ("AJ") Steers
508424f848 ci: use explicit ubuntu versioned ci runner (#49857) 2024-12-18 13:17:19 -08:00
Aaron ("AJ") Steers
c4f6fdc932 ci: replace deprecated ::set-output syntax (#49856) 2024-12-18 08:44:50 -08:00
Augustin
40840d1835 up-to-date: use beefier runner (#49131) 2024-12-12 10:47:20 +01:00
Augustin
0df36eda2e up-to-date: use dedicated runner to control job concurrency (#48970) 2024-12-11 11:43:54 +01:00
Augustin
8738ff0928 ci: up-to-date, continue on error in matrix job (#48928) 2024-12-11 09:36:04 +01:00
Augustin
1231fa70ef airbyte-ci: make the connectors list command write its output to a json file + dynamic matrix in up-to-date (#48872) 2024-12-11 08:54:34 +01:00
Augustin
36ede9fc46 up-to-date: fix typo in GHA (#48630) 2024-11-25 11:16:34 +01:00
Augustin
9e11760aa0 airbyte-ci: matrix strategy for up-to-date (#47968) 2024-11-22 17:56:25 +01:00
Aaron ("AJ") Steers
c6d49bdc60 Python-CDK: Remove CDK (replaced by new repo) (#48470) 2024-11-18 17:45:18 -08:00
Aaron ("AJ") Steers
e4641d3306 Docs(python-cdk): Add automated PDoc docs generation CI job (#46977) 2024-11-09 15:44:11 -08:00
Rodi Reich Zilberman
e42d056050 merge mysql v2 into v1 (#48369) 2024-11-07 10:39:55 -08:00
Augustin
f5454fcd71 up-to-date: remove deprecated airbyte-ci options from the workflow (#48140) 2024-11-04 19:51:31 +01:00
Augustin
ef7139c379 Revert "Temporary GHA workflow to identify secrets with JSON data" (#48131) 2024-11-04 11:52:08 +01:00
Augustin
4ee96c7009 Temporary GHA workflow to identify secrets with JSON data (#48130) 2024-11-04 11:33:23 +01:00
Augustin
6002cf8465 GHA: dedicated dagger token for publish (#47722) 2024-10-29 11:23:15 +01:00
Marius Posta
0dc4efe7f7 bulk-cdk: gradle and github workflow improvements (#47687) 2024-10-28 16:50:57 -07:00
Augustin
6988679424 up-to-date: fix quote escape in workflow (#47444)
## Motivation
The single quote escaping syntax  used in GHA workflow to run `airbyte-ci` was wrong.
Separating `schedule` triggers from `workflow_dispatch` triggers makes it easier to get the syntax right.

### Workflow and Command Updates:

* [`.github/workflows/connectors_up_to_date.yml`](diffhunk://#diff-2d17c6d9c0d58a040bfab9725e36051d4330b78f1a76e2f9fb024f673b7a74d4L14-R14): Added a new metadata query to exclude `source-declarative-manifest` from the `connectors-options` input. Updated the workflow to handle both `workflow_dispatch` and `schedule` events separately. [[1]](diffhunk://#diff-2d17c6d9c0d58a040bfab9725e36051d4330b78f1a76e2f9fb024f673b7a74d4L14-R14) [[2]](diffhunk://#diff-2d17c6d9c0d58a040bfab9725e36051d4330b78f1a76e2f9fb024f673b7a74d4L28-R30) [[3]](diffhunk://#diff-2d17c6d9c0d58a040bfab9725e36051d4330b78f1a76e2f9fb024f673b7a74d4L42-R59)

### Documentation Changes:

* [`airbyte-ci/connectors/pipelines/README.md`](diffhunk://#diff-62eccd92928fbcd3d285983bfdaa2b0d4ca49016cb9c2f63d6d9fc968c59c541L528): Removed the `--ignore-connector` option from the documentation and added an entry to the changelog explaining the removal. [[1]](diffhunk://#diff-62eccd92928fbcd3d285983bfdaa2b0d4ca49016cb9c2f63d6d9fc968c59c541L528) [[2]](diffhunk://#diff-62eccd92928fbcd3d285983bfdaa2b0d4ca49016cb9c2f63d6d9fc968c59c541R853)

### Codebase Simplification:

* [`airbyte-ci/connectors/pipelines/pipelines/airbyte_ci/connectors/up_to_date/commands.py`](diffhunk://#diff-e6ca381b7841536a83b88d6b45f24bbcdbe304f88248787054817373d8f73544L52-L57): Removed the `--ignore-connector` option and its related logic from the `up_to_date` command. [[1]](diffhunk://#diff-e6ca381b7841536a83b88d6b45f24bbcdbe304f88248787054817373d8f73544L52-L57) [[2]](diffhunk://#diff-e6ca381b7841536a83b88d6b45f24bbcdbe304f88248787054817373d8f73544L66-L75)

### Version Bump:

* [`airbyte-ci/connectors/pipelines/pyproject.toml`](diffhunk://#diff-087e2c37602bbd6824f875004abddcb4e1a374da12bf84201671ed0900882ce0L7-R7): Updated the version from `4.41.6` to `4.41.7`.
2024-10-28 11:55:02 +01:00
Augustin
b1b2f9c744 up-to-date: ignore RC from the up to date pipeline (#47360) 2024-10-26 12:20:53 +02:00
Edward Gao
32691add91 Bulk load CDK: switch to passing path around in integration tests (#46978) 2024-10-22 18:56:49 +03:00
Augustin
3d3f27db3f [fix] finalize workflow: better interpolation (#46967) 2024-10-17 10:02:50 -04:00
Augustin
40ee0298f5 Use multiple Dagger token to namespace caching (#46965)
## What
The Dagger team created a bunch of additional token to use their distributed cache.
We want multiple token to "namespace" the cache per use case so that for instance  `airbyte-ci format` can pull the couple images it uses from it, instead of downloading the full cache which has all the connector testing related layers.

Rationale:
* `DAGGER_CLOUD_TOKEN_CACHE_5`: internal python packages testing
* `DAGGER_CLOUD_TOKEN_CACHE_4`: community CI only
* `DAGGER_CLOUD_TOKEN_CACHE_3`: connector build/testing/publish
* `DAGGER_CLOUD_TOKEN_CACHE_2`: light jobs like `format` or `version increment check`
2024-10-17 12:22:08 +02:00
Catherine Noll
24b5b106f6 chore(auto-merge): increase frequency to every 2 hours (#46910) 2024-10-15 06:52:12 -04:00
Natik Gadzhi
b9f4154d1c chore(airbyte-cdk): remove codeflash to reduce repo noise (#46727) 2024-10-11 12:20:37 -07:00
Edward Gao
251b6b2368 Bulk CDK: gradle tweaks (#46548) 2024-10-07 11:08:09 -07:00
Edward Gao
4c680b49cd Bulk Load CDK: Add integration test using in-memory mock destination (#45634) 2024-10-03 16:58:24 -07:00
Natik Gadzhi
d96d47d2bd fix(airbyte-ci): fix progressive rollout finalize steps bugs (#46278)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2024-10-01 13:18:13 +00:00
Catherine Noll
6f3f3b7bcd fix: connector rollout publish pipeline fix GHA inputs (#46251) 2024-09-30 05:23:22 -04:00
Natik Gadzhi
412b0a690c fix(bump-version): quotes around changelog line (#46257) 2024-09-29 16:35:18 -07:00
Natik Gadzhi
de732e31f3 fix(bump-version): typo in command yaml filename (#46256) 2024-09-29 16:25:39 -07:00
Natik Gadzhi
ef87001fbe feat(ci workflows): introducing bump-version workflow! (#46252) 2024-09-29 16:18:55 -07:00
Natik Gadzhi
95aaf8a211 airbyte-ci: connector progressive rollout finalize / rollback steps + gh actions (#45868)
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
2024-09-25 23:11:24 +00:00
Marius Posta
c3c842340a .github: fix airbyte-ci-release.yml (#45361) 2024-09-10 07:47:39 -07:00
Ella Rohm-Ensing
011f40b782 Revert "fix: allow review requirements check on forks (#44404)" (#45175) 2024-09-05 10:55:45 -07:00
Evan Tahler
7debf35327 Bulk CDK alerts go to the right slack channel (#44867) 2024-08-28 23:08:08 +00:00
Augustin
708a9a1d42 cdk connectors test: fix regression test run (#44849) 2024-08-28 11:25:21 +02:00
Augustin
a32e94e3cc community-ci: support regression tests on forks (#44813) 2024-08-28 08:58:24 +02:00
Alexandre Girard
b034e7d444 feat(ci) Run codeflash in on PRs modifying the Python CDK (#44427)
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
2024-08-26 09:22:01 -05:00
Ella Rohm-Ensing
c7a6731b3c fix: allow review requirements check on forks (#44404) 2024-08-23 13:36:29 -07:00
Artem Inzhyyants
9603c3c595 feat(Airbyte-ci): add command generate-erd-schema (#43310)
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
Co-authored-by: maxi297 <maxime@airbyte.io>
Co-authored-by: Maxime Carbonneau-Leclerc <3360483+maxi297@users.noreply.github.com>
2024-08-20 12:10:14 -04:00
Catherine Noll
f86b1caa90 Live tests: surface --should-read-with-state to GHAs (#44173) 2024-08-16 11:36:46 -04:00
Augustin
42c9bc1a01 airbyte-ci: ignore archived connectors on up-to-date and don't fail publish when no connector is selected (#43970) 2024-08-13 21:50:55 +00:00
Augustin
d8ced0f33b airbyte-ci: ignore source-declarative-manifest in up-to-date (#43969) 2024-08-13 13:40:04 +02:00
Catherine Noll
49e027738b CDK Connectors Tests: Fix NotGitRepo error (#43394) 2024-08-12 12:36:21 -04:00
Augustin
99b1814345 publish-connectors: add comment with link to PD (#43846) 2024-08-12 16:24:02 +02:00
Augustin
3f5e0f2260 publish pipeline: send pager duty alert on worfklow failure (#43420) 2024-08-12 09:59:33 -04:00
Augustin
6e5068cfdd connector publish pipeline: increase retry delay (#43719) 2024-08-12 10:18:38 +02:00
Augustin
0f4d0e3fa5 auto-merge/up-to-date: change tokens (#43710) 2024-08-11 08:07:49 +02:00
Ben Church
eb74cba528 feat(bump-version): bump-version support for explicit version (#42970) 2024-08-09 09:08:49 -07:00
Marius Posta
2c5d5080cf .github: fix bulk cdk publish workflow trigger (#43372) 2024-08-07 11:58:25 -07:00