1
0
mirror of synced 2025-12-22 19:38:29 -05:00
Commit Graph

26 Commits

Author SHA1 Message Date
Edward Gao
1a4d157206 move metadata validation from airbyte-ci into vanilla GHA (#64164) 2025-08-04 12:31:54 -07:00
Natik Gadzhi
d265715149 feat(airbyte-ci): re-publish connector image if --pre-release (#55262) 2025-03-30 18:50:40 -07:00
Natik Gadzhi
dae050c8fe feat(airbyte-ci): update tools to Python 3.11 (#52695) 2025-02-03 09:14:46 -08:00
Natik Gadzhi
abd0a11ba2 Revert "feat: update internal packages to Python 3.11" (#52692) 2025-01-31 11:01:47 -08:00
devin-ai-integration[bot]
e743cd4c3d feat: update internal packages to Python 3.11 (#52664)
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: natik@airbyte.io <natik@airbyte.io>
Co-authored-by: Natik Gadzhi <natik@respawn.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2025-01-31 09:55:24 -08:00
Aaron ("AJ") Steers
83ecbe0fc3 CI: apply pre-commit format fix from #49806 (#49852) 2024-12-18 14:05:43 -08:00
Augustin
12fb76a28e airbyte-ci: fix ownership issues while using --use-local-cdk (#48868) 2024-12-11 08:58:11 +01:00
Augustin
e1ecca0b8b Make progressive rollout use explicit in metadata (#46911) 2024-10-16 11:58:47 +02:00
Natik Gadzhi
95aaf8a211 airbyte-ci: connector progressive rollout finalize / rollback steps + gh actions (#45868)
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
2024-09-25 23:11:24 +00:00
Augustin
66b39a42fc airbyte-ci: do not push latest tag for release candidates (#44551)
## What
Closes https://github.com/airbytehq/airbyte-internal-issues/issues/9403
When a connector is a release candidate it will have the `releases.isReleaseCandidate` flag set to `true` in its `metadata.yaml`.
We don't want to publish the `latest` tag when the connector is a RC.

## How
Tweak the publish pipeline to conditionnaly publish the latest tag according to the metadata content.
2024-08-22 18:43:40 +02:00
Augustin
c67c5ba4e3 airbyte-ci: generate SBOM on publish (#44377) 2024-08-19 21:00:35 +02:00
Augustin
62c682034a airbyte-ci: introduce a SecretStore abstraction (#38322) 2024-05-23 11:11:11 +00:00
Stephane Geneix
e9ccc10461 airbyte-ci: augment the report for java connectors (#35317)
Today we're missing the logs (both JVM and container logs) in java connector reports.
This is creating a link to test artifacts. In the CI, the link will point to a zip file, while on a local run, it will point to a directory.

In addition, we recently added the junit XML inlined with the test standard output and error, but that didn't really work as well as we'd hoped: The reports were slow to load, they were not ordered by time, the corresponding logs were lacking. There's still a possibility they'll be useful, so rather than removing them altogether, they will be bundled in the log zip (or directory).

I'm also adding a button to copy the standard output or the standard error from a step into the clipboard.
Finally, I'm reducing the max vertical size of an expanded step, so it doesn't go over 70%, which seems much cleaner to me.

Here's an example of the result (from the child PR): d4683bfb7f/source-mssql/3.7.0/output.html
2024-02-22 09:04:02 -08:00
Augustin
944c960a9f airbyte-ci: do no run QA checks on publish - only MetadataValidation (#35437)
Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>
2024-02-20 20:15:29 +00:00
Augustin
9525793087 airbyte-ci: use connectors-qa instead of connector_ops.qa_check (#35325) 2024-02-19 18:58:09 +01:00
Joe Reuter
d1334beb2e airbyte-ci: Switch to prod pypi (#34606) 2024-01-30 09:49:50 +01:00
Joe Reuter
d289534aba airbyte-ci: Add pypi publishing logic (#34111) 2024-01-24 15:27:49 +00:00
Augustin
f90d8dbccb airbyte-ci: re-introduce mypy (#33964) 2024-01-05 04:42:16 -06:00
Edward Gao
0a3b8e7c62 airbyte-ci: Revert mypy changes (#33954)
Co-authored-by: erohmensing <erohmensing@gmail.com>
2024-01-04 21:59:17 +00:00
Augustin
917f420c58 airbyte-ci: fix types (mypy) (#33785) 2024-01-04 10:10:45 +00:00
Ella Rohm-Ensing
a53a020c6a Update Pipelines folder structure (#31525)
Co-authored-by: Ben Church <ben@airbyte.io>
Co-authored-by: erohmensing <erohmensing@users.noreply.github.com>
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
2023-10-18 23:46:03 +00:00
Marius Posta
3e680675a4 github workflows: repo-wide auto-format (#29798)
Co-authored-by: postamar <postamar@users.noreply.github.com>
2023-08-25 10:20:41 -07:00
Ben Church
b666e2e8a3 Remove release stage references in favor of support level or ab_internal (#29232)
* First pass on removing release stage references

* Automated Commit - Format and Process Resources Changes

* Fix metadata tests

* Fix qa engine tests

* Fix pipeline tests

* Update registry report

* Fix support-level arg

* Add dummy change

* Deal with --allow_community

* Improve log message

* Add docs

* Revert "Add dummy change"

This reverts commit 1861b9525a.

* Code review comments

* Run format

* Install connector ops to qa-engine

* Fix CI test

* REVERT ME

* Revert "REVERT ME"

This reverts commit dce9b8e39b.

---------

Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
2023-08-15 19:10:55 +00:00
Augustin
a9475faa22 connectors-ci: re-enable publish tests (#29149) 2023-08-07 04:47:15 -05:00
Augustin
b4606cad5f connectors-ci: fix airbyte-ci test run (#28907)
* enable workflow dispatch on test workflow

* install curl

* exit with 1 status code if exec error

* use click Abort

* fix wildcard

* remove superfluous fixtures

* skip failing publish tests

* share the docker socket with the testing container for dagger-in-dagger

* bump version

* bump version

* set workflow concurrency
2023-08-01 06:04:49 -05:00
Ben Church
fb7258e2bd Move tools/ci_* projects to airbyte-ci, update to use Poetry, bump to python 3.10 (#27957)
* Move ci_connector_ops

* Move ci_credentials

* Move tools/ci_common_utils

* Rename tools to airbyte-ci

* Move to ci

* Convert ci_credentials

* Convert ci_common_utls

* Convert ci_connector_ops

* Get pipelines running

* Move pipelines to own poetry project

* Update readme

* Delete

* Add ci_code_validator

* Use pipx to install gha deps

* Fix'

* Ensure every thing is running

* Automated Commit - Formatting Changes

* Gitignore miss

* Add pipx installer

* Get local pipx dependencies

* Fix paths

* Install pipx

* ceremonial source-faker change

* Add installation step for ci_code_validator

* Add comment

* remove ci_code_validator

* Address code review comments

* add pipx install to acceptance-test-docker.sh

* Run formater

* Revert "ceremonial source-faker change"

This reverts commit 26884cd0db.

* gitignore lecacy pipeline report path

* update poetry.lock

* skip upload if logs do not exist

---------

Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
2023-07-26 15:49:59 +00:00