airbyte/airbyte-integrations/bases/source-acceptance-test/tools/strictness_level_migration

Tooling for test_strictness_level migration

This directory contains scripts that can help us manage the migration of connectors's acceptance-test-config.yml to high test strictness level. Before running these scripts you need to set up a local virtual environment in the current directory:

python -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt

Requirements

• GitHub CLI (brew install gh)

Create migration issue for GA connectors (create_issues.py)

This script will create one issue per GA connectors to migrate to high test strictness level.

What it does:

1. Find all GA connectors in ../../../../../airbyte-config/init/src/main/resources/seed/source_definitions.yaml
2. Generate an issue content (title, body, labels, project), using ./templates/issue.md.j2
3. Find an already existing issue with the same title.
4. Create the issue and return its url if it does not exist.

Issues get created with the following labels:

• area/connectors
• team/connectors-python
• type/enhancement
• test-strictness-level

Issues are added to the following project: SAT-high-test-strictness-level

How to run:

Dry run: python create_issues.py

Real execution: python create_issues.py --dry False

Create migration PRs for GA connectors (create_prs.py)

This script will create one PR per GA connectors to migrate to high test strictness level.

What it does:

1. Iterate on all GA connectors in ../../../../../airbyte-config/init/src/main/resources/seed/source_definitions.yaml
2. Create a branch for each GA connector
3. Locally migrate acceptance_test_config.yml to the latest format
4. Commit and push the changes on this branch
5. Open a PR for this branch
6. Run a SAT on this branch by posting a /test comment on the PR

An example of the PR it creates can be found here

PR get created with the following labels:

• area/connectors
• team/connectors-python
• type/enhancement
• test-strictness-level

PR are added to the following project: SAT-high-test-strictness-level

How to run:

Dry run: python create_prs.py

Real execution: python create_prs.py --dry False