1
0
mirror of synced 2025-12-23 21:03:15 -05:00
Files
airbyte/airbyte-integrations/connectors/source-bigquery
LiRen Tu b9e1997d2f Split airbyte-db and move db dev commands to gradle (#5616)
# Summary

- A follow-up PR for #5543.
- This PR separates the `airbyte-db` project to two modules:
  - `lib` is the original `airbyte-db`.
  - `jooq` is for jOOQ code generation.
- This is necessary because the jOOQ generator requires a custom database implementation that can run Flyway migration. So the code generator logic needs to depend on the compilation of the original `airbyte-db` project.

# Commits
* Separate db to lib and jooq modules
* Update dependencies
* Add jobs db migrator test
* Fix compose build
* Add migration dev center
* Add schema dump task
* Update airbyte-db/lib/README.md
  * Co-authored-by: Davin Chia <davinchia@gmail.com>
* Update readme
* Remove bom dependency
* Update readme
* Use jooq code in db config persistence
* Remove AirbyteConfigsTable

Co-authored-by: Davin Chia <davinchia@gmail.com>
2021-08-26 10:44:09 -07:00
..
2021-08-16 23:20:56 +05:30

BigQuery Test Configuration

In order to test the BigQuery source, you need a service account key file.

Community Contributor

As a community contributor, you will need access to a GCP project and BigQuery to run tests.

  1. Go to the Service Accounts page on the GCP console
  2. Click on `+ Create Service Account" button
  3. Fill out a descriptive name/id/description
  4. Click the edit icon next to the service account you created on the IAM page
  5. Add the BigQuery Data Editor and BigQuery User role
  6. Go back to the Service Accounts page and use the actions modal to Create Key
  7. Download this key as a JSON file
  8. Move and rename this file to secrets/credentials.json

Airbyte Employee

  1. Access the BigQuery Integration Test User secret on Rippling under the Engineering folder
  2. Create a file with the contents at secrets/credentials.json