airbyte

mirror of synced 2026-01-08 03:06:34 -05:00

Files

Daemonxiao d4524032ae 🎉 New Destination: TiDB (#15592 )

* Add new destination-tidb

* support sync

* Add normalization-tidb

* fix failed tests

* Add unnest marco

* fmt

* Add new destination-tidb

* support sync

* Add normalization-tidb

* fix failed tests

* Add unnest marco

* fmt

* fmt

* fix integration test

* Update docs/integrations/destinations/tidb.md

Co-authored-by: Xiang Zhang <angwerzx@126.com>

* Update doc

* Update doc

* Update doc

* bump normalization version

* update normalization changelog

* run format

* add dest def

* generat spec

Co-authored-by: Xiang Zhang <angwerzx@126.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>

2022-08-31 16:50:27 -03:00

macros

🎉 New Destination: TiDB (#15592 )

2022-08-31 16:50:27 -03:00

dbt_project.yml

Un-revert add /tmp emptyDir volume to connector pods (#11511 )

2022-04-11 13:12:51 -07:00

packages.yml

🎉 upgrade dbt to 1.0.0 (except for oracle and mysql) (#11051 )

2022-03-11 16:38:37 -08:00

README.md

Change all instances of DBT to dbt in markdown files. (#4308 )

2021-06-23 19:00:44 -07:00

README.md

Installing dbt

Activate your venv and run pip3 install dbt
Copy airbyte-normalization/sample_files/profiles.yml over to ~/.dbt/profiles.yml
Edit to configure your profiles accordingly

Running dbt

cd airbyte-normalization
You can now run dbt commands, to check the setup is fine: dbt debug
To build the dbt tables in your warehouse: dbt run

Running dbt from Airbyte generated config

You can also change directory (cd /tmp/dev_root/workspace/1/0/normalize for example) to one of the workspace generated by Airbyte within one of the normalize folder.
You should find profiles.yml and a bunch of other dbt files/folders created there.
To check everything is setup properly: dbt debug --profiles-dir=$(pwd) --project-dir=$(pwd)
You can modify the .sql files and run dbt run --profiles-dir=$(pwd) --project-dir=$(pwd) too
You can inspect compiled dbt .sql files before they are run in the destination engine in normalize/build/compiled or normalize/build/run folders