Edward Gao
c8e3ec0210
Fix build: Revert "chore: clean out unused "bases" and utils ( #53234 )" ( #53621 )
2025-02-10 21:36:30 +00:00
Natik Gadzhi
4dec57a29f
chore: clean out unused "bases" and utils ( #53234 )
2025-02-07 15:19:32 -08:00
George Claireaux
7ba102b441
Add and persist job failures for Normalization ( #14790 )
...
* added TracedException and uncaught exception handler
* added trace message capturing
* added tests for TRACE messages
* pre-json logging
* propagating normalization failures
* log format json & fix hang
* parsing dbt json logs
* bump normalization version
* tests
* Benoit comments
* update trace exception user message
* review comments
* bump version
* bump version
* review comments
* nit comments
* add normalization trace failure test
* version bump
* pmd
* formatto
* bump version
2022-08-02 15:37:00 +01:00
Augustin
e8146e5ec2
Normalization: Upgrade MySQL to dbt 1.0.0 ( #11470 )
2022-06-15 15:05:49 -07:00
Serhii Chvaliuk
7401cb64c0
Normalization: Checking --event-buffer-size on old dbt crashed entrypoint.sh ( #12924 )
...
* Fixed checking --event-buffer-size on old dbt crashed entrypoint.sh
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com >
2022-05-18 11:08:12 +03:00
Edward Gao
0464a1074b
🐛 Normalization: Decrease event buffer size ( #11267 )
2022-03-25 16:03:21 -07:00
Christophe Duong
38ee7a7348
Redirect dbt log files to airbyte log when failing ( #8621 )
...
not publishing yet as it's not urgent, will be available next time we work on normalization
2021-12-08 19:10:50 +01:00
George Claireaux
3d8625e03d
Fix ssh tunneling for normalization ( #6396 )
...
* switch to custom file for ssh config in normalization
* bump version
* get local port properly
* added unit test for write_ssh_config
* format
2021-09-23 14:08:45 +01:00
Christophe Duong
edcd83dd1a
Add a config for instance wide oauth parameters ( #5761 )
...
* Add a config for instance wide oauth parameters
* Remove recreate endpoints and add tests
* Inject oauth params in discover/check/reset too
* Inject masked OAuth params for UI Validation (#5865 )
Co-authored-by: Sherif Nada <snadalive@gmail.com >
2021-09-09 10:36:21 +02:00
Charles
8ad43afb07
SSH for Postgres Destination ( #5743 )
...
Co-authored-by: George Claireaux <phlair@users.noreply.github.com >
2021-09-07 17:06:25 -07:00
Christophe Duong
9b324f3ba5
Make operations run with UI integration ( #4055 )
2021-06-11 15:45:22 +02:00
Christophe Duong
083aebcbcb
Workflow to handle operations (custom transformation) ( #3379 )
...
* Keep normalization backward compatible with old settings from destination
* Bumpversion normalization image
2021-05-17 18:08:27 +02:00
Christophe Duong
194d6cb5d0
Add metadata prefix to destination internal columns ( #1708 )
...
* Add metadata prefix to destination internal columns
* Bumpversion all destinations for new normalization behavior
* Fix acceptance tests
2021-01-19 17:21:15 +01:00
Christophe Duong
0f7b1eeacd
Download external DBT dependencies when building normalization docker image ( #1519 ) ( #1520 )
2021-01-05 18:34:45 +01:00
Christophe Duong
206d3cbea8
Naming conventions managed in destinations ( #1060 )
...
Handled field and table identifier conversions as necessary in order to successfully in destinations
2020-11-25 18:53:23 +01:00
Christophe Duong
d042ef524a
DBT project for Airbyte normalization ( #802 )
...
Add a step that generates config files and SQL files in order to run DBT which takes care of converting JSON blob data (from catalog.json JSON Schema) into normalized tables
Co-authored-by: cgardens <giardina.charles@gmail.com >
Co-authored-by: Sherif Nada <snadalive@gmail.com >
2020-11-06 23:02:30 +01:00
Charles
90f8c587fe
Hook up Normalization Scripts and Run DBT ( #821 )
2020-11-04 16:11:50 -08:00
Charles
e5e6ce9550
normalization base project / docker image setup ( #792 )
2020-11-03 15:36:56 -08:00
