1
0
mirror of synced 2026-01-02 21:02:43 -05:00
Commit Graph

8 Commits

Author SHA1 Message Date
George Claireaux
c5783aa799 connectors that published (#13932) 2022-06-20 12:42:56 +01:00
mkhokh-33
35005541f9 source-bigquery: escape column names and update google cloud bigquery artifact (#11484)
* source-bigquery: escape column names and update google cloud bigquery artifact

* source-bigquery: escape column names and update google cloud bigquery artifact

* source-bigquery: fix formatting

* source-bigquery: fix review comments

* bump versions

* bump versions source_specs.yaml

* revert bump versions

* fix publish-command.yml

* revert publish-command.yml

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-04-13 22:58:29 +03:00
Lake Mossman
3d8a0dc048 Add ExitOnOutOfMemoryError to java connectors and bump versions (#10256) 2022-02-14 15:49:15 -08:00
Karina Kuznietsova
cbe8da49f3 Update fields in source-connectors specifications: amplitude, apify-dataset, appstore-singer, aws-cloudtrail, azure-table, bigcommerce, bigquery, braintree, cart, chargebee (#8434)
* Titles and Descriptions changes #8364
* bump version, update changelogs

Co-authored-by: Karina <karina.kuznietsova@zazmic.com>
2021-12-23 14:45:08 +02:00
Abhi Vaidyanatha
ae32ecbb27 GitBook: [master] 186 pages and 77 assets modified 2021-10-08 21:17:47 +00:00
Marcos Marx
153c003e4a Marcos/test pr 6524 (#6577)
* handle empty or null data set id

* bump version

Co-authored-by: prasrvenkat <pras@calixa.io>
2021-09-30 14:17:35 -03:00
irynakruk
4625d9036a 🐛 BigQuery source: Fix nested structs (#6135)
* Fixed parsing nested Structs

* Update bigquery.md

* Clean up

* Update Dockerfile
2021-09-17 10:08:30 -04:00
Andrii Leonets
9151d83bcf 🐛 BigQuery source: Fix nested arrays (#4981)
* unfinished jdbcsource separation

* creation AbstactRelation

* Migrate StateManager to new abstract level (JdbcSource -> RelationalSource)

* fix imports

* move configs to Database level + fix MySql source

* make in line jdbc source with a new impl

* Fix ScaffoldJavaJdbcSource template

* rename `AbstractField` to `CommonField`. Now it
s not an abstract class.
+ add default implementation for `AbstractRelationalDbSource.getFullyQualifiedTableName`

* format

* rename generated files in line with their location

* bonus renaming

* move utility methods specific for jdbc source to a proper module

* internal review update

* BigQueryDatabase impl without row transformation

* add Static method for BigQueryDatabase instancing

* remove data type parameter limitation + rename class parameters

* Move DataTypeUtils from jdbs to common + impl basic types BigQueryUtils

* make DB2 in line with new relational abstract classes

* add missing import

* cover all biqquery classes + add type transformation method from StandardSQLTypeName to JsonSchemaPrimitive

* close unused connections

* add table list extract method

* bigquery source connector

* return all tables for a whole project instead of a dataset

* impl incremental fetch

* bigquery source connector

* bigquery source connector

* remove unnecessary databaseid

* add primitive type filtering

* add temporary workaround for test database.

* add dataset location

* fix table info retrieving

* handle dataset config

* Add working comprehensive test without data cases

* minor changes in the source processing

* acceptance tests; discover method fix

* discover method fix

* first comprehensinve test

* Comprehensive tests for the BigQuery source + database timeout config

* bigquery acceptance tests fix; formatting

* fix incremental sync using date, datetime, time and timestamp types

* Implement source checks: basic and dataset

* format

* revert: airbyte_protocol.by

* internal review update

* Add possibility to get list of comprehensive tests in a Markdown table format.

* Update airbyte-integrations/connectors/source-bigquery/src/main/resources/spec.json

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* review update

* Implement processing for arrays and structures

* format

* added bigquery secrets

* added bigquery secrets

* spec fix

* test configs fix

* extend mapping for Arrays and Structs

* Process nested arrays

* handle arrays of records properly.

* format

* BigQuery source docs

* docs readme update

* hide evidences

* fix changlog order

* Add bigquery to source_defintions yaml

Co-authored-by: heade <danildubinin2@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-07-27 20:27:12 +03:00