jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-21 19:11:14 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,480 Commits 5,109 Branches 518 Tags
yarden/source-mongodb-support-dynamic-arrays
Commit Graph

321 Commits

Author SHA1 Message Date
devin-ai-integration[bot]
b25da68e14 fix(destination-bigquery): Add backticks to column names in SQL generation to prevent syntax errors (#67401) 
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
 2025-11-25 17:18:01 +00:00
Edward Gao
7c4b0e335a Destination Bigquery: Correctly handle timestamps getting nulled out (#69307) 2025-11-13 08:33:19 -08:00
Edward Gao
f896b615de Destination Bigquery: upgrade cdk (#69231) 2025-11-11 19:39:03 +00:00
octavia-bot[bot]
7ec10691d6 chore: upgrade destination-bigquery to bulk CDK 0.1.61 (#69126) 
Co-authored-by: edgao <5741425+edgao@users.noreply.github.com>
Co-authored-by: octavia-bot[bot] <108746235+octavia-bot[bot]@users.noreply.github.com>
Co-authored-by: Subodh Kant Chaturvedi <subodh1810@gmail.com>
 2025-11-05 12:27:46 +05:30
Edward Gao
89a5b89403 Destination bigquery: defensive behavior (#69083) 2025-10-31 14:30:07 -07:00
Edward Gao
1d38f49895 Destination bigquery: log load job stats (#68671) 2025-10-28 09:04:46 -07:00
Subodh Kant Chaturvedi
9eb70fb5a7 feat: update speed destination connectors to work with new proto format (#67153) 
Co-authored-by: Rodi Reich Zilberman <867491+rodireich@users.noreply.github.com>
 2025-10-21 23:03:33 +05:30
Ryan Br...
3d7579ffcc Rbroughan/update bq interfaces (#68152) 
## What
Update BQ to new interfaces
 2025-10-17 08:22:22 -07:00
Davin Chia
bc888917f8 chore: remove memory limits from certified GA destinations (#67078) 
Remove memory_limit from sync job resourceRequirements for 4 certified GA destinations:

destination-s3 (1.9.2 → 1.9.3)
destination-bigquery (3.0.7 → 3.0.8)
destination-azure-blob-storage (1.1.1 → 1.1.2)
This change improves performance and resource utilization by removing artificial memory caps while keeping memory_request intact.

Limits are mostly a cost concern, and connector devs shouldn't need to set them to begin with.

🤖 Generated with Claude Code

Co-authored-by: Claude <noreply@anthropic.com>
 2025-10-06 10:36:55 -07:00
octavia-bot[bot]
61bc7bf5f4 🐙 destination-bigquery: release 3.0.7 (#65905) 
Co-authored-by: octavia-bot[bot] <108746235+octavia-bot[bot]@users.noreply.github.com>
Co-authored-by: subodhchaturvedi <subodh1810@gmail.com>
 2025-09-03 22:44:37 +05:30
Subodh Kant Chaturvedi
6a453b3df4 feat: implement socket+proto support for bigquery (#65114) 2025-08-28 00:16:15 +05:30
Edward Gao
6baa9c0e09 Destination Bigquery: Even more handling for billing errors (#63700) 2025-07-24 09:13:00 -07:00
Edward Gao
7fe15a7003 Destination Bigquery: GCS mode supports null chars in strings (#63312) 2025-07-18 17:01:43 +00:00
Jimmy Ma
ff463304e5 feat(destination-bigquery): improve error reporting for billing issues (#63327) 2025-07-16 09:15:38 -07:00
Edward Gao
da56fa8b65 Destination bigquery: more schema evolution fixes (#62448) 2025-07-08 20:47:43 +00:00
Edward Gao
ba7b3d60ba Destination bigquery: better schema evolution error messages (#62106) 2025-06-30 07:59:02 -07:00
Edward Gao
0da52a347c Destination Bigquery: quote names everywhere (#62085) 2025-06-26 13:04:38 -07:00
Edward Gao
e137a10160 Destination bigquery: Implement direct load (#59752) 
Co-authored-by: Francis Genet <francis.genet@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Ian Alton <ian.alton@airbyte.io>
 2025-06-25 20:09:17 +00:00
Francis Genet
f2f090d92b Bad PR number in BQ changelog (#62050) 2025-06-24 21:47:57 +00:00
octavia-bot[bot]
575c1c9b03 🐙 destination-bigquery: release 2.12.4 (#62045) 
Co-authored-by: octavia-bot[bot] <108746235+octavia-bot[bot]@users.noreply.github.com>
Co-authored-by: Francis Genet <francis.genet@airbyte.io>
 2025-06-24 13:06:06 -07:00
Francis Genet
8369d85a21 [Bigquery] More retries is better retries (#62041) 2025-06-24 11:44:21 -07:00
Edward Gao
b931a6d022 Destination Bigquery / Bulk load CDK: increase message queue memory ratio (#62016) 2025-06-23 17:49:22 +00:00
Edward Gao
863408dc36 Destination Bigquery / Bulk load CDK: make JsonSchema parser more robust against invalid schemas (#62014) 2025-06-23 10:35:08 -07:00
Francis Genet
24805a51c7 fix: Update ObjectStoragePathFactory to allow for custom validation (#61702) 2025-06-18 14:30:17 -07:00
Edward Gao
b84b9b4087 Destination Bigquery / bulk load CDK: validate catalog at startup (#61700) 2025-06-18 13:50:31 -07:00
Edward Gao
cebaba574e Destination bigquery: revert revert, release as 2.12.4-rc.1 (#61649) 2025-06-17 09:12:27 -07:00
Francis Genet
88e31d393c [BigQuery] 2.12.3 release. (#61648) 
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
 2025-06-17 07:57:37 -07:00
Edward Gao
211f0dc8c8 Destination bigquery: start progressive rollout for CDK state handling fix (#61637) 2025-06-16 09:01:37 -07:00
Davin Chia
0af493bed1 chore: add readme warning. (#61596) 
After #61588, we discovered the local CDK version has a bug. These versions should not be used.
 2025-06-13 15:05:06 -07:00
Davin Chia
2c573f8e4e chore: preemptively bump certified connectors. (#61588) 
Following #61584. Bumping certified connector versions to make sure the version and code commits align. Doing this in 2 parts.

Bump BQ, SF, S3, S3-data-lake.
 2025-06-13 17:34:40 +00:00
Edward Gao
be96aa252c Destination bigquery: Write compressed CSV files (#61432) 2025-06-10 16:20:46 +00:00
Edward Gao
948477f913 Destination Bigquery: throw useful error when crashing in setup (#61018) 2025-06-04 08:47:08 -07:00
Edward Gao
10c64b869b Destination bigquery: no need to drop namespace anymore (#61321) 2025-06-02 10:18:49 -07:00
Edward Gao
75f028d574 Destination Bigquery: use default namespace in CHECK (#60986) 2025-05-29 23:14:22 +00:00
Edward Gao
b633dc79cd Destination Bigquery: better force create table (#60973) 2025-05-29 13:24:30 -07:00
github-actions[bot]
0934847d56 🐙 destination-bigquery: release 2.11.0 (#60922) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-05-27 19:11:03 +03:00
Francis Genet
25e3573846 [BigQuery] Add a random element to the check namespace (#60865) 2025-05-22 20:29:18 +00:00
Edward Gao
f11a7e07f1 Destination bigquery: RC5: smarter standard inserts implementation to avoid rate limit (#60859) 
Co-authored-by: Francis Genet <francis.genet@airbyte.io>
 2025-05-22 18:06:25 +00:00
Edward Gao
16875ca1df Destination bigquery: RC5: better periodic state flushing (#60841) 2025-05-21 20:34:14 +00:00
Edward Gao
c731bd2d51 Destinations bigquery, mssql: handle streams with no columns (#60791) 2025-05-19 18:22:48 +00:00
Edward Gao
7cd9e4b9ef Destination bigquery: RC3 - fix behavior on sources emitting many state messages (#60324) 2025-05-16 19:01:40 +00:00
Edward Gao
6fad1d44b2 Destination Bigquery: RC2 - fix column name handling (#60302) 2025-05-15 21:24:23 +00:00
Edward Gao
8f447197ec Destination bigquery: use new cdk (#56980) 
Co-authored-by: Francis Genet <francis.genet@airbyte.io>
Co-authored-by: Aaron ("AJ") Steers <aj@airbyte.io>
 2025-05-15 15:34:06 +00:00
Nikita R
ae9687e2ee Destination BigQuery: add europe-north2 region (#59142) 
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
 2025-04-29 12:30:30 -03:00
Ian Alton
01cd16654e 11059 multi-instance, versioned docs (#58095) 
Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2025-04-24 02:58:09 +03:00
Edward Gao
046df3d7e5 Destination Bigquery: clean up sqlgenerator (#57569) 
Co-authored-by: Francis Genet <francis.genet@airbyte.io>
 2025-04-14 10:40:43 -07:00
Edward Gao
71d1ab12a6 Destination bigquery: partition raw table on extracted_at; upgrade to latest cdk (#56982) 2025-04-07 09:44:34 -07:00
devin-ai-integration[bot]
ceaf322225 chore(destination): Upgrade all Java destination connectors to use java-connector-base:2.0.1 (#56355) 
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: davin@airbyte.io <davin@airbyte.io>
Co-authored-by: Davin Chia <davinchia@gmail.com>
 2025-03-24 18:59:36 -04:00
Edward Gao
b51d9a4043 Destinations: extract common documentation about airbyte fields (#53177) 2025-02-10 13:32:14 -08:00
Augustin
fd21f1726c destination-bigquery: Use airbyte/java-connector-base:2.0.0 (#51482) 2025-01-14 09:14:26 +01:00