jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-22 19:38:29 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,480 Commits 5,117 Branches 518 Tags
yarden/source-mongodb-support-dynamic-arrays
Commit Graph

2421 Commits

Author SHA1 Message Date
Edward Gao
b7eab7564d Destination bigquery: don't error on malformed creds (#32261) 
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-11-07 19:06:12 -04:00
Edward Gao
37172c1261 Destination bigquery: reduce commit frequency in GCS staging mode (#32112) 
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-11-07 18:23:31 -04:00
Edward Gao
1a404296cb Destination s3: also pin oss (#32278) 2023-11-07 22:22:15 +00:00
Edward Gao
bbe45b4650 Destination s3: pin cloud to 0.5.1 (#32228) 2023-11-07 16:45:50 +00:00
Joe Bell
04c067d01d Destinations BigQuery and Snowflake - Move SAFE/TRY casting to seperate transaction (#32026) 
Co-authored-by: jbfbell <jbfbell@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-11-06 20:33:54 -04:00
Edward Gao
c81abe51a8 Destination bigquery + Snowflake: Further error grouping improvements (#32190) 
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-11-06 13:25:06 -04:00
Stephane Geneix
a2f8eec7f8 update CDK to 0.4.1 (#32193) 2023-11-04 09:53:08 -04:00
Marius Posta
56df6decae destination-s3: use CDK 0.4.0, fix broken lzo dep (#32178) 2023-11-03 14:32:41 -07:00
Edward Gao
2f931d824e Destination snowflake: Revert merge statement (#32124) 2023-11-03 14:04:24 -07:00
Joe Reuter
ca9a7c3835 Weaviate: Update weaviate client library (#32134) 2023-11-03 12:21:26 +01:00
Edward Gao
453232b366 Destinations bigquery+snowflake: better sentry error grouping (#31983) 
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-11-02 16:32:11 +00:00
Joe Reuter
402ac603f4 Weaviate: Add retry (#32038) 2023-11-02 11:50:10 +01:00
Joe Reuter
55f241d3dc Milvus: Improve code sample in documentation (#32037) 2023-11-01 11:59:19 +01:00
Al-Moatasem
1ce84d6396 ✨-Destination BigQuery: Updating Dataset Locations List (#32010) 2023-10-31 14:58:30 -05:00
Edward Gao
82679a679c Destinations snowflake+bigquery: delay upgrade deadline to nov 7 (#31985) 
Co-authored-by: Alexandre Cuoci <Hesperide@users.noreply.github.com>
 2023-10-31 11:47:48 -04:00
Marius Posta
7cd8020ac8 java CDK: hoist top-level gradle projects into CDK (#31960) 
Co-authored-by: postamar <postamar@users.noreply.github.com>
 2023-10-30 12:03:06 -07:00
Evan Tahler
2214883d57 databricks: remove note about normalization (#31969) 2023-10-30 16:36:20 +00:00
Joe Reuter
c828692b01 Weaviate: Fix memory leak (#31953) 2023-10-30 17:20:34 +01:00
Edward Gao
877200de94 Destination snowflake: filter raw table commit on extracted_at (#31897) 2023-10-27 13:14:50 -04:00
Edward Gao
c6005b17e9 Destination snowflake: T+D via merge (#31683) 
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-10-27 15:58:00 +00:00
Edward Gao
45505dd45c Destination bigquery: Use merge statement to do T+D (#31529) 
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-10-27 15:55:50 +00:00
Joe Reuter
3de1a05d17 Upgrade CDK for Milvus/Qdrant/Chroma/Weaviate (#31563) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-10-27 16:03:23 +02:00
Gireesh Sreepathi
3e764712f4 Destination BigQuery + Snowflake : Disable type and dedupe step controlled by flag in Connector spec (#31686) 
Signed-off-by: Gireesh Sreepathi <gisripa@gmail.com>
Co-authored-by: gisripa <gisripa@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: Evan Tahler <evan@airbyte.io>
 2023-10-26 13:46:54 -07:00
Joe Reuter
bee749b04b Pinecone: Namespace and field remapping support (#31373) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
 2023-10-26 14:10:23 +00:00
Henri Blancke
8d60177786 🐛 Destination AWS Datalake: Upgrade AWSWrangler (#29221) 
Signed-off-by: Henri Blancke <blanckehenri@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
 2023-10-25 14:00:35 -03:00
Edward Gao
148dda1c1f Destinations Bigquery+Snowflake: Do not dedup raw table (#31520) 
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-10-25 12:19:58 -04:00
Aaron ("AJ") Steers
0f2fbe6e09 ✨ Destination DuckDB: Use latest DuckDB 0.9.1 libraries 🚨(breaking change)🚨 (#31744) 2023-10-24 15:18:52 -07:00
Evan Tahler
62027b5b11 No deduping for mysql-destination (#31781) 2023-10-24 10:46:17 -05:00
Joe Bell
500a7d9a75 Destination Bigquery - Remove v2 check (#31717) 2023-10-23 11:07:54 -07:00
Augustin
a41c4f5b3d Migrate connectors to use our python base image (Round 2) (#31599) 2023-10-19 17:58:45 +02:00
Ignacio Valdelvira
06dc186531 Update bigquery.md with output schemas of V2 destination (#31548) 
Co-authored-by: Evan Tahler <evantahler@gmail.com>
 2023-10-19 08:29:29 -05:00
Joe Reuter
083fc2035b Vector DBs: Upgrade CDK (#31329) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
 2023-10-18 15:48:55 +02:00
Benoit Moriceau
25dc4f6df2 Add standard async (#29812) 
Co-authored-by: tryangul <ryan.broughan@gmail.com>
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
Co-authored-by: tryangul <tryangul@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
 2023-10-17 14:56:00 -07:00
Edward Gao
f1baf2a2f2 Destinations snowflake+bigquery: Improve performance by filtering raw table on extracted_at (#31191) 
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-10-17 17:48:18 +00:00
Gireesh Sreepathi
c4ff29e23a Destinations bigquery: Fix string-json auto conversion for BigQuery (#31358) 
Signed-off-by: Gireesh Sreepathi <gisripa@gmail.com>
Co-authored-by: gisripa <gisripa@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
 2023-10-12 17:13:39 -07:00
Ryan Br
5f9bec01bd Remove entry and allocated memory for empty buffers. (#31194) 
Co-authored-by: tryangul <tryangul@users.noreply.github.com>
 2023-10-11 11:22:46 -07:00
Cynthia Yin
e3d126b5e7 🐛 Fixing rounding of numeric values for async destinations (#31083) 2023-10-10 22:13:33 -04:00
Evan Tahler
898846d40a Remove Dv2 Null checks (#31149) 
Co-authored-by: evantahler <evantahler@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
 2023-10-10 15:36:00 -04:00
Evan Tahler
0cf410814a destination-redshift: Clarify configuration groups (#31218) 2023-10-10 10:48:09 -07:00
Evan Tahler
589ea37004 destination-bigquery - better config groups (#31198) 
Co-authored-by: Alexandre Cuoci <Hesperide@users.noreply.github.com>
 2023-10-10 10:48:01 -07:00
Evan Tahler
f4f97e3e65 destination-bigquery: Increase staging file upload timeout to 5 minutes (#31185) 2023-10-09 17:28:48 +00:00
Benoit Moriceau
8fddc21c35 Add missing java options (#31153) 2023-10-07 01:07:21 +00:00
Benoit Moriceau
9e2b3f4990 Bump CDk (#31139) 2023-10-06 16:50:21 -05:00
Joe Reuter
64964cceb9 Vector DB Destinations: Fix OpenAI batch size and Weaviate field name collision (#31075) 2023-10-06 23:18:22 +02:00
Benoit Moriceau
6e1a56d6b1 reduce block size (#31129) 2023-10-06 11:44:37 -05:00
Edward Gao
ad5ce75be9 Revert "T&D: Use non-null columns for PKs rather then scanning raw ta… (#31082) 2023-10-04 17:25:41 -05:00
Joe Bell
4ebac2e032 Destination Bigquery - Triple timeout (#31028) 2023-10-04 18:49:11 +00:00
Evan Tahler
4992fce7ba T&D: Use non-null columns for PKs rather then scanning raw table to ensure all records have PKs (#30779) 
Co-authored-by: evantahler <evantahler@users.noreply.github.com>
Co-authored-by: Joe Bell <joseph.bell@airbyte.io>
Co-authored-by: jbfbell <jbfbell@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-10-03 16:23:01 +00:00
Edward Gao
83949efd1e Destination Snowflake: upgrade to latest snowflake jdbc driver (#30938) 2023-10-02 11:18:32 -07:00
Joe Reuter
14bfc11668 Milvus, Chroma, Qdrant, Pinecone: Update CDK (#30820) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-10-01 14:28:37 +00:00