jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-23 03:47:05 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,480 Commits 5,116 Branches 518 Tags
yarden/source-mongodb-support-dynamic-arrays
Commit Graph

2421 Commits

Author SHA1 Message Date
Evan Tahler
8d1bc7305c Remove mention of bigquery-denormalized from bigquery docs (#30848) 2023-09-28 19:33:19 +00:00
Edward Gao
6d831f1a0d Destination snowflake: Fix regression from cdk publish race condition (#30835) 2023-09-28 14:32:42 -04:00
Joe Reuter
f161e2e441 🚨 Weaviate destination: Add embedding capabilities, overwrite and dedup support, API key auth mode and available on Airbyte Cloud (#30151) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
Co-authored-by: Aaron ("AJ") Steers <aj@airbyte.io>
 2023-09-28 11:09:39 +02:00
Benoit Moriceau
0537dde7d2 Bmoric/async memory bump (#30775) 
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
 2023-09-27 18:44:20 -05:00
Edward Gao
4c26d4cceb DV2: Fix column name collision detection (#30739) 
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-09-27 15:57:43 -07:00
Joe Bell
05c7269a50 Destination BigQuery - Try unsafe operations with exception handling (#30696) 2023-09-27 20:57:44 +00:00
Edward Gao
8abda48f14 🐛 Destination snowflake: support concurrent syncs with identical stream name but different namespace (#30599) 
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-09-27 15:57:11 -05:00
Joe Reuter
e100c27d49 Milvus / Qdrant / Pinecone: Update CDK (#30689) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-09-26 12:03:22 +02:00
Joe Reuter
bc0d9805d6 Pinecone: Fix stale vectors on starter pods (#30718) 2023-09-26 11:05:09 +02:00
Peter Hu
2cb6372875 ✨ Destination Google Sheets: include socat binary in docker image (#30748) 2023-09-25 23:49:26 +00:00
Evan Tahler
1ac6f80524 ✨ Destination Teradata Vantage: Enabled dbt custom transformation for… (#30740) 2023-09-25 16:43:14 -04:00
Edward Gao
7a8150eb25 Destination bigquery: soft reset correctly handles previous sync unclean exit (#30697) 2023-09-22 19:05:14 +00:00
Edward Gao
15c8ce9a67 Destination bigquery: handle case where stream name and namespace are identical (#30640) 
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-09-22 10:51:28 -05:00
Joe Reuter
afefc10527 Pinecone destination: Set certified flag (#30649) 2023-09-22 10:04:19 +02:00
Benoit Moriceau
f599c1c3c9 Reduce the snowflake async buffer size (#30671) 2023-09-21 16:47:13 -05:00
Mark Wagner
ca30781ca6 🐛 Destination Azure Blob Storage: Switch per-record logging in writer from info to debug (#30412) 
Co-authored-by: Evan Tahler <evan@airbyte.io>
 2023-09-20 19:20:56 -05:00
Ryan Br
317f7acc22 ✨ Bigquery uses async framework (#30069) 
Co-authored-by: tryangul <tryangul@users.noreply.github.com>
Co-authored-by: benmoriceau <benoit@airbyte.io>
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
 2023-09-20 16:34:07 -05:00
Aaron ("AJ") Steers
f2a1841869 🐛 Destination DuckDB: Fix schema name handling (#30600) 2023-09-20 08:52:15 -07:00
Joe Reuter
e3e8eb0a19 🐛Pinecone destination: Fix loading of large records (#30514) 2023-09-20 11:23:35 +00:00
Cynthia Yin
bb73ece673 Destination BigQuery + Snowflake: delete unused constants for reserved keywords (#30592) 2023-09-19 15:18:28 -07:00
Aaron ("AJ") Steers
68380cbfef Source DuckDB: ✨ Add MotherDuck support 🦆🦆 (#29428) 
Co-authored-by: Elena Felder <41136058+elefeint@users.noreply.github.com>
 2023-09-19 13:26:07 -07:00
Benoit Moriceau
12fb75331b Make sure that the buffers are push at least every 5 minutes (#30546) 
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
 2023-09-19 08:33:04 -07:00
Tope Folorunso
9c23a121e5 🎉 New Destination: Qdrant (Vector Database) (#30332) 
Co-authored-by: Joe Reuter <joe@airbyte.io>
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-09-19 17:18:35 +02:00
Cynthia Yin
839fb26e09 🐛 Destination Snowflake - support reserved column names (#30319) 
Co-authored-by: cynthiaxyin <cynthiaxyin@users.noreply.github.com>
 2023-09-19 02:27:20 -07:00
Joe Reuter
6b48ecf1f6 🐛 Pinecone destination: Fix delete with many entries on starter pods (#30510) 2023-09-19 10:27:03 +02:00
Evan Tahler
e366ebdbd7 destination-bigquery GCS staging comes first (#30551) 2023-09-18 17:14:36 -07:00
Benoit Moriceau
a7c13dc6f1 Improve the memory usage of the async destination (#30479) 
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
 2023-09-18 16:31:57 -07:00
Edward Gao
8805edcea6 DV2: Better errors in the UI (#30491) 
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-09-18 15:58:56 +00:00
Martin Hwasser
c801aa3aa7 ✨ Add azure embedder to destination-pinecone. (#30296) 
Co-authored-by: Joe Reuter <joe@airbyte.io>
 2023-09-15 11:10:47 +02:00
Edward Gao
68c6b01937 Destinations v2: threadsafe setup (#30439) 
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-09-14 11:56:12 -05:00
Edward Gao
70ef3b4d1d 🐛 Destination snowflake: Handle namespace/stream name/columns containing ${ (#30416) 2023-09-14 08:17:24 -07:00
Joe Reuter
9fa6fe363a Pinecone destination: Promote to beta/certified (#30382) 2023-09-14 15:34:39 +02:00
Tope Folorunso
034e147bbf 🎉 New Destination: Chroma (Vector Database) (#30023) 
Co-authored-by: Joe Reuter <joe@airbyte.io>
Co-authored-by: Joe Reuter <email@johannes-reuter.de>
 2023-09-13 18:51:50 +02:00
Edward Gao
0910f3a626 DV2: add log messages for name collisions (#30364) 2023-09-12 22:47:08 +00:00
Evan Tahler
0dac23542b ⚠️ Retire destination-bigquery-denormalized (#28488) 
Co-authored-by: evantahler <evantahler@users.noreply.github.com>
Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>
 2023-09-12 16:00:16 -05:00
Edward Gao
e0ce2ac4d0 destinations v2: snowflake: threadsafe typing and deduping (#29878) 
Co-authored-by: edgao <edgao@users.noreply.github.com>
Co-authored-by: Evan Tahler <evan@airbyte.io>
Co-authored-by: evantahler <evantahler@users.noreply.github.com>
 2023-09-12 17:28:50 +00:00
Joe Reuter
4b18146d29 Pinecone destination: Improve spec and allowed hosts (#30193) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
 2023-09-12 09:25:10 +00:00
Martin Hwasser
09c38ed14c Langchain destination: Use embedders from CDK (#30282) 
Co-authored-by: Joe Reuter <joe@airbyte.io>
 2023-09-11 15:52:28 +02:00
Joe Reuter
723a523481 🎉 New Destination: Milvus (#29790) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-09-11 10:23:28 +02:00
Joe Reuter
988aa32294 Pinecone destination: Refactor to use vector DB CDK (#30133) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
Co-authored-by: alafanechere <alafanechere@users.noreply.github.com>
 2023-09-08 16:04:29 +02:00
Cynthia Yin
1db33d9c55 🐛 Destination BigQuery - change typing and deduping error column creation (#30070) 
Co-authored-by: cynthiaxyin <cynthiaxyin@users.noreply.github.com>
 2023-09-06 16:44:48 -07:00
Joe Bell
11068c1c4e Destinations V2 - T&D Streams in parallel (#30020) 
Co-authored-by: jbfbell <jbfbell@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
 2023-09-06 10:04:34 -07:00
Pedro S. Lopez
3cc4cada09 fix langchain breaking change metadata (#30174) 2023-09-06 09:57:23 -04:00
Evan Tahler
7fc7db7ea4 T&D frequency: stream start, 6h(*) (#30117) 2023-09-06 01:22:20 +00:00
Joe Reuter
de31c73b65 Pinecone destination: Switch to GRPC client (#30086) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-09-05 19:31:14 +02:00
Edward Gao
9231c044d9 🐛 Destination snowflake: Create final tables with uppercase naming (#30056) 
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-09-05 11:54:53 -05:00
Joe Reuter
dee066bf68 🚨 Langchain destination: Fix dedup bug (#30080) 2023-09-05 17:16:01 +02:00
Joe Reuter
63d79a2656 Fix Langchain docs (#30127) 2023-09-05 09:48:51 +02:00
Joe Reuter
4615423b39 🚨 Pinecone destination: Fix dedup bug (#30079) 2023-09-04 09:58:44 +02:00
Evan Tahler
636da8ecf2 ✨Destination Snowflake: improve performance by skipping TRY_CAST for string columns (#30121) 2023-09-01 17:06:51 -07:00