jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-20 10:32:35 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,480 Commits 5,109 Branches 518 Tags
yarden/source-mongodb-support-dynamic-arrays
Commit Graph

115 Commits

Author SHA1 Message Date
Yarden Carmeli
5c314d966b Update comments and changelog 2025-12-17 20:18:27 -04:00
Yarden Carmeli
8e17db88ef Source-MongoDB: Add validation to ensure consistent state format (#65579) 2025-09-10 09:56:53 -07:00
Yarden Carmeli
d33efb182e Souce MongoDB: Fix changelog table formatting (#65077) 2025-08-18 15:01:14 -07:00
devin-ai-integration[bot]
c2ca2e4084 fix(source-mongodb-v2): fix hardcoded read preferences (#64900) 
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: yue.li@airbyte.io <yue.li@airbyte.io>
 2025-08-12 13:04:29 -07:00
Yarden Carmeli
430c404049 update logic to allow use of read permission when using a single db (#62938) 
Co-authored-by: Rodi Reich Zilberman <867491+rodireich@users.noreply.github.com>
 2025-07-14 13:34:00 -07:00
Yarden Carmeli
7e6c8e69ba Add readAnyDatabase Requirement to MongoDB Docs (related to v2.0.0) (#62062) 2025-06-30 11:52:20 -07:00
Yue Li
3f51e5bc53 [source-mongodb-v2] Do not pin the version to 1.5.17 (#61369) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-06-04 15:50:01 -07:00
devin-ai-integration[bot]
dea6434121 feat(source-mongodb-v2): Add support for multiple databases (#60252) 
Co-authored-by: yue.li@airbyte.io <yue.li@airbyte.io>
Co-authored-by: Yue Li <61070669+theyueli@users.noreply.github.com>
 2025-06-03 14:07:35 -07:00
Davin Chia
af8ce3aa6d chore: migrate mongo, mssql and oracle to new gradle flow. (#60311) 2025-05-27 17:12:40 -04:00
Yue Li
ad7aa7af4b [cdk, source-postgres, source-mysql, source-mongodb-v2] Fixing vulnerabilities in dependencies (#58132) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-04-24 08:28:30 -07:00
Ian Alton
01cd16654e 11059 multi-instance, versioned docs (#58095) 
Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2025-04-24 02:58:09 +03:00
Yue Li
fd8f2c930f [source-mongodb-v2] Implement timeout for document discovery (#58111) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-04-17 17:30:45 -07:00
Yarden Carmeli
5e9f513bc6 [source-mongodb-v2] Update logs (#56973) 2025-04-02 12:16:52 -07:00
devin-ai-integration[bot]
3cf3c3d2fa [source-mysql, mssql, postgres, mongodb-v2] chore: update base image version for certified DB source connectors (#55234) 
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: yue.li@airbyte.io <yue.li@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-03-06 12:15:07 -08:00
Augustin
6dc84f796b source-mongodb-v2: Use airbyte/java-connector-base:2.0.0 (#51491) 2025-01-13 08:04:20 -08:00
Augustin
21c8774892 source-mongodb-v2: Use airbyte/java-connector-base:1.0.0 (#49868) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2024-12-23 20:54:22 -08:00
Xiaohan Song
f9aca266e0 [source-mongodb] remove extra check on getDatabaseNames (#48115) 2024-11-01 21:47:08 +02:00
Xiaohan Song
657110b3c0 [source-mongodb] lazy init current iterator to prevent cursor timeout issue (#45883) 2024-09-24 13:00:52 -07:00
Yue Li
2e62443f1c [source-postgres/mysql/mssql/mongodb-v2] Use latest CDK to adopt latest apache sshd mina to handle tcpkeepalive requests (#45639) 2024-09-18 14:46:10 +03:00
Xiaohan Song
1b2c27e231 [source-mongodb] add subtype when converting binary (#42927) 2024-08-30 02:13:22 +03:00
Yue Li
af98a810b5 [certified db sources] adopt latest CDK to use error translation bug fixes (#44841) 2024-08-28 22:35:16 +03:00
Xiaohan Song
6cbba8d19a [source-mongodb] use escaped dot in wass streamlist (#44846) 2024-08-28 07:46:03 -07:00
Xiaohan Song
ff907f0ae5 [source-mongodb] include list does not have escaped dot (#44839) 2024-08-28 02:27:19 +03:00
Yue Li
c68ec5ab2f [source-mongo-v2] revert permission check on oplog.rs for mongo source (#44779) 2024-08-26 11:44:11 -07:00
Yue Li
f565c0426c [source-mongodb-v2] Adding permission check on oplog.rs needed by CDC (#44490) 
The user will not be able to set up the connector if his/her airbyte user does not have read access to the oplog.rs collection.
 2024-08-20 18:19:44 -07:00
Akash Kulkarni
b43b1111a8 [cdk] : More logging for count mismatch (#43410) 2024-08-09 05:45:27 +03:00
Xiaohan Song
97d822f820 [cdk, source-mysql/postgres/mssql/mongodb-v2] log record count to state message (#42869) 
Co-authored-by: Yue Li <yue.li@airbyte.io>
Co-authored-by: Yue Li <61070669+theyueli@users.noreply.github.com>
 2024-08-07 04:35:22 +03:00
nora-airbyte
889cb65e21 Center MongoDb connector icon (#42549) 
Co-authored-by: Yue Li <61070669+theyueli@users.noreply.github.com>
 2024-08-05 11:24:49 -07:00
Yue Li
8f42de9c37 [source-mongodb-v2] : Implement WASS algorithm (#42561) 
Fixes airbytehq/airbyte-internal-issues#8730

Port of #38240 for MongoDB
 2024-08-05 06:36:23 -07:00
Evan Tahler
d2ae38209f source-mongo: Warn (vs fail) on different _id types in collection (#39145) 2024-07-22 16:34:11 -07:00
Akash Kulkarni
3a3e058ae8 [DB-sources] : Improve heartbeat logic (#40516) 2024-07-01 12:51:33 -07:00
Akash Kulkarni
94234e57c6 [Source-mongodb-v2] : Adopt new CDK (#39530) 2024-06-17 13:57:57 -07:00
Xiaohan Song
3c9a6121c4 Upgrade mongodb to use dbz 2.6.2 (#38238) 2024-06-11 13:25:24 -04:00
Audrey Maldonado
b9690ba76e Wrapping changelog in details for a collapsible view (#38801) 2024-06-04 13:40:53 -04:00
Rodi Reich Zilberman
c1748b4efe MongoDB stream status traces (#38781) 2024-05-30 19:44:07 -04:00
Xiaohan Song
2d194fa359 Set isResumeable flag in catalog (#38584) 
Co-authored-by: Dhroov Makwana <pabloescoder@gmail.com>
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
Co-authored-by: btkcodedev <btk.codedev@gmail.com>
Co-authored-by: Gireesh Sreepathi <gisripa@gmail.com>
Co-authored-by: Yue Li <61070669+theyueli@users.noreply.github.com>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Natik Gadzhi <natik@respawn.io>
Co-authored-by: Danylo Jablonski <150933663+DanyloGL@users.noreply.github.com>
Co-authored-by: Maxime Carbonneau-Leclerc <3360483+maxi297@users.noreply.github.com>
Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
Co-authored-by: Ben Church <ben@airbyte.io>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
Co-authored-by: Christo Grabowski <108154848+ChristoGrab@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: Catherine Noll <clnoll@users.noreply.github.com>
Co-authored-by: Audrey Maldonado <audrey.maldonado@gmail.com>
Co-authored-by: Rodi Reich Zilberman <867491+rodireich@users.noreply.github.com>
Co-authored-by: Serhii Lazebnyi <serhii.lazebnyi@globallogic.com>
Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
 2024-05-30 10:23:09 -07:00
Evan Tahler
a914027d74 [docs] Vendor-Specific limitations added to troubleshooting sections (#38351) 
Co-authored-by: Stephane Geneix <147216312+stephane-airbyte@users.noreply.github.com>
 2024-05-21 14:42:22 +00:00
Rodi Reich Zilberman
82961ad9f9 Add support for binary _id field in source-mongodb (#38103) 2024-05-10 10:46:42 -07:00
Natik Gadzhi
cb80e6922a [tools] prettier rules for .md + formatting cleanup 2024-05-07 08:19:33 -07:00
Akash Kulkarni
ddc3d2b527 [Source-mongo] : Add options for CAPTURE_MODE (#36851) 2024-05-06 19:06:27 -04:00
Akash Kulkarni
48930e499a [Source-mongo] : Chunk size(limit) should correspond to ~1GB of data (#37753) 2024-05-02 15:04:53 -07:00
Rodi Reich Zilberman
bdb3556b8a bump connectors to latest CDK version (#37781) 2024-05-02 16:52:11 -04:00
Akash Kulkarni
914f044354 [Certified sources] : Bump cdk versions to disable DBZ retries (#37742) 2024-05-01 15:07:37 -04:00
Akash Kulkarni
993aece63d [Source-mongo] : Implement fixed chunk size (1million) (#37559) 2024-04-25 14:37:24 -07:00
Akash Kulkarni
8eb634c17f [Source-mongodb-v2] : Fix logic in determining whether a resume token is valid or not (#37557) 2024-04-24 15:54:20 -07:00
Akash Kulkarni
d9ee103f10 [Source-mongo] : Adding a new iterator in preparation of adding chunking subqueries (#37525) 2024-04-24 10:26:31 -07:00
Xiaohan Song
28369403c9 [source-MongoDB] Do not send estimate trace message if we don't have data (#37473) 2024-04-22 11:03:19 -07:00
Akash Kulkarni
70afb9d2c7 [Source-mongodb] : Populate null values in airbyte record message (#37348) 2024-04-16 13:41:21 -07:00
Rodi Reich Zilberman
27e851c5ca Add maxSecondsBetweenMessages to metadata yaml (#36872) 2024-04-05 19:57:44 -07:00
Akash Kulkarni
4a020a4078 [Source-mongo] : Migrate to Kotlin (#36845) 2024-04-04 20:29:23 -04:00