jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-20 18:39:31 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,480 Commits 5,109 Branches 518 Tags
yarden/source-mongodb-support-dynamic-arrays
Commit Graph

192 Commits

Author SHA1 Message Date
Yarden Carmeli
5c314d966b Update comments and changelog 2025-12-17 20:18:27 -04:00
Yarden Carmeli
3bb4dcfe4d Source-MongoDB: Wrap non-array values in array when schema expects array to prevent NULLS 2025-12-17 19:14:37 -04:00
Edward Gao
3991e28549 Destination Clickhouse: increase test timeout (#69717) 2025-11-19 15:17:28 -08:00
Aaron ("AJ") Steers
a7be6e6a0f chore: Sort externalDocumentationUrls by type then title (do not merge) (#69742) 
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2025-11-18 21:51:00 -08:00
Aaron ("AJ") Steers
d9b08c06d9 feat: Add API release history URLs to 44 certified connectors (#69741) 
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2025-11-18 20:20:34 -08:00
Aaron ("AJ") Steers
f589f89217 feat: Add external documentation URLs to Group H source connectors (source-microsoft-entra-id through source-oura) (#69735) 
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2025-11-18 18:09:21 -08:00
Yarden Carmeli
8e17db88ef Source-MongoDB: Add validation to ensure consistent state format (#65579) 2025-09-10 09:56:53 -07:00
devin-ai-integration[bot]
c2ca2e4084 fix(source-mongodb-v2): fix hardcoded read preferences (#64900) 
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: yue.li@airbyte.io <yue.li@airbyte.io>
 2025-08-12 13:04:29 -07:00
Yarden Carmeli
430c404049 update logic to allow use of read permission when using a single db (#62938) 
Co-authored-by: Rodi Reich Zilberman <867491+rodireich@users.noreply.github.com>
 2025-07-14 13:34:00 -07:00
Yue Li
3f51e5bc53 [source-mongodb-v2] Do not pin the version to 1.5.17 (#61369) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-06-04 15:50:01 -07:00
devin-ai-integration[bot]
dea6434121 feat(source-mongodb-v2): Add support for multiple databases (#60252) 
Co-authored-by: yue.li@airbyte.io <yue.li@airbyte.io>
Co-authored-by: Yue Li <61070669+theyueli@users.noreply.github.com>
 2025-06-03 14:07:35 -07:00
Davin Chia
af8ce3aa6d chore: migrate mongo, mssql and oracle to new gradle flow. (#60311) 2025-05-27 17:12:40 -04:00
Aaron ("AJ") Steers
05965c781e chore: add poe_tasks.toml for all java connectors (#59670) 2025-05-05 17:28:27 -07:00
Matt Bayley
30079e74d2 remediate bugged v1.5.18 (#59134) 2025-04-28 16:39:32 -07:00
Yue Li
ad7aa7af4b [cdk, source-postgres, source-mysql, source-mongodb-v2] Fixing vulnerabilities in dependencies (#58132) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-04-24 08:28:30 -07:00
Yue Li
fd8f2c930f [source-mongodb-v2] Implement timeout for document discovery (#58111) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-04-17 17:30:45 -07:00
Yarden Carmeli
5e9f513bc6 [source-mongodb-v2] Update logs (#56973) 2025-04-02 12:16:52 -07:00
devin-ai-integration[bot]
3cf3c3d2fa [source-mysql, mssql, postgres, mongodb-v2] chore: update base image version for certified DB source connectors (#55234) 
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: yue.li@airbyte.io <yue.li@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-03-06 12:15:07 -08:00
Augustin
6dc84f796b source-mongodb-v2: Use airbyte/java-connector-base:2.0.0 (#51491) 2025-01-13 08:04:20 -08:00
Augustin
21c8774892 source-mongodb-v2: Use airbyte/java-connector-base:1.0.0 (#49868) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2024-12-23 20:54:22 -08:00
Aaron ("AJ") Steers
83ecbe0fc3 CI: apply pre-commit format fix from #49806 (#49852) 2024-12-18 14:05:43 -08:00
Xiaohan Song
f9aca266e0 [source-mongodb] remove extra check on getDatabaseNames (#48115) 2024-11-01 21:47:08 +02:00
Xiaohan Song
657110b3c0 [source-mongodb] lazy init current iterator to prevent cursor timeout issue (#45883) 2024-09-24 13:00:52 -07:00
Yue Li
2e62443f1c [source-postgres/mysql/mssql/mongodb-v2] Use latest CDK to adopt latest apache sshd mina to handle tcpkeepalive requests (#45639) 2024-09-18 14:46:10 +03:00
Xiaohan Song
1b2c27e231 [source-mongodb] add subtype when converting binary (#42927) 2024-08-30 02:13:22 +03:00
Yue Li
af98a810b5 [certified db sources] adopt latest CDK to use error translation bug fixes (#44841) 2024-08-28 22:35:16 +03:00
Xiaohan Song
6cbba8d19a [source-mongodb] use escaped dot in wass streamlist (#44846) 2024-08-28 07:46:03 -07:00
Xiaohan Song
ff907f0ae5 [source-mongodb] include list does not have escaped dot (#44839) 2024-08-28 02:27:19 +03:00
Yue Li
c68ec5ab2f [source-mongo-v2] revert permission check on oplog.rs for mongo source (#44779) 2024-08-26 11:44:11 -07:00
Yue Li
f565c0426c [source-mongodb-v2] Adding permission check on oplog.rs needed by CDC (#44490) 
The user will not be able to set up the connector if his/her airbyte user does not have read access to the oplog.rs collection.
 2024-08-20 18:19:44 -07:00
Augustin
601c3c455c Rename registries to registryOverrides in connector metadata (#43757) 2024-08-13 16:10:56 +02:00
Akash Kulkarni
b43b1111a8 [cdk] : More logging for count mismatch (#43410) 2024-08-09 05:45:27 +03:00
Xiaohan Song
97d822f820 [cdk, source-mysql/postgres/mssql/mongodb-v2] log record count to state message (#42869) 
Co-authored-by: Yue Li <yue.li@airbyte.io>
Co-authored-by: Yue Li <61070669+theyueli@users.noreply.github.com>
 2024-08-07 04:35:22 +03:00
nora-airbyte
889cb65e21 Center MongoDb connector icon (#42549) 
Co-authored-by: Yue Li <61070669+theyueli@users.noreply.github.com>
 2024-08-05 11:24:49 -07:00
Yue Li
8f42de9c37 [source-mongodb-v2] : Implement WASS algorithm (#42561) 
Fixes airbytehq/airbyte-internal-issues#8730

Port of #38240 for MongoDB
 2024-08-05 06:36:23 -07:00
Evan Tahler
d2ae38209f source-mongo: Warn (vs fail) on different _id types in collection (#39145) 2024-07-22 16:34:11 -07:00
Akash Kulkarni
3a3e058ae8 [DB-sources] : Improve heartbeat logic (#40516) 2024-07-01 12:51:33 -07:00
Akash Kulkarni
94234e57c6 [Source-mongodb-v2] : Adopt new CDK (#39530) 2024-06-17 13:57:57 -07:00
Xiaohan Song
3c9a6121c4 Upgrade mongodb to use dbz 2.6.2 (#38238) 2024-06-11 13:25:24 -04:00
Rodi Reich Zilberman
c1748b4efe MongoDB stream status traces (#38781) 2024-05-30 19:44:07 -04:00
Xiaohan Song
2d194fa359 Set isResumeable flag in catalog (#38584) 
Co-authored-by: Dhroov Makwana <pabloescoder@gmail.com>
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
Co-authored-by: btkcodedev <btk.codedev@gmail.com>
Co-authored-by: Gireesh Sreepathi <gisripa@gmail.com>
Co-authored-by: Yue Li <61070669+theyueli@users.noreply.github.com>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Natik Gadzhi <natik@respawn.io>
Co-authored-by: Danylo Jablonski <150933663+DanyloGL@users.noreply.github.com>
Co-authored-by: Maxime Carbonneau-Leclerc <3360483+maxi297@users.noreply.github.com>
Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
Co-authored-by: Ben Church <ben@airbyte.io>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
Co-authored-by: Christo Grabowski <108154848+ChristoGrab@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: Catherine Noll <clnoll@users.noreply.github.com>
Co-authored-by: Audrey Maldonado <audrey.maldonado@gmail.com>
Co-authored-by: Rodi Reich Zilberman <867491+rodireich@users.noreply.github.com>
Co-authored-by: Serhii Lazebnyi <serhii.lazebnyi@globallogic.com>
Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
 2024-05-30 10:23:09 -07:00
Augustin
31c95da499 [skip ci] Add connectorTestSuitesOptions to metadata (#38188) 2024-05-15 15:04:10 -05:00
Rodi Reich Zilberman
82961ad9f9 Add support for binary _id field in source-mongodb (#38103) 2024-05-10 10:46:42 -07:00
Natik Gadzhi
cb80e6922a [tools] prettier rules for .md + formatting cleanup 2024-05-07 08:19:33 -07:00
Akash Kulkarni
ddc3d2b527 [Source-mongo] : Add options for CAPTURE_MODE (#36851) 2024-05-06 19:06:27 -04:00
Akash Kulkarni
48930e499a [Source-mongo] : Chunk size(limit) should correspond to ~1GB of data (#37753) 2024-05-02 15:04:53 -07:00
Rodi Reich Zilberman
bdb3556b8a bump connectors to latest CDK version (#37781) 2024-05-02 16:52:11 -04:00
Akash Kulkarni
914f044354 [Certified sources] : Bump cdk versions to disable DBZ retries (#37742) 2024-05-01 15:07:37 -04:00
Akash Kulkarni
993aece63d [Source-mongo] : Implement fixed chunk size (1million) (#37559) 2024-04-25 14:37:24 -07:00
Akash Kulkarni
8eb634c17f [Source-mongodb-v2] : Fix logic in determining whether a resume token is valid or not (#37557) 2024-04-24 15:54:20 -07:00