1
0
mirror of synced 2026-01-25 19:02:00 -05:00
Commit Graph

23 Commits

Author SHA1 Message Date
Mickaël Andrieu
e38baf4997 Docs: highlight the requirement on MongoDB user access levels (#21462) 2023-01-17 07:34:02 +00:00
VitaliiMaltsev
84f02995ba MongoDb Source: Increase performance of discover (#17614)
* MongoDb Source: Increase performance of discover

* bump version

* fixed tests

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-07 14:18:29 +03:00
Akash Kulkarni
4b990d0797 🚨 Add ability to enforce SSL in MongoDB source connector (#17590)
* Check and test for if we are disabling SSL/TLS in source-mongodb-strict-encrypt

* Update docs

* Address comments

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-06 11:57:36 -07:00
VitaliiMaltsev
022b8db345 Destination: BigQuery (denormalized typed struct) - Could not evaluate union, field is expected to be one of these: NULL, STRING. (#16401)
* Fixed bucket naming for S3

* removed redundant configs

* BigQuery Denormalized: Could not evaluate union on Mongo formatted type

* add test

* fixed BigQuery tests

* updated changelog

* replaced star import

* bump version

* auto-bump connector version [ci skip]

* fixed compilation error

* bump mongodb-strict-encrypt

* auto-bump connector version [ci skip]

* removed unused method

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-13 19:10:09 +03:00
mkhokh-33
5776dcc949 Mkhokh/8858 cursor fields for incremental update (#14356)
* add logic to skip incremental mode for tables which do not have a field types that could not be used as cursor

* added tests for cursor fields incremental updates

* remove not used methods

* fix tests

* fix formatting

* revert RedshiftInsertDestinationAcceptanceTest

* fix ssl clickhouse test

* fix codereview comments

* fix clickhouse strict encrypt test

* fix postgres source after merge from master

* optimize ssl clickhouse test logic

* fix db2 test

* added check for cursor field should be not nullable, fix formatting

* fixed tests, formatting, issue after merge from master

* fix merge issues

* fix test for source-jdbc and remove some code used for local testing

* added description for cockroach db tests

* test changes

* refactoring for cursor field tests after code review comments

* refactoring for cursor field tests after code review comments

* fix code review comments

* remove unused imports

* fix formatting

* fix compilation error

* fix postgres and postgress ssl test

* Fixed bucket naming for S3

* remove CHAR, NCHAR from possible cursor types

* remove SYMBOL from possible cursor types

* removed redundant configs

* fixed mysql-strict-encrypt tests

* fixed mongodb-v2 tests

* minor format changes

* bump version

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

Co-authored-by: vmaltsev <ihbectop@gmail.com>
Co-authored-by: subodh <subodh1810@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-18 19:48:22 +03:00
Topher Lubaway
9c6c092a22 Revert "Improving docusaurus sidebar generation (#1927) (#14369)" (#14596)
This reverts commit a2c194a11f.
2022-07-11 15:27:14 -05:00
Mykyta Serbynevskiy
a2c194a11f Improving docusaurus sidebar generation (#1927) (#14369)
* Improving docusaurus sidebar generation (#1927)

* Added "Career & open positions" folder to sidebar, adjusted "Project overview" folder

* Deleted "career-and-open-positions" folder from sidebar
2022-07-08 14:18:27 -05:00
George Claireaux
c5783aa799 connectors that published (#13932) 2022-06-20 12:42:56 +01:00
Yurii Bidiuk
b3194b2200 🎉🐛: Source mongoDB: implement building JsonSchema with 'properties' for fields with type 'object' (#12428)
* mongodb: build JsonSchema with 'properties'

* add tests

* bump version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-05 12:56:07 +03:00
Nahid
fbad2b8c06 Source MongoDb: fix parsing of DBRef objects (#10276) 2022-02-22 18:51:46 -03:00
Lake Mossman
3d8a0dc048 Add ExitOnOutOfMemoryError to java connectors and bump versions (#10256) 2022-02-14 15:49:15 -08:00
VitaliiMaltsev
2b0d0bdef6 Source MongoDB fetch authorized collections only (#9238)
* fix for jdk 17

* Source MongoDB show authorized collections

* add javadoc

* fixed checkstyle

* add CHANGELOG

* fix checkstyle

* refactoring

* bump version anf fix checkstyle

Co-authored-by: vmaltsev <vitalii.maltsev@globallogic.com>
2022-01-13 15:41:34 +02:00
Iryna Grankova
b8c33bdfed Update fields in source-connectors specifications: mongodb-strict-encrypt, mongodb-v2 (#9202) 2021-12-30 17:30:26 +02:00
Joël Luijmes
ad55ab01d1 MongoDB limit 10k records during Discovery(#8491)
Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2021-12-07 16:27:40 -03:00
andriikorotkov
9e087c6f9c 🐛 Source MongoDB - Added Milliseconds to Cursor for mongo date type (#8306)
* Added milliseconds for date format for cursor

* Added milliseconds for date format for cursor

* Added milliseconds for date format for cursor

* updated documentation
2021-11-29 18:36:49 +02:00
andriikorotkov
6bf9ebacb2 🐛 Updated source-mondodb-v2 performance and updated cursor for timestamp type (#8161)
* updated source-mongodb-v2 performance

* updated code style

* fixed remarks

* fixed remarks

* fixed remarks

* updated strict encrypt source mongodb version

* updated source mongodb work with empty collections

* updated source mongodb timestamp cursor

* updated mongodb source perfomance

* fix code style

* fix code style

* updated tests and documentation

* updated tests and documentation

* updated tests and documentation

* added vudangngoc changes

* updated code style

* updated code style
2021-11-23 13:56:25 +02:00
andriikorotkov
46e1f65905 🐛 Source MongoDB - Added milliseconds to convert timestamp to datetime format (#8046)
* Added milliseconds to convert timestamp to datetime format

* updated docs

* updated docs
2021-11-18 14:30:15 +02:00
andriikorotkov
8e0e0b4f79 🐛 Updated source-mongodb-v2 performance (#7982)
* updated source-mongodb-v2 performance

* updated code style

* fixed remarks

* fixed remarks

* fixed remarks

* updated strict encrypt source mongodb version
2021-11-18 12:05:58 +02:00
irynakruk
dbfd6cae88 Source MongoDB v2: Fixed nested document parsing (#7160)
* Fixed nested document parsing: added parsing of nested documents and arrays, added data types test
2021-10-25 09:16:34 -04:00
irynakruk
22c3a9e043 🐛 MongoDb Source: Added filter to avoid MongoDb system collections (#6860)
* Added filter to avoid MongoDb system collections
2021-10-11 13:41:24 -04:00
Abhi Vaidyanatha
ae32ecbb27 GitBook: [master] 186 pages and 77 assets modified 2021-10-08 21:17:47 +00:00
irynakruk
5551698002 Source MongoDb: added support via TLS/SSL (#6364)
* updated ssl configs;
fixed replica connection;
fixed incremental read;

* added MongoDbSourceAtlasAcceptanceTest with ssl enabled

* updated docs, moved TLS option for standalone instance type, enabled it by default for other types

* Update mongodb-v2.md

* updated README.md

* updated spec.json

* Code review changes

* updated ci_credentials.sh
2021-09-24 09:22:54 -04:00
irynakruk
ffecc1c9a2 🎉 New source: MongoDb ported to java (#5530)
* New abstraction for NoSql database sources

* New MongoDbSource: partial impl

* Added MongoDataType

* Improved MongoDatabase and fixed read method

* code review changes;

* merge clean up;

* Renamed NoSqlDatabase to AbstractDatabase

* formatter changes;

* code review changes: changed mongodb-new to mongodb-v2; left only new connector info in all docs

* code review changes: changed mongodb-new to mongodb-v2; left only new connector info in all docs

* updated spec.json and toDatabaseConfig() method

* updated doc accordingly to spec.json changes

Co-authored-by: Iryna Kruk <iryna.o.kruk@globallogic.com>
2021-09-09 08:14:16 -04:00