1
0
mirror of synced 2025-12-21 11:01:41 -05:00
Commit Graph

281 Commits

Author SHA1 Message Date
LiRen Tu
6843bc1d1f 🎉 Source MySQL: support all MySQL 8.0 types (#7970)
* Add jdbc compatible layer

* Support routine mysql types

* Format code

* Fix build

* Refactor abstract jdbc source and operation classes

* Update mysql source operations

* Test discover command for mysql

* Remove abstract jdbc compatible source layer

* Format code

* Update template

* Fix more types

* Bump version

* Log original field type

* Update comments

* Bump version in seed
2021-12-11 21:49:32 -08:00
mkhokh-33
0eaaa1f6fc 🐛 Source-MySql: do not check cdc required param binlog_row_image for standard replication (#8335)
* Source-MySql: do not check cdc required param binlog_row_image for standard replication

* Source-MySql: fix formatting

* Revert "Source-MySql: fix formatting"

This reverts commit 5a94474a52.

* Source-MySql: made a code improvement

* Source-MySql: bump versions

* Source-MySql: fix version in source_specs.yaml

* Source-MySql: bump versions

* Source-MySql:update source_definitions.yaml with new version
2021-12-06 18:32:59 +02:00
oneshcheret
fcf7491fee 🐛 Validate incorrect handling '\n' symbols in ssh key (#8371)
* 🐛 Validate \n in ssh key

* bump versions for ssh key connectors

* update versions for ssh key connectors

* temporal fix for checking failed tests

* revert temp changes and destination oracle version

* bump versions in config for ssh key related connectors
2021-12-03 20:11:51 +02:00
mkhokh-33
5032addf3e 🐛 Source MySQL: transform binary data base64 format (#8047)
* Source-MySql: transform binary data base64 format, add integration tests

* Source-MySql: fix code style

* Source-MySql: bump versions

* Source-MySql: bump versions in source_specs.yaml

* Source-MySql: added test for stream with binary data for DestinationAbstractTest

* Source-MySql: added format
2021-11-23 16:04:48 +02:00
Eugene
3a0eaafb5e 🎉 Source Mysql - added basic MySql performance tests (#7820)
* [ticket 7489, PR 7820] Source Mysql - added skeleton for MySql performance tests
2021-11-15 12:16:36 +02:00
Alexander Tsukanov
7c3b7ef489 🐛 Source MySQL: Value '65535' is outside valid range for type (#7559)
* BUG-5842: Mysql Value '65535' is outside valid range for type java.lang.Short

* BUG-5842: Bumped versions of connector.

* BUG-5842: Fixed unit-test for mysql-encrypt

* Update docs/integrations/sources/mysql.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-11-04 12:18:44 +02:00
Andrii Leonets
a98b3fe414 MySql Source: Fix data processing (#6093)
* move logic from static JdbcUtils to JdbcSourceOperations

* format

* Add methods for all types in order to have possibility rewrite them and use common type mapping.

* Make BigQuery in line impl with JDBC changes

* fix binary type

* add database creations methods with sourceOperations input

* add MySqlSourceOperations

* fix processing

* Fix CDC processing

* format

* add some tests for double and float

* incr version

* #3931 #3932 added zero-date converting to null param "zeroDateTimeBehavior=convertToNull"

* remove old tests covered by data type tests + incr ver

* Update airbyte-integrations/connectors/destination-mysql/src/main/java/io/airbyte/integrations/destination/mysql/MySQLDestination.java

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Update docs/integrations/sources/mysql.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* add back comments to the data type mapping

* incr config version

Co-authored-by: Oleksandr Sheheda <alexandrshegeda@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-10-12 18:08:50 +03:00
Abhi Vaidyanatha
ae32ecbb27 GitBook: [master] 186 pages and 77 assets modified 2021-10-08 21:17:47 +00:00
Jenny Brown
2e5fbba434 Clarify ssh private key format for ssh tunnels (#6585)
* Clarify ssh private key format for ssh tunnels
* Improved SSH Tunnel key generation steps, fixed formatting
* Modified wording 'app' to 'connector' for consistency
* Ran format
2021-10-04 13:59:47 -05:00
Abhi Vaidyanatha
30a4b6b687 Fix inconsistent H4 Markdown headers. (#6701) 2021-10-04 00:23:38 -07:00
Abhi Vaidyanatha
34d3c5b79c Attempt to fix MD parsing on MySQL doc (#6695) 2021-10-03 23:38:29 -07:00
Abhi Vaidyanatha
8a8af6aacb 📚 Docs Refresh: MySQL Source (#6666)
* Docs Refresh: MySQL Destination

* Add note about TLS.

* Update docs/integrations/sources/mysql.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Update docs/integrations/sources/mysql.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* SSH Tunnel support.

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-10-03 22:57:08 -07:00
Eugene
7698a50c74 🎉Source MySQL - added option to connect using SSL (#6510)
* Source MySQL - added option to connect using SSL
2021-09-30 18:23:51 +03:00
Eugene
11f64882a9 🎉Source MySQl - Added support for connection via ssh (aka bastion server) (#6146)
* Source MySQL - Added ssh support
2021-09-21 10:57:31 +03:00
Marcos Marx
057bad4bb5 remove calendly link and correct mysql docs (#5375) 2021-08-12 15:22:57 -03:00
subhaklp
57902a84c7 Update MySQL source connector documentation (#5222)
Added an optional JDBC connector param that enables zero date time values to be transferred from MySQL to other data stores.
2021-08-05 14:35:10 -03:00
Jared Rhizor
fb902dcc2e fix mysql doc link / scaffold links (#4956) 2021-07-29 23:00:04 -07:00
Marcos Marx
d91ff7dcf1 Documentation add data types to databases (#5008)
* add postgres data types

* add mysql data types

* add mssql data types

* add oracle data type
2021-07-26 23:02:46 -03:00
Marcos Marx
88d7953a18 Add CHANGELOG for Sources (#4215)
* add changelog for postres source

* add changelog for mysql source

* add changelog for mssql source

* add changelog for file source

* add changelog for google sheets

* add full changelog for file source

* add full changelog for google sheet source

* add full changelog for mssql source

* add changelog for http requests

* add changelog for salesforce source

* add changelog for facebook marketing source

* add changelog for google analytics source

* add changelog for shopify native source connector
2021-06-18 17:45:09 -03:00
Subodh Kant Chaturvedi
7ccc4fafe8 🎉 source: implementation for mysql cdc (#3505)
* source: implementation for mysql cdc

* add target file and position

* dont want to add file in this PR

* refine tests + add comments

* fix typo

* address review comments

* fix formatting error

* resolve conflicts

* update docs + bump docker minor version

* remove un-necessary new lines + add multiple checks for cdc

* address review comments from Davin

* increase the version in source_definitions.yaml

* rebuild seed
2021-05-25 00:31:57 +05:30
Marcos Marx
7c70eb02cd GitBook: [master] 84 pages and 72 assets modified 2021-05-03 12:14:16 +00:00
Marcos Marx
237b99e774 correct typo in mysql source docs (#3143)
* correct mysql source docs

* change bigint order
2021-04-30 18:45:40 -03:00
Davin Chia
42686add8a Release connectors with namespace change. (#2990)
Release all connectors affected by namespace change. Includes all JDBC sources and destinations.

Also add documentation for normalisation. Prerequisite to actually releasing 0.21.0-alpha.
2021-04-21 11:35:08 +08:00
Marcos Marx
db119d043b correct some docs mysql oracle (#2826) 2021-04-09 08:12:19 -07:00
Shrif Nada
ff458bbd9d GitBook: [master] 111 pages modified 2021-01-26 04:14:55 +00:00
Jared Rhizor
4ab0464274 add postgres troubleshooting docs (#1653)
* add postgres troubleshooting docs

* update headings

* add to other db sources

* move connection troubleshooting to faq
2021-01-25 10:56:09 -08:00
John Lafleur
2acc3840d0 GitBook: [docs_feature_incremental] 33 pages modified (#1683)
Co-authored-by: John Lafleur <john@dataline.io>
2021-01-17 07:32:24 +11:00
John Lafleur
5532aa370a Updating Incremental within docs pages for all sources to make it more explicit (#1381)
* GitBook: [incremental_update_docs] 79 pages modified

* GitBook: [incremental_update_docs] one page modified

Co-authored-by: John Lafleur <john@dataline.io>
2020-12-18 21:03:34 +11:00
Charles
01cdeafdb1 release v0.8.0-alpha (#1339) 2020-12-16 14:01:57 -08:00
Michel Tricot
89f6ae6e36 Fix many broken links (#798) 2020-11-02 19:19:48 -08:00
Charles
395aeca640 mysql source (#758) 2020-10-30 15:37:49 -07:00