1
0
mirror of synced 2025-12-21 19:11:14 -05:00
Commit Graph

44 Commits

Author SHA1 Message Date
olehmykhalchenko
a3bbfd0935 [destination-mysql]Use MySQL/MariaDB compatible timestamp format (#63736)
MariaDB/MySQL Timestamp Compatibility Fix for #62874.

Changed the timestamp formatter to use DateTimeFormatter.ofPattern("yyyy-MM-dd HH:mm:ss.SSSSSS"), which outputs timestamps in the format required by both MariaDB and MySQL (YYYY-MM-DD HH:MM:SS.SSSSSS), without a T separator or timezone offset.
Updated the formatTimestampLiteral method to always format timestamps in UTC using .atZone(ZoneOffset.UTC), ensuring consistent and database-compatible values including timezone correction
Removed any use of ISO 8601 formatting and offset information, as MariaDB does not support timestamp literals with timezone offsets or the T separator.
These changes ensure that all generated timestamp literals are accepted by both MySQL and MariaDB, and that time values are stored in UTC for consistency.


Co-authored-by: Davin Chia <davinchia@gmail.com>
2025-08-04 16:39:26 -07:00
urban-z
2fa977e071 [destination-mysql] change casting function to make compatible with mariadb (#50861)
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Davin Chia <davinchia@gmail.com>
2025-03-25 19:59:28 -03:00
devin-ai-integration[bot]
ceaf322225 chore(destination): Upgrade all Java destination connectors to use java-connector-base:2.0.1 (#56355)
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: davin@airbyte.io <davin@airbyte.io>
Co-authored-by: Davin Chia <davinchia@gmail.com>
2025-03-24 18:59:36 -04:00
Augustin
3ee4cbe0e5 destination-mysql-strict-encrypt: Use airbyte/java-connector-base:2.0.0 (#51512) 2025-01-13 17:36:40 +02:00
Augustin
a138883dc0 destination-mysql-strict-encrypt: Use airbyte/java-connector-base:1.0.0 (#49869)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2024-12-19 10:26:49 +02:00
Stephane Geneix
42687194ac destination-mysql: convert all tests to kotlin (#40556)
## What
<!--
* Describe what the change is solving. Link all GitHub issues related to this change.
-->

## How
<!--
* Describe how code changes achieve the solution.
-->

## Review guide
<!--
1. `x.py`
2. `y.py`
-->

## User Impact
<!--
* What is the end result perceived by the user?
* If there are negative side effects, please list them. 
-->

## Can this PR be safely reverted and rolled back?
<!--
* If unsure, leave it blank.
-->
- [ ] YES 💚
- [ ] NO 
2024-06-27 14:08:45 -07:00
Stephane Geneix
4b176395b9 destination-mysql: convert prod code to kotlin (#40553)
## What
<!--
* Describe what the change is solving. Link all GitHub issues related to this change.
-->

## How
<!--
* Describe how code changes achieve the solution.
-->

## Review guide
<!--
1. `x.py`
2. `y.py`
-->

## User Impact
<!--
* What is the end result perceived by the user?
* If there are negative side effects, please list them. 
-->

## Can this PR be safely reverted and rolled back?
<!--
* If unsure, leave it blank.
-->
- [ ] YES 💚
- [ ] NO 
2024-06-27 13:45:04 -07:00
Edward Gao
10f89e17dd Destination mysql: catch access error as config error (#40513) 2024-06-25 19:33:29 -04:00
Audrey Maldonado
b9690ba76e Wrapping changelog in details for a collapsible view (#38801) 2024-06-04 13:40:53 -04:00
Edward Gao
e8e85eb778 Destination Mysql: DV2 (#36936) 2024-05-03 16:44:46 -04:00
Edward Gao
faad484e08 Destination mysql: upgrade to latest cdk (#36926) 2024-04-12 14:41:58 -04:00
Edward Gao
f8d3e27fc9 Destination mysql: fix tests + upgrade to latest CDK (#33468)
Signed-off-by: Gireesh Sreepathi <gisripa@gmail.com>
Co-authored-by: Gireesh Sreepathi <gisripa@gmail.com>
2023-12-18 19:36:32 -04:00
Tim Roes
c5db1e947b 📚 Documentation November 2023 overhaul (#32811)
Co-authored-by: Natalie Kwong <38087517+nataliekwong@users.noreply.github.com>
Co-authored-by: timroes <timroes@users.noreply.github.com>
Co-authored-by: nataliekwong <nataliekwong@users.noreply.github.com>
2023-11-26 11:57:38 -08:00
Evan Tahler
62027b5b11 No deduping for mysql-destination (#31781) 2023-10-24 10:46:17 -05:00
Evan Tahler
9210547af5 [Docs] No Deduped + Hostory, Append + Deduped is the future! (#29114)
* [Docs] No `Deduped + Hostory`, `Append + Deduped` is the future!

* fix links
2023-08-08 15:07:49 -07:00
Evan Tahler
f455c1288d Java DB Destination connector licenses to Elv2 (#27781)
* Java DB Destination connector licenses to Elv2

* PR id for docs

* fix redshift tagging
2023-06-29 12:26:24 -05:00
Amruta Ranade
a6af9611a6 added SSL Tunnel method rec (#16782) 2022-09-15 17:36:32 -04:00
Yurii Bidiuk
10e4aae891 Use LOG4J2 to wrap connectors logs to JSON format (#15668)
* Use LOG4J2 to wrap connectors logs to JSON format

* log connector's stack trace directly as a message

* add stack_trace field to json template

* bump versions

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* revert versions for destinations: postgres, mssql, mysql

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-14 23:27:13 +03:00
Nataly Merezhuk
e1f44a13c0 Corrects MySQL destination documantion: deduped history is not supported. (#14854)
Co-authored-by: Amruta Ranade <11484018+Amruta-Ranade@users.noreply.github.com>
2022-08-22 11:36:35 -04:00
Greg Solovyev
d3d60c1067 Align strict encrypt and regular connector versions for destination-mysql (#15258)
* Align strict endrypt and regular connector versions

* Retain changelog for strict encrypt
2022-08-03 13:47:35 -07:00
Topher Lubaway
9c6c092a22 Revert "Improving docusaurus sidebar generation (#1927) (#14369)" (#14596)
This reverts commit a2c194a11f.
2022-07-11 15:27:14 -05:00
Mykyta Serbynevskiy
a2c194a11f Improving docusaurus sidebar generation (#1927) (#14369)
* Improving docusaurus sidebar generation (#1927)

* Added "Career & open positions" folder to sidebar, adjusted "Project overview" folder

* Deleted "career-and-open-positions" folder from sidebar
2022-07-08 14:18:27 -05:00
George Claireaux
e7dae06168 Enhance /publish to allow for multiple connectors and parallel execution (#13864)
* start

* revert

* azblob

* bq

* bq denorm

* megapublish baaaabyyyy

* fix needs

* matrix connectors

* auto-bump connector version

* dont failfast and max parallel 5

* multi runno

* minor

* testing matrix agents

* name

* testing multi agents

* tmp fix

* new multi agents

* multi test

* tryy

* let's do this

* magico

* fix

* label test

* couple more connector bumps

* temp

* things

* check this

* lets gooo

* more connectors

* Delete TEMP-testing-command.yml

* auto-bump connector version

* added comment describing bash part

* running single thread

* catch sentry cli

* auto-bump connector version

* destinations

* + snowflake

* saved

* auto-bump connector version

* auto-bump connector version

* java source bumps

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* remove twice-defined methods

* label things

* revert action

* using the new test action

* point at action

* wrong tag on action

* update pool label

* update to use new ec2-github-runner fork

* this needs to be more generic than publisher

* change publish to run on pool

* add comment about runner-pool usage

* updated publish command docs for multi & parallel connector runs

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* unbump failed publish versions

* missed dockerfiles

* remove failed docs

* mssql fix

* overhauled the git comment output

* bumping a test connector that should work

* slight order switcheroo

* output connectors properly in first message

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-21 18:40:33 +01:00
Oleksandr Sheheda
44a43f0338 Improve check connection performance for all JDBC-related DBs (#12820)
* removed redundant read permission check for destination

* bump docker image versions, update definitions and changelog

* bump docker image versions, update definitions and changelog

* update changelog

* fix for MSSQL and Oracle tests

* fix for MSSQL strict encrypt

* fixed conflicts

* revert versions that were not published
2022-05-24 16:06:01 +03:00
Marcos Marx
c72012012f Docs: add troubleshooting for mysql (#11012)
* add troubleshooting for mysql

* correct abhi comments
2022-03-10 15:14:34 -03:00
girarda
5d8cb41150 Refactor to enable support for optional JDBC parameters for all JDBC destinations (#10421)
* refactoring to allow testing

* MySQLDestination uses connection property map instead of url arguments

* Update jdbc destinations

* A little more generic

* reset to master

* reset to master

* move to jdbcutils

* Align when multiline

* Align when multiline

* Update postgres to use property map

* Move tests to AbstractJdbcDestinationTest

* clean

* Align when multiline

* return property map

* Add postgres tests

* update clickhouse

* reformat

* reset

* reformat

* fix test

* reformat

* fix bug

* Add mssql tests

* refactor test

* fix oracle destination test

* oracle tests

* fix redshift acceptance test

* Pass string

* Revert "Pass string"

This reverts commit 697821738c.

* Double deserialization

* Revert "Double deserialization"

This reverts commit ee8d75245b.

* try updating json_operations

* Revert "try updating json_operations"

This reverts commit c8022c2994.

* json parse

* Revert "json parse"

This reverts commit 11a6725eaa.

* Revert "Revert "Double deserialization""

This reverts commit 213f47acc4.

* Revert "Revert "Revert "Double deserialization"""

This reverts commit 66822454af.

* move to constant

* Add comment

* map can be constant

* Add comment

* move map

* hide in method

* no need to create new map

* no need to create new map

* no need to create new map

* enably mysql test

* Update changelogs

* Update changelog

* update changelog

* Bump versions

* bump version

* disable dbt support

* update spec

* update other oracle tests

* update doc

* bump seed

* fix source test

* update seed spec file

* fix expected spec
2022-02-28 09:25:04 -08:00
girarda
3db3e88187 🎉 Destination MySQL: Add jdbc_url_params support for optional JDBC parameters (#10362)
* pass through jdbc params

* fail if contains verifyServerCertificate

* do the same for all ssl params

* delete dead file

* slight refactor

* new method

* remove default value

* error message

* rename

* update as per comments

* Update exception message

* Bump version

* extract to method

* Update doc

* Revert "Update doc"

This reverts commit 097906fe64.

* Update doc

* delete dead code

* update doc

* Throw exception with better error message

* Add missing test

* Use MoreMaps::merge

* Add missing tests

* camel case

* Allow colliding parameters if values are equal

* Remove trailing &

* Throw IllegalArgumentException

* extract to constants

* Bump version in seed

* Update destination specs
2022-02-17 10:58:50 -08:00
Lake Mossman
3d8a0dc048 Add ExitOnOutOfMemoryError to java connectors and bump versions (#10256) 2022-02-14 15:49:15 -08:00
oneshcheret
fcf7491fee 🐛 Validate incorrect handling '\n' symbols in ssh key (#8371)
* 🐛 Validate \n in ssh key

* bump versions for ssh key connectors

* update versions for ssh key connectors

* temporal fix for checking failed tests

* revert temp changes and destination oracle version

* bump versions in config for ssh key related connectors
2021-12-03 20:11:51 +02:00
Sherif A. Nada
efb5151011 🐛 Make all JDBC destinations (SF, RS, PG, MySQL, MSSQL, Oracle) handle wide rows by using byte-based record buffering (#7719) 2021-11-08 19:26:32 -08:00
Eugene
05e09aff7d 🎉Destination MySQl - added ssl strict encrypt connector (#6763)
* [6423] Destination MySQl - added ssl strict encrypt connector
2021-10-14 08:28:43 +03:00
Abhi Vaidyanatha
ae32ecbb27 GitBook: [master] 186 pages and 77 assets modified 2021-10-08 21:17:47 +00:00
Abhi Vaidyanatha
acff636e4b Fix list formatting in SSH tunnel sections (#6847) 2021-10-06 15:49:31 -07:00
Abhi Vaidyanatha
0f0bb85a1f 📚 Docs Refresh: MySQL Destination (#6676)
* Docs Refresh: MySQL Destination

* Add SSH Tunnel.
2021-10-03 23:07:20 -07:00
andriikorotkov
bbf098a753 🎉 Destination MySQl - Added support for MySQL destination via TLS/SSL (#6506)
* add support SSL for MySQL destination

* updated ssl tests and add documentation

* updated code style

* changed default ssl value as true
2021-09-29 15:23:54 +03:00
andriikorotkov
8fa15713c3 🎉 Destination MySQl - Added support for connection via ssh (aka bastion server) (#6317)
* updated mysql tests

* updated mysql tests

* added mysql ssh tunnel tests by key

* fixed remarks

* fixed remarks

* updated DatabricksStreamCopier

* switch to custom file for ssh config in normalization

* updated MySQL SSH tests

* bump version

* get local port properly

* updated assertSameValue for MySQL ssh tunnel

* updated image version and documentation

* updated code style

* updated CI credentials

* updated normalization documentation

Co-authored-by: George Claireaux <george@claireaux.co.uk>
2021-09-28 13:11:32 +03:00
Abhi Vaidyanatha
d732eaf80e Add information on which destinations support Incremental - Deduped History in their docs (#6031)
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-09-16 16:40:12 -07:00
Sherif A. Nada
57d948b6a9 Update MySQL destination docs to indicate required versions with/without normalization 2021-08-26 22:14:44 -07:00
Marcos Marx
21e6d49d3a Enable additionalProperties in spec.json for destinations (#5125)
* bigquery

* bigquery denormalized

* kafka destination

* meilisearch

* mssql

* mysql

* oracle

* postgres

* snowflake

* add normalization in snowflake gradle

* remove unused import
2021-08-01 18:28:36 -03:00
Christophe Duong
76c1f3465c Add sanitized column name in some destinations' raw table outputs (#5026)
* Add sanitized column name in some destinations' raw table outputs
2021-07-28 14:38:08 +02:00
Davin Chia
830fac6b64 Turn on MYSQL normalization flag. (#4651)
* Turn on normalization flag. Bump versions
2021-07-09 19:43:45 +02:00
LiRen Tu
3d3988b1e3 Destination MySQL: bump version (#4531)
* Bump mysql destination version to pick up normalization

* Also change the publish command to run on ec2-runners to try and avoid build errors with gradle unable to find the right volume.

Co-authored-by: Davin Chia <davinchia@gmail.com>
2021-07-04 21:54:01 +08:00
Marcos Marx
a18b0e80d0 GitBook: [master] 161 pages and 75 assets modified 2021-05-16 22:51:02 +00:00
Subodh Kant Chaturvedi
a2ec9ee1e5 mysql destination docs (#3275)
* setup doc for mysql destination

* update the documentation in right places
2021-05-07 13:38:07 +05:30