11 Commits

Author	SHA1	Message	Date
Johnny Schmidt	e9a37d45ac	S3 Dest emits V2 fields and captures failures (#42409)	2024-08-14 09:41:29 -07:00
Natik Gadzhi	cb80e6922a	[tools] prettier rules for .md + formatting cleanup	2024-05-07 08:19:33 -07:00
Przemysław Dąbek	e766d05f9d	Update references and point to existing locations (#30712) ... Co-authored-by: Sajarin <sajarindider@gmail.com>	2023-09-26 15:19:57 -04:00
Liren Tu	9356d6adf5	📝 Update json avro conversion doc about logical type union (#17010) ... * Update json avro doc to include logical type union * Add a note about the potential problem * Add issue link	2022-09-21 15:43:44 -07:00
Topher Lubaway	9c6c092a22	Revert "Improving docusaurus sidebar generation (#1927) (#14369)" (#14596) ... This reverts commit a2c194a11f.	2022-07-11 15:27:14 -05:00
Mykyta Serbynevskiy	a2c194a11f	Improving docusaurus sidebar generation (#1927) (#14369) ... * Improving docusaurus sidebar generation (#1927) * Added "Career & open positions" folder to sidebar, adjusted "Project overview" folder * Deleted "career-and-open-positions" folder from sidebar	2022-07-08 14:18:27 -05:00
LiRen Tu	5f6785dcbf	🐞 Destination S3 & GCS Avro: support array with unknown item type (#9367) ... * Support array field with empty items specification * Remove all exceptions * Format code * Bump connector versions * Bump bigquery versions * Update docs * Remove unused code * Update doc for PR #9363 * Update doc about defaulting all improperly typed fields to string * Ignore bigquery * Update version and doc * Update doc * Bump version in seed	2022-01-11 23:12:37 -08:00
LiRen Tu	22ef236ab8	Refactor and clean up json avro schema converter (#9363) ... * Default isRootNode to true and rename parameters * Default appendAirbyteFields to true * Rename methods and add javadoc * Simplify namespace generation and delete obtainPaths method * Simplify test case * Add namespace for objects in array * Merge object definitions in type union (need improvement) * Fix merging of record fields * Switch test case to minimize changes * Mark assembler and builder as final variables * Adjust test case * Remove unused code * Keep field doc * Update comment * Merge record schemas recursively * Add nested test case * Add docuementation * Add test case for issue #5564 * Format code	2022-01-09 10:56:54 -08:00
LiRen Tu	5e494a9ff8	📝 Update json to avro conversion doc (#8866) ... * Update json-avro doc * Add final * Fix minor issues	2021-12-17 02:08:41 -08:00
VitaliiMaltsev	67f7cf01f2	Bump GCS version with avro/parquet timestamp conversion (#8360) ... * get date-time format form json schema * created universal date-time converter * implemented jsonnode transformation for avro and parquet * removed unneeded dependency from build.gradle * fix checkstyle * add DateTimeUtilsTest * add AvroRecordHelperTest * resolve merge conflicts | fix checkstyle * update LocalTime parsing * added String type to avro schema for Logical Types, removed date-time conversion * fix checkstyle * fix checkstyle * added static String schema, added comments * bump version * Bump GCS version with avro/parquet timestamp conversion * update docs * update docs Co-authored-by: vmaltsev <vitalii.maltsev@globallogic.com>	2021-12-02 10:32:35 +02:00
LiRen Tu	c9c41dcd08	🎉 Destination S3 & GCS: support additional properties (#7288) ... * Log json schema * Use patched json avro converter * Rename schema * Update unit test cases * Fix ab ap field schema conversion * Rename files * Add unit test cases * Fix dependency for databricks * Bump versions * Update documentations * Update gcs doc * Set additional properties field name * Revert s3 and gcs version * Specify extra props fields * Refactor json avro conversion doc * Update connector doc * Fix databricks spec typo * Bump connector versions in seed	2021-11-03 11:37:24 -07:00