1
0
mirror of synced 2026-01-09 06:03:17 -05:00
Commit Graph

349 Commits

Author SHA1 Message Date
vivienmorlet
dab4cfc1b5 🐛 Source Google Ads: add 'asset' Resource to full refresh custom tables (#25624)
* add 'asset' Resource tu full refresh custom tables

* update google-ads.md

* remove diff hunk marker

* update version in metadata.yaml

---------

Co-authored-by: Sunny Hashmi <6833405+sh4sh@users.noreply.github.com>
2023-05-30 13:16:15 -04:00
Evan Tahler
cf590d7690 Update connectors.md 2023-05-10 09:57:18 -07:00
Ben Church
0ea1a8143d Remove connectors.md and builds.md (#25597)
* Remove builds.md references

* Remove connectors.md

* Update connectors.md to reference the new report

* Add connector report to readme
2023-04-27 22:08:37 +00:00
Prasanna Kumar
e2b46dd6af Source GitLab: Accept api_url with or without scheme (#21373)
* feat: source-gitlab accept api_url w/ or w/o scheme

* 🪟🔧 Refactor ConnectorsView (#21531)

* WIP

* WIP

* wip

* more fixes

* fix test

* remove some more styled components and improve memoization

* review comment

* feat: source-gitlab accept api_url w/ or w/o scheme

* Revert allowedHosts missing value checks (#21923)

* bump versions

* update expected records

* auto-bump connector version

---------

Co-authored-by: Joe Reuter <joe@airbyte.io>
Co-authored-by: Evan Tahler <evan@airbyte.io>
Co-authored-by: Mal Hancock <mallory@archangelic.space>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-27 13:30:58 -07:00
Shishir Rajmohan Verma
3b3ca60cf5 🎉 Source Amazon Seller Partner: add FBA Reimbursement Report stream (#23605)
* add reimbursements stream

* bump up version to 0.2.33 and update changelog

* add reimbursements stream

* bump up version to 0.2.33 and update changelog

* bump up version and update changelog

* correcting version - incrementing minor version as it adds a new stream to the connector

* set additionalProperties to true in the schema

* updated expected_records.txt

* auto-bump connector version

---------

Co-authored-by: Sajarin <sajarindider@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-27 15:04:51 -04:00
Subodh Kant Chaturvedi
94ed6554ea upgrade debezium version to 2.2.0.Final (#25401)
* upgrade debezium version to 2.2.0.Final

* bump version + changelog

* auto-bump connector version

* manual bump version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-27 22:12:20 +05:30
Leo Schick
f4d2c642fa 🐛 Source SurveyMonkey: fix add missing params to stream survey_responses (#25109)
* add missing params to stream survey_responses

* fix unit test test_surveys_responses_request_params

* use next_page_token when given in survey_responses stream

* fix integration tests

* fix build

* update expected records

* update expected records complete

* fix expected records

* bump connector version and update docs

* Update source_definitions.yaml

* auto-bump connector version

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-27 13:27:22 -03:00
Jeff Cowan (Airbyte)
79db9f8e68 Clean up destination bases (#25346)
Changes in this refactor PR
* Use the proper interface name for the OnStartFunction
* Use the proper interface name for the OnCloseFunction
* Create and use a proper interface name for the FlushBufferFunction
* Create and use a proper interface name for the BufferCreateFunction
* Mostly naming consistency changes. These are things caught in static, compile time checks so should be low risk.

---------

Co-authored-by: jcowanpdx <jcowanpdx@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-27 08:47:02 -07:00
Jonathan Pearlin
8a01d05dcc Publish source-facebook-marketing with stream status messages (#25559)
* Prepare to publish source-facebook-marketing

* Bump required CDK version

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-27 10:33:00 -05:00
Marcos Marx
87c07f32f4 Source Posthog: increase batch size (#25603)
* increase events api limit to 10000

* add docs

* Bump dockerfile

* update seed file

* Automated Change

---------

Co-authored-by: Haithem Souala <haithem.souala@woopit.fr>
2023-04-27 10:17:45 -03:00
igsaf2
fd36c06cd9 Source Monday: fix boards stream 25 row limit in source-monday (#25277)
* fix boards stream 25 row limit in source-monday

* update docs and dockerfile

* auto-bump connector version

---------

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
2023-04-27 09:52:38 -03:00
Augustin
787e8eefd3 connectors-ci: unpin pytest on specific connectors (#25562) 2023-04-27 11:57:45 +00:00
Dominik Wagner
cb593fae9b 🎉 Source SurveyMonkey: add survey_collectors and collectors stream (#23721)
* add survey_collectors stream

* add stream to docs

* add missing schema

* fix stream and add expected records

* remove unused file

* bump connector version

* fix unit test

* add doc url for surveycollectors

* update expected records

* auto-bump connector version

---------

Co-authored-by: sh4sh <6833405+sh4sh@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-27 07:16:28 -03:00
Baz
02940ca2c3 🐛 Source Marketo: fix expected records for CAT (#25481)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-27 13:01:17 +03:00
Jonathan Pearlin
a38af089e9 Track stream status in source (#24971)
* WIP Track stream status in source

* Revert formatting

* Revert formatting changes

* Remove unnecessary file

* Automated Change

* Automated Change

* Use new stream status trace message

* Rename class

* Remove unnecessary import

* Formatting

* Add tests

* Fix compile issues

* Automated Commit - Formatting Changes

* Remove TODO

* Fix compilation error

* Split STOPPED into INCOMPLETE and COMPLETE

* Remove unused import

* Changelog updates for source-postgres

* Remove unused import

* auto-bump connector version

---------

Co-authored-by: jdpgrailsdev <jdpgrailsdev@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-26 15:14:25 -05:00
Akash Kulkarni
4164cd900e Revert "Better formatting/logging for pre-sync data" (#25560)
* Revert "Better formatting/logging for pre-sync data (#25459)"

This reverts commit 0d9b7b4f7b.

* Fix dockerfile + docs

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-26 13:16:31 -05:00
Baz
3e6c8a37b0 🐛 Source Pinterest: fix boards schema with correct format for date-time (#25548)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-26 17:17:41 +03:00
Arsen Losenko
0774d07d5d Source PayPal Transaction: Mark datefields in spec as dates (#22916)
* Source PayPal Transaction: Mark datefields in spec as dates

* Update changelog

* Update Dockerfile

* Update regex pattern

* Update config examples, and skip comparison with previous version

* Update pattern regex to match both datetime from datepicker and datetime with offset

* Remove previous changes in config examples

* Update examples in spec

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-26 16:56:09 +03:00
Marcos Marx
6b4bd97042 🎉 Source Greenhouse: enhance stream support (#25332)
* enhance stream support

* remove bracket space

* add missing schema and new lines

* fix: update cdk version to 2.0

* fix flake check

* solve conflicts

* merge oss_catalog from master

* remove oss_catalog

* Automated Change

* fix schemas

* remove oss catalog

* fix unit test count stream

* update doc changelog and dockerfile version

* auto-bump connector version

---------

Co-authored-by: itaseski <ivica.taseski94@gmail.com>
Co-authored-by: sajarin <sajarindider@gmail.com>
Co-authored-by: itaseski <itaseski@debian-BULLSEYE-live-builder-AMD64>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-26 10:44:01 -03:00
Greg Meyer
9134fd17b6 Source Hubspot: renamed the contacts auth scopes (#21423)
* they renamed the oauth scope

* it should be .read

* remove space

* Try only with crm.objects.contacts.read

* bump connector version

* fix space in docs

* update version in dockerfile to 0.6.2

* update the source definition file as well

* Update source_definitions.yaml

* Update Dockerfile

* auto-bump connector version

---------

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-25 18:45:25 -03:00
Mal Hancock
0963ea4438 Source surveycto incremental sync fix (#25522)
* changes

* changes

* bump version

* fix eof

* remove datetime import

* update documentation

* auto-bump connector version

---------

Co-authored-by: siddhant <ssiddhant3030@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-25 14:36:18 -07:00
Akash Kulkarni
0d9b7b4f7b Better formatting/logging for pre-sync data (#25459)
* Log cursor alongside indexes

* Better formatting for table estimates, indexes

* Doc & dockerfile bump

* Fix formatting

* auto-bump connector version

* Automated Commit - Formatting Changes

* Fixing connector base issues

* Fix failure

* Fix changelog

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: airbyteio <airbyteio@users.noreply.github.com>
2023-04-25 14:12:36 -07:00
Edward Gao
7abda87840 destination bigquery: run normalization inside container if env var is set (#25097)
* super hacky start

* also check that we're writing

* v0 convert normalization logs to airbytemessage

* add start+end logs

* aggregate errors into a single trace?

* pipefail; quick tweaks to log parser

* make spotbugs happy

* more comments, uncomment env var check

* copy in SentryExceptionHelper

* final fixes

* write tests + fix bugs

* move to base-java

* remove outdated comment

* fix spotbugs

* Automated Change

* minor version bump

* changelog

* fix behavior when env var not set

* run normalization even if destination fails

* better logic

* better logging

* oops

* move to base-java

* rebump version

* Automated Change

* auto-bump connector version

* wtf how did this work previously

* auto-bump connector version

---------

Co-authored-by: edgao <edgao@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-25 20:11:57 +00:00
Upmitt
8c9ac5492c Cloud missing connector icons (#25168)
* Cloud missing connector icons

* rename new icon back to old name

* Add icons to source definitions

* Apply changes to connectors.md

---------

Co-authored-by: erohmensing <erohmensing@gmail.com>
2023-04-25 18:49:55 +00:00
Denys Davydov
3f327f60f3 Source Google Analytics Data API: implement advanced reports (#25179)
* #11689 source Google Analytics Data API: implement advanced reports

* #11689 source GA data API: upd changelog

* #11689 source GA data API: fix CAT

* #11689 source GA data API: fix CAT

* Have empty dict as default option

* Remove dateRange and dimensions from required params

* Generate source defintions manually

---------

Co-authored-by: Arsen Losenko <20901439+arsenlosenko@users.noreply.github.com>
2023-04-25 19:55:55 +03:00
Marcos Marx
0dd3111a47 Source bing ads fix add lb window (#25259)
* test: create test state initialization

* feat: add lookback_window configuration and logic

* fix: pendulum subtract method used instead of minus

* style: rename _get_start_date

* docs: explain parameter meaning

* fix: add lookback_window param in invalid_config json

* chore: bump connector version in Dockerfile

* fix start_date subtract

* Automated Change

* Remove comparision

* auto-bump connector version

---------

Co-authored-by: Moguero <thibault.latrace@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-25 13:05:07 -03:00
Roman Yermilov [GL]
6f3cdcf864 Source Salesforce: update API version to 53 (#25352)
* Source Salesforce: update API version to 53

* Source Salesforce: update changelog

* Source Salesforce: update version in tests

* Source Salesforce: bump version

* Source Salesforce: update expected records

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-25 14:55:26 +00:00
Serhii Lazebnyi
3bfcddac2d 🎉Source File: Add datatime format parsing support for csv files (#25445)
* Add datatime format parsing support

* Updated subject in docs

* Bump file secure

* PR number bumped

* Fix typo

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-25 11:57:10 +02:00
Serhii Lazebnyi
5bde434895 🐛Source Pinterest: Update AMOUNT_OF_DAYS_ALLOWED_FOR_LOOKUP to 89 days (#25313)
* Update `AMOUNT_OF_DAYS_ALLOWED_FOR_LOOKUP` to 90 days

* Redced AMOUNT_OF_DAYS_ALLOWED_FOR_LOOKUP to 89 days

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-24 22:05:29 +00:00
Serhii Lazebnyi
312c84164a 🐛Source GitHub: Fix invalid validation format of repositories config (#25312)
* Fix repo name validation

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-24 21:36:49 +00:00
Baz
26c9ad5062 🐛 Source Shopify: fix None cursor field value, access_scopes keyError issue, JSONDecodeError issue, mark datefields as format of date (#25110) 2023-04-24 23:47:51 +03:00
Mohamad Hallak
f9fe9fe8eb 🐛 Source Stripe: Add customer tax ids to invoices stream (#23389)
* Add customer tax ids to invoices

* Update docs

* Update source_specs.yaml

* Update versions

* Bump version

* Update source_definitions.yaml

* Update source_specs.yaml

* fix source_definitions

* formatting changes

* fix schema and add expected records

* fix expected records

* auto-bump connector version

---------

Co-authored-by: Mal Hancock <mallory@archangelic.space>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-24 16:22:59 -03:00
btkcodedev
f6bd91018b 🎉Source MailChimp: New Stream Automations (#23290)
* bump connector version

* Source: MailChimp, New Stream Automations

* fix: Schema error fix

* Fixes formatting.

* fix: Fixed acceptance test schema errors

* fix: Update schema, update dockerlabel

* refactor: Update docs

* refactor: Update DockerVersionTag

* fix: Update EOF and configured catalog

* fix: Schema, Update docs

* fix: Schema on catalog

* fix: update DocketVersionTag

* fix: schema, update docs, bump docker version

* fix: spec, update doc in streams.py

* fix: schema compatability for null

* update connector version to 0.4.0

* Update Dockerfile

* recreate source spec

* restore source spec form main

* rollback source spec from main

* source spec

* run gradle config seed

* fix schema and remove unused code

* fix docs

* bump connector seed file versino

* auto-bump connector version

---------

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: nataly <nataly@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
2023-04-24 15:07:18 -03:00
Roman Yermilov [GL]
dd607dcdf0 🎉Source Salesforce: add checkpointing (#24888)
* Source Salesforce: add checkpointing

* Source-Iterable: fix integration tests

* Source Salesforce: fix integration test s;ices

* Source Salesforce: wait for latest record to be accessible

* Source Salesforce: retry for 10 times for everything

* Source Salesforce: refactoring. Add checkpointing for all incremental

* Source Salesforce: small fixes

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-24 15:26:43 +04:00
JJ Nilbodee
dd2cee304e 🎉 Source Stripe: add SetupIntents stream (#23963)
* add SetupIntents schema

* add setup intents

* add test & docs

* update docs

* add additionalProperties

* update date

* fix schema

* update schema and expected records

* fix sub schedule schema

* update expected records for sub schedule

* update expected records

* update source def seed

* auto-bump connector version

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Mal Hancock <mhancock@archangelic.space>
Co-authored-by: Mal Hancock <mallory@archangelic.space>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-21 16:21:10 -03:00
Marcos Marx
7c9392adf8 Destination S3 Glue: Fix precision and scale of decimal type (#25397)
* destination-s3-glue: Fix precision and scale of decimal type

The decimal type in Hive will default to a precision of 10 and a scale of 0, meaning
that it cannot handle numbers larger than 10 digits. The maximum values for precision
and scale are 38 and 38 respectively. This updates the decimal type specified in
destination schemas to use the maximum values for the broadest compatibility with
numeric values.

If a table is using the default precision of 10 and a number is present which exceeds
that many digits then the query engine will throw a `fieldValue cannot be null` error
message which is very cryptic.

* run seed generator

* Automated Change

* Update connectors.md

* Automated Change

---------

Co-authored-by: Tobias Macey <tmacey@mit.edu>
2023-04-21 13:25:00 -03:00
Marcos Marx
123a31e813 🎉 New Destination: Starburst Galaxy (#25399)
Co-authored-by: Mayank Vadariya <48036907+mayankvadariya@users.noreply.github.com>
2023-04-21 12:34:55 -03:00
iberchid
f5d494a451 Source Snapchat Marketing: Add missing story metrics to basic stats (#20897)
* Add missing story metrics to basic stats

* fix expected records and update dockerfile version

* auto-bump connector version

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-21 09:50:18 -03:00
Edward Gao
d9a50be557 Destination Databricks: use hive_metastore if catalog not set (#25366)
* use hive_metastore if catalog not set

* Automated Change

* add test case

* version bump + changelog

* auto-bump connector version

---------

Co-authored-by: edgao <edgao@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-20 17:42:26 -07:00
Artem Inzhyyants
aaf4bf056b Source Amplitude: refactor Events stream (#25317)
* Source Amplitude: Refactor Events Stream, based on Python CDK

* Source Amplitude: bump docker version

* Source Amplitude: Fix add get_updated_state

* Revert "Increase memory_limit for Amplitude (#25282)"

This reverts commit 06354ae4e4.

* Source Amplitude: Fix backport compatibility with new config

* Update source_definitions.yaml

* Source Amplitude: update catalogs


---------

Co-authored-by: artem1205 <artem1205@users.noreply.github.com>
2023-04-20 22:14:51 +02:00
Ana Loureiro
a6d6b06303 Source SFTP-Bulk: Support custom CSV separators (#19224)
* manage different separators

* tests

* update tests

* add optional parameter for separator

* add default separator

* typo

* add trailing newline

* fix spec.json order

* bump dockerfile version

* update changelog

* auto-bump connector version

* retrigger checks

* retrigger checks

---------

Co-authored-by: Sunny Hashmi <6833405+sh4sh@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-20 10:02:19 -04:00
Akash Kulkarni
395de77a50 [JDBC sources] : Log database indexes per stream (#25345)
* [JDBC sources] : Log database indexes per stream

* Docker & doc bump

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-20 01:05:15 +00:00
Cynthia Yin
ae34a80cc5 Destination BigQuery + BigQuery denormalized: add configurable file buffer count (#25287)
* add configurable file buffer count for dest bq + bq denorm

* update changelog

* changelog nits

* auto-bump connector version

* manually bump connector version for bq denorm

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-20 00:11:14 +00:00
Yevhen Sukhomud
fd70eb614d 24153 Destination Databricks: Fix support for external tables on S3 (#24657)
* 24153 Destination Databricks: Update s3 source external

* 24153 Destination Databricks: Fixed databricks.md formatting

* 24153 Destination Databricks: Update the version

* auto-bump connector version

---------

Co-authored-by: Evan Tahler <evan@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-19 13:28:32 -07:00
Dominik Wagner
692e8c36c4 🎉Source Mailjet-Mail: Add listrecipient stream (#24689)
* add listrecipient stream

* update schemas to match source api

* bump dockerfile version

* update changelog

* auto-bump connector version

---------

Co-authored-by: sh4sh <6833405+sh4sh@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-19 20:18:20 +00:00
Henri Blancke
af3db20f64 🐛 Destination AWS Datalake: fix airbyte type in complex data types (#24642)
* [UPD] prefer airbyte type in complex data types

Signed-off-by: Henri Blancke <blanckehenri@gmail.com>

* [UPD] bump version

Signed-off-by: Henri Blancke <blanckehenri@gmail.com>

* [UPD] only for integers

Signed-off-by: Henri Blancke <blanckehenri@gmail.com>

* [FIX] changelog table

Signed-off-by: Henri Blancke <blanckehenri@gmail.com>

* [UPD] cast objects that can have additional props to string

Signed-off-by: Henri Blancke <blanckehenri@gmail.com>

* [ADD] tests

Signed-off-by: Henri Blancke <blanckehenri@gmail.com>

* auto-bump connector version

---------

Signed-off-by: Henri Blancke <blanckehenri@gmail.com>
Co-authored-by: Sajarin <sajarindider@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-19 15:12:41 -04:00
Sergio Ropero
819bba174f postgres-cdc checkpointing: fix LSN parsing bug + refactor for efficiency (#24582)
* Fix LSN parsing from Integer to Long

* rebasing

* Rebase

* Rebase

* Other casting

* Lock the file only when reading, so the file is free when parsing the object.
Increased from 1 to 166 checkpoints, and from skipping hundreds of checkpoints to never skip a state.

* Update load function documentation

* bump mysql and mssql

* cdc: refactor to remove debezium dependency from connector packages

* use gradle's shared dependency

* more refactoring

* upgrade docker version

* resolve master merge conflicts

* Automated Change

* minor changes

* resolve merge conflicts

* avoid deserializing multiple times

* simplify

* enable checkpointing for Postgres

* more improvements

* enable assertions

* changelog + bump version

* auto-bump connector version

* auto-bump connector version

* manual bump

---------

Co-authored-by: subodh <subodh1810@gmail.com>
Co-authored-by: subodh1810 <subodh1810@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-19 21:05:50 +05:30
Catherine Noll
2bc79893aa source-amplitude: Only fetch date_time_fields once per request (#25315) 2023-04-19 10:47:59 -04:00
midavadim
0b9847742f 🎉 Source Google Ads - fixed schema type for "data_type: ENUM" and "is_repeated: true" to array of strings (#24945)
* fixed schema type for "data_type: ENUM" and "is_repeated: true" to array of strings

* added SAT for GAQL

* updated version

* Added unittest for get_json_schema

* slight enhancement

* fixed empty lines

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-19 15:35:54 +03:00
Marcos Marx
10db658097 Source Stripe: add account stream (#25136)
* add accounts stream

* add docs

* lint

* fix

* fix

* fix test

* fix tests

* fix account schema

* fix expected records and schema

* remove account from abnormal state

* update dockerfile and update docs

* Update Dockerfile

* Update source_definitions.yaml

* Update test_source stream count

* auto-bump connector version

---------

Co-authored-by: Haithem Souala <haithem.souala@woopit.fr>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-19 13:03:39 +03:00