jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-02-03 10:02:09 -05:00
Code Issues Packages Projects Releases Wiki Activity
12,116 Commits 5,696 Branches 518 Tags
4bf6b8e15a2d35ae5ac80bfe35d42d1c19df977f
Commit Graph

3524 Commits

Author SHA1 Message Date
Efim Matytsin
f1c89a157c ✨ Source Shopify: add new stream Disputes (#28770) 
* SCNTALS-1988 add disputes stream to shopify

* Update airbyte-integrations/connectors/source-shopify/source_shopify/schemas/disputes.json

Co-authored-by: sh4sh <6833405+sh4sh@users.noreply.github.com>

* added disputes to acceptance-test-config.yml

* add docs for shopify stream

---------

Co-authored-by: sh4sh <6833405+sh4sh@users.noreply.github.com>
 2023-08-04 13:25:38 -05:00
Edward Gao
b74ddffdbe 🐛 Destination bigquery 1s1t: wrap jsonpath fieldname in quotes (#29089) 
* wrap jsonpath fieldname in quotes

* logistics
 2023-08-04 11:28:38 -06:00
Baz
d2dd4e9591 🐛 Source TikTok Marketing: add missing property to ad_groups schema, fix None > null in expected records (#29083) 2023-08-04 18:14:32 +03:00
Baz
9e6cd978c1 🐛 Source Facebook-Marketing: fix broken OAuth references in spec (#29042) 2023-08-04 15:27:58 +03:00
Edward Gao
ac67bfd9fd 1s1t: Refactor sqlgenerator integration test (#28890) 
* random wip stuff

* fix insertRaw

* theoretically implement stuff?

* stuff

* put suffix at the end

* different uuids

* fix expected records

* move tdtest resources into dat folder

* use resource files

* stuff

* move code around

* more stuff

* rename final table

* stuff

* cdc immediate deletion

* cdcComplexUpdate

* cleanup

* botched rebase

* more tests

* move back to old file

* Automated Commit - Format and Process Resources Changes

* add comments

* Automated Commit - Format and Process Resources Changes

* Automated Commit - Format and Process Resources Changes

* raw name update

* logistics

---------

Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-08-03 17:27:17 -06:00
Rodi Reich Zilberman
2d2cddd9f3 Rollout ctid cdc (#28708) 
* source-postgres: enable ctid+cdc implementation

* 100% ctid rollout for cdc

* remove CtidFeatureFlags

* fix CdcPostgresSourceAcceptanceTest

* Bump versions and release notes

* Fix compilation error due to previous merge

---------

Co-authored-by: subodh <subodh1810@gmail.com>
 2023-08-03 15:36:04 -05:00
Benoit Moriceau
d7f6bcbefe 🐛 Avoid writing records to log (#29047) 
* Avoid writing records to log

* Update version
 2023-08-03 15:20:12 -05:00
Lake Mossman
96df471940 🎨 Improve replication method selection UX (#28882) 
* update replication method in MySQL source

* bump version

* update expected specs

* update registries

* bump strict encrypt version

* make password always_show

* change url

* update registries
 2023-08-03 15:18:34 -05:00
btkcodedev
fde1664d37 ✨Source Shortio: Migrate Python CDK to Low-code CDK (#28950) 
* Migrate Shortio to Low-Code

* Update abnormal state

* Format

* Update Docs

* Fix metadata.yaml

* Add pagination

* Add incremental sync

* add incremental parameters

* update metadata

* rollback update version

* release date

---------

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
 2023-08-03 13:33:17 -03:00
Joe Reuter
0a4be6ee59 Source-Greenhouse: Fix unit tests for new CDK version (#28969) 
Fix unit tests
 2023-08-03 17:47:47 +02:00
Marcos Marx
03ffad5d4f Source oauth0: new streams and fix incremental (#29001) 
* Add new streams Organizations,OrganizationMembers,OrganizationMemberRoles

* relax schema definition to allow additional fields

* Bump image tag version

* revert some changes to the old schemas

* Format python so gradle can pass

* update incremental

* remove unused print

* fix unit test

---------

Co-authored-by: Vasilis Gavriilidis <vasilis.gavriilidis@orfium.com>
 2023-08-03 11:05:19 -03:00
Baz
3bc79be30a 🐛 Source Github, Instagram, Zendesk Support / Talk - revert spec changes and improve (#29031) 2023-08-03 15:06:35 +03:00
Serhii Lazebnyi
db0d6466ff Updated docs (#29019) 2023-08-03 11:36:09 +02:00
Baz
4e532ae8ed 🐛 Source Github, Instagram, Zendesk-support, Zendesk-talk: fix CAT tests fail on spec (#28910) 2023-08-03 08:51:12 +03:00
Edward Gao
3af7f3b6fb 🐛 Destinations snowflake + bigquery: only parse catalog in 1s1t mode (#28976) 
* only parse catalog in 1s1t mode

* one more thing?

* logistics
 2023-08-02 15:19:52 -07:00
Joe Reuter
516e89ce8d update docs (#28973) 2023-08-02 18:42:26 +02:00
Joe Reuter
4d229f2974 Langchain destination: Check pincone index dimensions as part of check (#28977) 
* check dimensions

* improve error message

* adjust changelog
 2023-08-02 18:38:52 +02:00
Zaza Javakhishvili
61fa2b6826 🐛 Source Amazon Seller Partner: Fix non vendor accounts connector create/check issue (#27050) 
* bux fix. Now non vendor accounts can create/check connection

* add bull requestr url

* run check for vendor only

* update metadata file

* remove expectered records from empty stream

* add ListFinancialEventGroups as empty stream

* remove expected records

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
 2023-08-02 12:51:55 -03:00
Edward Gao
694731f4e4 Destination bigquery v2: Fix _ab_cdc_deleted_at handling in non-dedup modes (#28959) 
* fix bug in deleted_at handling

* add test

* comments

* more comments

* logistics
 2023-08-02 09:48:25 -06:00
Denys Davydov
cd51881ff0 🐛 Source Stripe: add availability strategy (#28911) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* source stripe: add availaility strategy

* upd changelog

* update error message map

* update availability strategy
 2023-08-02 16:09:32 +03:00
Rodi Reich Zilberman
3365015db6 Use full enquoted table name for max cursor query (#28954) 
* Use full enquoted table name for max cursor query

* Bump versions
 2023-08-01 20:11:40 -05:00
Cynthia Yin
ae30ce09de ✨ Destinations V2: open up early access for BigQuery via spec toggle (#28894) 
* update spec + version

* update PR link
 2023-08-01 18:12:21 -05:00
Christo Grabowski
4a8e75e200 Docs: Source Google Ads docs update (#28833) 
* update token request step

* add instructions for OAuth credentials

* additional context

* add setup steps from main to inapp

* update duplication comment

* minor changes to inapp setup

* clarify manager account Customer ID field

* update prerequisites

* truncat inapp setup steps

* last couple edits

* update note on conversion windows
 2023-08-01 18:10:43 -04:00
sh4sh
6df99b24af 🐛 source-mssql: support Read Committed snapshot isolation level (#28545) 
* make getSnapshotIsolationConfig grab the correct config

* add object case for getDataToSyncConfig and getSnapshotIsolationConfig

* update tests to use current config parameters

* bump connector version

* add changelog
 2023-08-01 16:37:45 -05:00
Benoit Moriceau
a68ea60f63 ✨Reduce log noise (#28917) 
* Reduce log noise

* Automated Commit - Format and Process Resources Changes

---------

Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
 2023-08-01 13:21:41 -05:00
Sajarin
2d1e0fa527 ✨ Source Clockify: Add Optional API Url parameter (#28622) 
* Add api_url as optional parameter to source-clockify

See https://github.com/airbytehq/airbyte/issues/27688 for more details

* fix: update clients schema and migrate acceptance-test-config.yml from legacy

---------

Co-authored-by: Ezra Quemuel <ezra.quemuel@redesignhealth.com>
 2023-08-01 14:06:03 -04:00
KqLLL
4544eb55f3 Source Zoom: Replace JWT Auth methods with server-to-server Oauth (#25308) 
* Replace JWT Auth methods with server-to-server Oauth

* Bump versions in the Dockerfile and metadata.yaml
 2023-08-01 12:17:54 -05:00
Catherine Noll
57d3dafe16 Source S3: basic structure using file-based CDK (#28786) 2023-08-01 12:45:17 -04:00
Shishir Rajmohan Verma
c199724406 🐛 Source Genesys: Use region specific API server (#25598) 
* use api url corresponding to region specified in the config

* update unit tests

* bump up version

* refactor
 2023-08-01 10:35:30 -05:00
Baz
3e466d769c 🐛 Source Chargebee, Delighted: disabled Incremental tests (#28905) 2023-08-01 12:55:30 +03:00
Serhii Lazebnyi
f45da1a921 Source Stripe: Add properties to customer_shipping field in invoices stream (#28887) 
* Add properties to customer_shipping field in invoces stream

* Bump version
 2023-08-01 11:02:59 +02:00
Rodi Reich Zilberman
d37d2e271a Quote cursor name to support uppercase letters (required by postgres) (#28892) 
* quote cursor name to support uppercase letters (required by postgres)

* sanity

* sanity
 2023-07-31 22:16:52 -05:00
Christo Grabowski
0513b1ce19 Source Google Ads: update input field tooltips (#28832) 
* update field descriptions

* version bump

* changelog update

* add missing cell in table

* Update airbyte-integrations/connectors/source-google-ads/source_google_ads/spec.json

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Update airbyte-integrations/connectors/source-google-ads/source_google_ads/spec.json

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

---------

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2023-07-31 17:28:13 -04:00
Christo Grabowski
db24dbf5f6 Docs: Source SFTP Bulk docs update (#28686) 
* update setup instructions for bulk

* add description of Most Recent File field

* reword bulk-specific functionality

* update setup steps to match new layout in Airbyte UI

* update bulk features
 2023-07-31 12:40:47 -04:00
Edward Gao
360f0e8f74 Destination snowflake: Add 1s1t skeletons (#28618) 
* csv sheet generator supports 1s1t

* create+insert raw tables 1s1t

* add skeletons

* start writing tests

* progress in creating raw tables

* fix tests

* add s3 test; better csv generation

* handle case-sensitive column names

* also add gcs test

* hook T+D into the destination

* fix redshift; simplify

* Delete unused files?

* disable test; enable cleanup

* initialize config singleton in tests

* logistics

* header

* simplify

* fix unit tests

* correctly disable tests

* use default null for loaded_at

* fix test

* autoformat

* cython >.>

* more singleton init

* literally how?

* unused variables

* recorddiffer can be case-sensitive

* move constants to base-java

* use ternary
 2023-07-31 11:14:25 -05:00
Daryna Ishchenko
285afdc01f Source Trello: organizations: updated expected records (#28734) 
* organizations: updated expected records

* updated

---------

Co-authored-by: Baz <oleksandr.bazarnov@globallogic.com>
 2023-07-31 13:50:42 +03:00
Serhii Lazebnyi
6768281dd5 🎉 Source Pinterest: Add report stream for CAMPAIGN level (#28672) 
* Add report stream for `CAMPAIGN` level

* Updated PR number

* Fix window in days error
 2023-07-31 11:54:28 +02:00
Lake Mossman
2c81224caa 🧹 Sweep authSpecification in connectors repo (#27996) 
* sweep authSpecification from tests and api

* update CAT version and changelog

* Automated Commit - Format and Process Resources Changes

* make function more pythonic

* Automated Commit - Format and Process Resources Changes

* bump facebook marketing version

* fix table format

* unpin source-google-sheets cloud version

* try bumping PyYAML requirement to 6.0 in source-google-sheets

---------

Co-authored-by: lmossman <lmossman@users.noreply.github.com>
 2023-07-27 17:27:04 -05:00
btkcodedev
d13cd041fb ✨Source Twilio: New streams Step (#27323) 
* Add new stream Step

* EOF, Alignment

* ignore expected_records test for step stream due to no records in sandbox account

* Update version

* fix step stream

* update expected records

* format

* up

---------

Co-authored-by: Sajarin <sajarindider@gmail.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2023-07-27 18:33:48 -03:00
Jonathan Pearlin
9ca8cdece6 🐛 Source Mongo: Revert recent changes (#28815) 
* revert changes

* revert changes

* revert changes

* revert changes

* revert changes

* Prepare release

* Add pull request to release notes

* Automated Commit - Formatting Changes

---------

Co-authored-by: jdpgrailsdev <jdpgrailsdev@users.noreply.github.com>
 2023-07-27 14:47:47 -05:00
btkcodedev
236c4078b9 ✨Source Stripe: New Streams - Prices (#26127) 
* Initial commit

* Update metadata.yaml

* Fix md file

* resolve comments

* fix: format python files with flake

* fix: change created type in price schema to integer

* update expected_records of prices stream

---------

Co-authored-by: sajarin <sajarindider@gmail.com>
 2023-07-27 14:27:14 -04:00
Edward Gao
83fb3caeea 🚨 Destination bigquery 1s1t: change raw dataset + table name (#28723) 
* add test for raw dataset override

* tests hardcode raw dataset name

* rename raw tables

* minimum 1

* logistics

* different option per destination
 2023-07-27 12:37:17 -05:00
Antoine Balliet
ebb84e598c ✨Source HubSpot: New stream for contacts merged audit (#27091) 
* feat: add ContactsMergedAudit stream

* Update hubspot.md

* apply formatting

* Add to source

* Update catalog

* bump version in metadata.yaml

* use vid-to-merge as primary key

* fix format

* add additionalProperties prop in schema

* refactor by creating functions

* More details about API version choices

* Add docstring

* more explicit properties definition

* unit testing

* fix: modify expected_records for contacts_merged_audit stream

* Add abnormal state for contacts_merged_audit stream

* Update README.md

* WIP substream

* Apply formatting

* remove

* fix parent child stream

* remove diff title bar changelog

* fix unit tests

* improve naming

* Remove unused import

* updated schema

* simplify batch creation

* fix stream which doesnt allow incremental

* dockerfile

* fix: updated expected_records for contacts stream

* docs: bump metadata.yml file and update connector changelog

---------

Co-authored-by: Sunny Hashmi <6833405+sh4sh@users.noreply.github.com>
Co-authored-by: Sajarin <sajarindider@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
 2023-07-27 13:29:34 -04:00
Christo Grabowski
36affa6253 Docs: Source Salesforce docs update (#28751) 
* update setup instructions

* update setup steps in inapp

* add please

* remove whitespace

* small fix

* Update salesforce.md

* typecase
 2023-07-27 11:00:34 -04:00
Denys Davydov
4ad6deda26 ✨ ✨ Source Stripe: add missing fields (#28776) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #24672 source Stripe: add missing fields to stream schemas

* #24672 upd changelog

* fix schema error

* fix schema error
 2023-07-27 17:54:31 +03:00
Aviraj Gour
71437385cb ✨ Source surveycto : added check connection function (#28512) 
* check connection function implement

* failed msg

* Changes Suggested

* removed unused base_encode

Signed-off-by: Aviraj Gour <100823015+avirajsingh7@users.noreply.github.com>

* removed unused code

* checking all form ids

* exception modify

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>

* unit testing for check connection

* docs and metadata

* docker file update

---------

Signed-off-by: Aviraj Gour <100823015+avirajsingh7@users.noreply.github.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2023-07-27 09:06:50 -05:00
Eduard Tudenhoefner
aab90a0e48 Destination Iceberg: Support server-managed storage config (#28506) 2023-07-27 08:41:36 -05:00
Cole Snodgrass
0622860baf 🐛 Source Mongo: fix potential npe when collecting stats (#28760) 
* avoid NPE in getCollectionStats

* remove accidental whitespace

* update mongo changelog
 2023-07-27 08:18:58 -05:00
Randal Boyle
eab3f34ec7 🐛 Correcting aircall typo (#27433) 
* correcting availability typo in aircall.md

* correcting availability bumping dockerfile

* adding in CHANGELOG.md

* adding in CHANGELOG.md in the right place and bumping docker file version
 2023-07-27 07:42:19 -05:00
Roman Yermilov [GL]
9a714db326 Source S3: encoding validation fix, refactor and test (#28730) 
* Source S3: encoding validation fix, refactor and test

* Source S3: bump verson, update changelog

* Source S3: format imports

* Source S3: fix W291 trailing whitespace
 2023-07-27 16:00:06 +04:00