1
0
mirror of synced 2025-12-22 11:31:02 -05:00
Commit Graph

31012 Commits

Author SHA1 Message Date
Abhi Vaidyanatha
41b69a8431 Add note about orphaned Airbyte configs preventing automatic upgrades (#4709)
* Add note about removing orphaned Airbyte configs

* Remove excess baggage

* Add a resetting section to make this more clear.

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-07-16 15:02:38 -07:00
Anna Lvova
28239a87a1 🎉 Stripe Source: Fix subscriptions stream to return all kinds of subscriptions (including expired and canceled) (#4669)
#4669 Stripe Source: Fix subscriptions stream to return all kinds of subscriptions (including expired and canceled)
Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
2021-07-16 20:49:57 +03:00
John Lafleur
605c06b107 Update README.md 2021-07-16 15:18:59 +11:00
Abhi Vaidyanatha
30e1cba4d6 Remove example use cases from docs (#4775)
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-07-15 17:59:04 -07:00
Charles
76adc25820 Split Platform and Connector Builds (#4514) 2021-07-15 10:49:15 -07:00
Jared Rhizor
8529c59d0c update kube docs (#4749) 2021-07-15 08:41:56 -07:00
Davin Chia
441435a373 Bump version: 0.27.2-alpha → 0.27.3-alpha (#4761) 2021-07-15 20:15:29 +08:00
vovavovavovavova
a10c8051d5 Source PostHog: Use account information for checking the connection (#4692)
* this should fix the check if no records in annotations stream

* update schemas for new SAT requirements && apply user hint upgrade on wrong api key

* save schema upd

* upd insights schema

* upd insights schema2

* upd insights schema3

* upd insights schema4

* upd insights schema5 (null is joking)

* upd insights schema6 (null is joking)

* upd insights schema7

* upd insights schema8

* upd insights schema8

* bump version && docs
2021-07-15 10:52:26 +03:00
Davin Chia
a59e5f6d48 🐛 Fix some api-spec errors. (#4742) 2021-07-15 13:08:30 +08:00
oleh.zorenko
b405c9c0be 🐛 Source GitHub: fix bug with IssueEvents stream and add handling for rate limiting (#4708)
* Few updates for GitHub source

Set correct `cursor_field` for `IssueEvents` stream.
Add rate limit handling.
Add handling for 403 error.
Add handling for 502 error.

Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-07-14 20:49:01 -04:00
Marcos Marx
b1107381b1 🐛 Source Slack: add float_ts field (#4683)
* rename float_ts to ts cursor_field

* add float_ts

* change float_ts to number

* change channel_msg

* bump version

* increase default timeout_seconds slack acc test

* timeout_seconds to 1750

* timeout_seconds to 3600 :p

* add changelog for slack connector
2021-07-14 18:24:08 -03:00
George Claireaux
43d86114a3 fixed broken links and styling (#4747) 2021-07-14 18:35:54 +01:00
Subodh Kant Chaturvedi
cc7b376044 🎉 Source MSSQL: implementation for CDC (#4689)
* first few classes for mssql cdc

* wip

* mssql cdc working against unit tests

* increment version

* add cdc acceptance test

* tweaks

* add file

* working on comprehensive tests

* change isolation from snapshot to read_committed_snapshot

* finalised type tests

* Revert "change isolation from snapshot to read_committed_snapshot"

This reverts commit 20c6768071.

* small docstring fix

* remove unused imports

* stress test fixes

* minor formatting improvements

* mssql cdc docs

* finish off cdc docs

* format fix

* update connector version

* add to changelog

* fix for sql server agent offline failing cdc enable on tables

* final structure

* few more updates

* undo unwanted changes

* add abstract test + more refinement

* remove CDC metadata to debezium

* use new cdc abstraction for mysql

* undo wanted change

* use cdc abstraction for postgres

* add files

* pull in latest changes

* ready

* rename class + add missing property

* use renamed class + move constants to MySqlSource

* use renamed class + move constants to PostgresSource

* move debezium to bases + upgrade debezium version + review comments

* downgrade version + minor fixes

* bring in latest changes from cdc abstraction

* reset to minutes

* bring in the latest changes

* format

* fix build

* address review comments

* bring in latest changes

* bring in latest changes

* use common abstraction for CDC via debezium for sql server

* remove debezium from build

* finalise PR

* should return Optional

* pull in latest changes

* pull in latest changes

* address review comments

* use common abstraction for CDC via debezium for mysql (#4604)

* use new cdc abstraction for mysql

* undo wanted change

* pull in latest changes

* use renamed class + move constants to MySqlSource

* bring in latest changes from cdc abstraction

* format

* bring in latest changes

* pull in latest changes

* use common abstraction for CDC via debezium for postgres (#4607)

* use cdc abstraction for postgres

* add files

* ready

* use renamed class + move constants to PostgresSource

* bring in the latest changes

* bring in latest changes

* pull in latest changes

* lower version for tests to run on CI

* format

* Update docs/integrations/sources/mssql.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* addressing review comments

* fix for testGetTargetPosition

* format changes

Co-authored-by: George Claireaux <george@claireaux.co.uk>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-07-14 17:15:55 +01:00
Abhi Vaidyanatha
1f3acff869 Remove statement about Postgres connector being based on Singer (#4740)
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-07-13 23:22:21 -07:00
Abhi Vaidyanatha
4f0170bd7d Update docs on GitHub connector now that its Airbyte native (#4739)
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-07-13 23:19:37 -07:00
Yaroslav Dudar
20f9c2da62 🎉 New source: Typeform (#4541)
Typeform source: Forms and Responses streams
2021-07-13 13:06:50 +03:00
Sherif A. Nada
258a905469 🎉 Destination Snowflake: tag snowflake traffic with airbyte ID to enable optimizations from Snowflake (#4713) 2021-07-13 00:44:57 -07:00
Dmytro
3add914ada 🐛 Source Square: Update _send_request method due to changes in Airbyte CDK (#4645) 2021-07-13 10:27:34 +03:00
Davin Chia
76a86c3ef3 Bump version: 0.27.1-alpha → 0.27.2-alpha (#4724) 2021-07-13 14:32:21 +08:00
LiRen Tu
f859ad705d Bump destination s3 version (#4718) 2021-07-12 20:31:53 -07:00
Shadab Mohammad
9d5231ff0a 📚 add SSH instructions for OCI VM setup (#4684)
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-07-12 13:08:53 -07:00
Abhi Vaidyanatha
bba12a9f49 0.27.1 Announcement Summary (#4678)
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-07-09 16:15:59 -07:00
Davin Chia
830fac6b64 Turn on MYSQL normalization flag. (#4651)
* Turn on normalization flag. Bump versions
2021-07-09 19:43:45 +02:00
Oliver Meyer
21c961e104 🎉 New source: Dixa (#4358) 2021-07-09 09:06:04 -07:00
Subodh Kant Chaturvedi
e62ad58bf1 fix version for kube automatic migration support (#4649) 2021-07-09 14:27:51 +05:30
Abhi Vaidyanatha
d86db9bb8c Add hint to Airflow guide about local example (#4656)
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-07-09 01:44:12 -07:00
Abhi Vaidyanatha
d5f5ddc293 Update connector certification table. (#4647)
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-07-09 00:27:02 -07:00
Abhi Vaidyanatha
15971e89b1 0.27.1 Connector Patch Notes (#4646)
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-07-09 00:15:28 -07:00
vovavovavovavova
db223a4d06 🎉 New Source: Zendesk Sunshine (#4359)
* pre-PR

* add git config

* format

* Update airbyte-integrations/connectors/source-zendesk-sunshine/requirements.txt

upd requirements.txt remove extra

Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>

* Update airbyte-integrations/connectors/source-zendesk-sunshine/source_zendesk_sunshine/streams.py

backoff time int to float (btw real return type in headers is integer)

Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>

* requested changes

* fix newline absence && rm unnecessary temp file

* url_base to property

* rm extra var coming property

* rm extra var coming property

* save

* finishing updating the documentation

* forgotten definition

* add nullable to pass the test

* fix date in the log

Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>
2021-07-09 09:55:40 +03:00
Abhi Vaidyanatha
e6a374e3ca 0.27.1 Platform Patch Notes (#4644)
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-07-08 23:55:01 -07:00
Davin Chia
4c1c4d9dc8 Bump version: 0.27.0-alpha → 0.27.1-alpha (#4640) 2021-07-09 09:28:22 +08:00
Davin Chia
bfab448568 🎉 Add documentation for configuring Kube GCS logging. (#4622) 2021-07-09 09:01:10 +08:00
Sherif A. Nada
8ae9f1c3c6 Fix broken link in SUMMARY.md 2021-07-08 15:25:04 -07:00
Sherif A. Nada
77c4808b34 Fix docs formatting 2021-07-08 11:27:34 -07:00
midavadim
ca3befee14 🎉 New Source: Paypal Transaction (#4240)
* Added spec.json

* Initialization

* added oauth2 autorization

* added spec, check, discover + catalogs/configurared_catalogs

* updated request_params

* added paging, slicing (1d)

* Use oath2 for paypal

* incremental sync, acceptance test

* incremental sync, acceptance test

* Added spec.json

* Initialization

* added oauth2 autorization

* added spec, check, discover + catalogs/configurared_catalogs

* updated request_params

* added paging, slicing (1d)

* Use oath2 for paypal

* incremental sync, acceptance test

* incremental sync, acceptance test

* Added spec.json

* Initialization

* added oauth2 autorization

* added spec, check, discover + catalogs/configurared_catalogs

* updated request_params

* added paging, slicing (1d)

* Use oath2 for paypal

* incremental sync, acceptance test

* updated slices and api limits, added validation for input dates

* added tests, fixed cursor related information in schemas and configured catalogs, removed old comments, re-arranged Base PaypalTransactionStream class

* added input param 'env' to support production and sandbox envs

* added support for sandbox option, updated pattern for optional end date option

* added github secrets

* added support for sandbox option, updated pattern for optional end date option

* fixed Copyright date, removed debug mesages

* added docs

* fix for test failure - The sync should produce at least one STATE message

* removed optional parameter 'end_date'

* removed detailed info about balances schema

* Delete employees.json

* Delete customers.json

* Added requests_per_minute rate limit

* added unit tests, added custom backoff

* added test for stream slices with stream state

* removed comments

* updated docs pages

* fixed format for json files

* fixed types in schemas and link to the schema. fixed primary key for Transactions stream

* updated stream slices

* Updated tests, unified stream_slices for both streams, all instance variables instantiated directly in __init__ method

* added CHANGELOG.md

* Added build seeds

* fixed closing double quotation mark

* added paypal entry in builds.md

* add fixture helper

* added paypal transaction generator script

* fixed styling

* maximum allowed start_date is extracted from API response now.

* fixed schemas

* fixed schemas - removed datetime

* now maximum_allowed_start_date is identified by last_refreshed_datetime attr in API response.

* added possibility to specify additional properties

Co-authored-by: Sherif Nada <snadalive@gmail.com>
2021-07-08 18:47:00 +03:00
vovavovavovavova
6fdf1ef6ae Mailchimp fix url-base (#4621)
* minimal change to show acceptance test failure

* exactly fix

* bump version and readme

* upd
2021-07-08 18:15:54 +03:00
Sherif A. Nada
7b64635858 add oracle dpeloyment guide to summary.md (#4619) 2021-07-07 22:57:57 -07:00
Shadab Mohammad
9b20c1ae4b Create on on-oci-vm.md (#4468)
* Create on on-oci-vm.md

Deployment guide for Airbyte on Oracle Cloud Infrastructure (OCI) VM

* Update on-oci-vm.md

Adding the image links and uploading images to the repository

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update on-oci-vm.md

* Add files via upload

* Update on-oci-vm.md

* Add files via upload

* Update on-oci-vm.md

* Update on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>
2021-07-07 21:55:44 -03:00
Abhi Vaidyanatha
668ccb3240 Left isn't right (#4616)
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-07-07 17:20:38 -07:00
Abhi Vaidyanatha
9dcef6d939 Migrate Quickstart to use PokeAPI (#4615)
* Migrate Quickstart to use PokeAPI

* Words words words

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-07-07 17:15:44 -07:00
LiRen Tu
646aae1ac8 🎉 Destination S3: support anyOf allOf and oneOf (#4613)
* Support combined restrictions in json schema

* Bump s3 version

* Add more test cases

* Update changelog

* Add more test cases

* Update documentation

* Format code
2021-07-07 15:41:36 -07:00
John Lafleur
937f85fc12 Create head-of-lead-generation.md (#4609)
* Create head-of-lead-generation.md

* Update SUMMARY.md
2021-07-08 05:27:29 +11:00
Yevhenii
c8b8b526f2 🎉 Instagram Source: Migrate to use CDK, upgrade API version and fix failures with HTTP status 400 (#4210)
* handling 400 HTTP error with Backoff
* migrate to CDK

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
2021-07-07 14:11:27 -04:00
vovavovavovavova
4774edf2ca add source-definitions (#4601)
* add source-definitions

* tmp: add docs

* upd docs

* add changelog

* changes

* upd docs/integrations/readme
2021-07-07 20:48:20 +03:00
Dmytro
b8b205a3ff 🎉 New source: Square (#4439) 2021-07-07 20:20:18 +03:00
oleh.zorenko
3e37e904b1 Source GitHub: few updates (#4598)
* Few updates for GitHub connector

Add `AIRBYTE_ENTRYPOINT` to `Dockerfile`.
Add `Changelog` section to `docs/integrations/sources/github.md`.
Remove `source-github/CHANGELOG.md` file.

* Bump GitHub connector version
2021-07-07 15:48:47 +03:00
Marcos Marx
6201100e72 Add entrypoint and bump version for remaining connectors. (#4539)
See the PR descriptions for all the connectors published.
2021-07-07 17:37:22 +08:00
Christophe Duong
af57170d21 Deploy a sweeper pod to clear completed pod histories (#4500)
* Deploy a sweeper pod to clear completed pod histories
2021-07-07 10:32:09 +02:00
jonathan-duval
e2469342d9 Add operator guide for persistant volume on regional GKE cluster (#4591) 2021-07-07 14:22:00 +08:00
Marcos Marx
31555bab4d bump stripe version (#4587) 2021-07-06 21:13:24 -03:00