1
0
mirror of synced 2026-01-05 03:04:38 -05:00
Commit Graph

313 Commits

Author SHA1 Message Date
Marcos Marx
0e09ac3032 Publish PR 6963: new source freshsales (#7585)
* initial commit

* finish implementing full_refresh

* add other tables

* cleaning up

* add docs and use requests_native_auth

* fix function return different number of values

* change package author

* fix schema

* fix schema bug

* linting

* fix unit test

* clean up

* add null for schemas

* remove fc_widget_collaboration col

* change accpt test

* add creds

* run format

* add config files

* run format

Co-authored-by: Tuan Nguyen <anhtuan.nguyen@me.com>
2021-11-03 01:06:38 -03:00
Jared Rhizor
6586fbaf39 switch kube testing order (#7579) 2021-11-02 17:31:40 -07:00
Harshith Mullapudi
8ddf686e9e added credentials to CI for new source sentry
* add credentials to CI for new source sentry

* add ci cred
2021-11-02 19:55:58 +05:30
Marcos Marx
c846188772 Publish PR 6966: new source retently (#7552)
* retently

* PR comments

* PR comments

* mask api keys

* README

* keep gradle happy

* add github creds

* run format

Co-authored-by: Subhash <subhash@kloud.io>
2021-11-01 23:58:16 -03:00
Marcos Marx
fe118e676e Publish PR 4551: new source delighted correct format (#7540)
* Add Delighted source with people, unsubscribes and bounces streams

* Add survey responses stream

* Add documentation for Delighted source

* publish delighted source

* correct acceptance test

Co-authored-by: Rodrigo Parra <rodpar07@gmail.com>
2021-11-01 22:09:13 -03:00
Harshith Mullapudi
bdaec1cf3f add credentials in for New Source Paystack: #7214 (#7529)
* added credentials to ci for new source paystack

* format
2021-11-01 23:49:53 +05:30
Marcos Marx
2c8151fef2 Add creds for strava, lemlist, amazon sqs and freshservice (#7388)
* add creds for strava, lemlist, amazon sqs and freshservice

* correct source name in ci_creds
2021-10-26 11:42:36 -03:00
Charles
5c20ab3b01 remove py from fe e2e test build (#7361) 2021-10-25 17:12:59 -07:00
Charles
84b69d953e remove python from platform build (#7302) 2021-10-23 15:36:34 -07:00
Marcos Marx
c83cafc5c1 add salesloft credentials github wf and ci script (#7275) 2021-10-22 01:28:46 -03:00
Marcos Marx
4efadb228c add onesignal credentials + gradlew format (#7270) 2021-10-21 23:55:06 -03:00
Maksym Pavlenok
bc78e1c9b2 add secret name for publish config (#7221) 2021-10-20 20:03:52 +03:00
Maksym Pavlenok
059645fad4 🎉 Source File: separate secure fork (#6768)
* create a fork for the source-file connector

* update docs and tests

* update docs and tests

* add secrets

Co-authored-by: George Claireaux <george@claireaux.co.uk>

* switching among auth methods

* refactoring after reviews

* correction of doc

* update spec file



Co-authored-by: Maksym Pavlenok <maksym.pavlenok@globallogic.com>
Co-authored-by: George Claireaux <george@claireaux.co.uk>
2021-10-20 12:28:26 +03:00
Jared Rhizor
dc575f6361 fix kube build again (#7174) 2021-10-19 09:29:40 -07:00
George Claireaux
1d3a17a8fb 🎉 Source S3 - memory & performance optimisations + advanced CSV options (#6615)
* memory & performance optimisations

* address comments

* version bump

* added advanced_options for reading csv without header, and more custom pyarrow ReadOptions

* updated to use the latest airbyte-cdk

* updated docs

* bump source-s3 to 0.1.6

* remove unneeded lines

* Use the all dep ami for python builds.

* ec2-instance-id should be ec2-image-id

* ec2-instance-id should be ec2-image-id

Co-authored-by: Jingkun Zhuang <Jingkun.Zhuang@icims.com>
Co-authored-by: Davin Chia <davinchia@gmail.com>
2021-10-19 16:50:51 +01:00
Davin Chia
214b158bde Add labels to EC2 build machines. Refactor actions to reduce duplicate start ec2 runner actions. (#7119)
As the title.

I also took the chance to compose the actions, instead of injecting it everywhere.
2021-10-19 18:02:18 +08:00
Jared Rhizor
7901524131 exclude archive from link checker (#7140) 2021-10-18 14:46:27 -07:00
Jared Rhizor
0f93224769 kube build fixes (#7139)
* upgrade ec2-github-runner

* remaining build fixes

* fix build
2021-10-18 14:46:17 -07:00
Maksym Pavlenok
592f7fe2b2 🐛 Source ZenDesk Support: fix 404 responses for the ticket_comments stream (#6513)
* fix 404 responses for the ticket_comments stream

* add unit test

* add unit test

* add oauth2 access token

* Update airbyte-integrations/connectors/source-zendesk-support/source_zendesk_support/streams.py

Co-authored-by: George Claireaux <george@claireaux.co.uk>

* switching among auth methods

* Update docs/integrations/sources/zendesk-support.md

Co-authored-by: Davin Chia <davinchia@gmail.com>

* add log message for 404 errors

* Update docs/integrations/sources/zendesk-support.md

Co-authored-by: George Claireaux <george@claireaux.co.uk>

* Update airbyte-integrations/connectors/source-zendesk-support/source_zendesk_support/streams.py

Co-authored-by: George Claireaux <george@claireaux.co.uk>

* remove oauth logic from this PR

* remove oauth logic from this PR

Co-authored-by: Maksym Pavlenok <maksym.pavlenok@globallogic.com>
Co-authored-by: George Claireaux <george@claireaux.co.uk>
Co-authored-by: Davin Chia <davinchia@gmail.com>
2021-10-16 01:20:41 +03:00
Jared Rhizor
1b5922896b upgrade to Gradle 7.2 (#7070)
* upgrade to gradle 7.2

* get build working with gradle 7.2

* fix build

* fix connector build?

* EXCLUDE distTar and switch includes to excludes

* switch back to includes

* temporarily try to adjust properties

* don't know why this was modified

* revert spotless upgrade

* upgrade gradle node (better arm support it says)

* add back in Xss since we are getting StackOverflowError without it

* revert bad spotless fmt

* fix acceptance tests duplicates strategy

* add zip for jdbc includes

* check if this helps for java connectors

* remove accidental commit

* remove redundant

* fix warning explosion

* oops

* override gradle.properties

* remove set-env
2021-10-15 14:03:30 -07:00
Maksym Pavlenok
713fe61efd 🎉 New Source: TikTok Marketing (#5887)
* create a new connector folder

* add base classes

* add schemas

* add ads/ad_groups streams

* update tests and docs

* add a bootstrap file

* update the base domain name for API

* update the base domain name for API

* update Dockerfile libs

* remove unused comments

* Update airbyte-integrations/connectors/source-tiktok-marketing/bootstrap.md

Co-authored-by: George Claireaux <george@claireaux.co.uk>

* Update airbyte-integrations/connectors/source-tiktok-marketing/bootstrap.md

Co-authored-by: George Claireaux <george@claireaux.co.uk>

* fix UI error with input parameters

* fix problem with updated state

* Update airbyte-integrations/connectors/source-tiktok-marketing/source_tiktok_marketing/spec.py

Co-authored-by: Davin Chia <davinchia@gmail.com>

* add an unit test

* update README.md

* bump version

Co-authored-by: Maksym Pavlenok <maksym.pavlenok@globallogic.com>
Co-authored-by: George Claireaux <george@claireaux.co.uk>
Co-authored-by: Davin Chia <davinchia@gmail.com>
2021-10-15 19:24:14 +03:00
Baz
cfae84cbb0 🎉 Source Shopify: support oauth flow (#6951) 2021-10-14 22:37:30 +03:00
Arthur Galuza
bfe865aebf 🎉 Source Google Sheets: Support connecting via oAuth webflow (#6354)
* Add service account support

* Upd oauth support

* Upd auth creds selector
2021-10-13 23:02:22 +03:00
Harshith Mullapudi
cb4d5f5bce fix(workflow): community label is not added draft pr (#7014) 2021-10-13 22:42:33 +05:30
Harshith Mullapudi
b4f9788b5b fix(workflow): community label not added for FIRST_TIME, FIRST_TIME_CONTRIBUTOR (#7002) 2021-10-13 19:25:54 +05:30
Arthur Galuza
99b1e91c65 🎉 Source Pipedrive: add oAuth support (#6821)
* Add oauth support

* Upd changelog

* Update airbyte-integrations/connectors/source-pipedrive/source_pipedrive/spec.json

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-10-12 09:45:46 +03:00
Arthur Galuza
bf3189cd12 🎉 Source Google Analytics v4: Declare oauth parameters in google sources (#6414)
* Upd auth: oauth support

* Rename authorization/credentials, upd spec, refactor

* Add backward compatibility

* Upd CI

* Bump version

* Upd changelog
2021-10-08 12:38:40 +03:00
Yevhenii
00d56e7711 🎉 Source Slack: Implement OAuth support with OAuth authenticator (#6570)
* Source Slack: Implement OAuth support with OAuth authenticator
2021-10-07 14:01:15 +03:00
Sherif A. Nada
b470489983 🧹delete marketo singer source (#6800) 2021-10-06 22:53:21 -07:00
Harshith Mullapudi
3dae08736e chore(workflow): add community tag even if he is first time contributor (#6769) 2021-10-05 22:24:56 +05:30
Jenny Brown
2e5fbba434 Clarify ssh private key format for ssh tunnels (#6585)
* Clarify ssh private key format for ssh tunnels
* Improved SSH Tunnel key generation steps, fixed formatting
* Modified wording 'app' to 'connector' for consistency
* Ran format
2021-10-04 13:59:47 -05:00
Marcos Marx
f006da8aaa Github Bot add community issue/pr into Github Project (#6721)
* project bot add community issue/pr into projects

* eof
2021-10-04 13:06:01 -03:00
Vadym
351e998394 🎉 Source Hubspot: Support OAuth (#6465)
* Add required scopes to hubspot.md docs

* Update spec with oauth creds.
Update acceptance test config with oauth tests.
Add oauth test creds configs.

* Fix spec.js `oneOf` usage

* Add CDK authenticators usage.
Update source acceptance tests.
Update spec.json.

* Fix source unit tests

* Update hubspot.md scopes docs

* Add spec field titles.
Update comments.

* Update spec.json oauthFlowOutputParameters.

* Update spec.json to pass SAT.
2021-10-04 17:11:34 +03:00
oneshcheret
11561290be 🎉 Source MSSQL: Implement SSH bastion for acceptance/integration tests (#6608)
* 🎉 Source MSSQL: Implement SSH bastion for acceptance/integration tests

* 🎉 Source MSSQL: remove ci creds for mssql source
2021-10-04 16:08:41 +03:00
Harshith Mullapudi
e6d500273f fix(workflow): change pull_request to pull_request_target (#6693) 2021-10-04 17:21:54 +05:30
Harshith Mullapudi
b5346c1722 chore(workflow): added github community issue/pr label bot (#6626) 2021-10-01 23:09:18 +05:30
VitaliiMaltsev
c2561141fc 🎉 Destination Oracle - Added support for connection via ssh tunnel (#6370)
* Oracle destination with ssh tunneling

* add ssh key integration testing for Oracle destination

* fix checkstyle

* add container approach to Oracle Destination Integration Tests

* add container approach to Oracle Destination Integration Tests

* add container approach to Oracle Source Integration Tests/ delete secrets for Oracle db

* Oracle Destination - bump version to 0.1.8

* remove oracle ssh secrets from ci_credentials.sh

Co-authored-by: vmaltsev <vitalii.maltsev@globallogic.com>
2021-09-28 14:25:33 +03:00
Baz
2f835e4e39 🎉 New Source: LinkedIn Ads (#5285)
Resolving: https://github.com/airbytehq/airbyte/issues/2589

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
2021-09-25 01:58:58 +03:00
Eugene
6658ecd5aa 🎉 Source Oracle: Added support for connection via SSH tunnels (#6356)
* [5968] Source Oracle - Added option to connect to Oracle DB via SSH (aka bastion server)
2021-09-24 20:52:47 +03:00
irynakruk
5551698002 Source MongoDb: added support via TLS/SSL (#6364)
* updated ssl configs;
fixed replica connection;
fixed incremental read;

* added MongoDbSourceAtlasAcceptanceTest with ssl enabled

* updated docs, moved TLS option for standalone instance type, enabled it by default for other types

* Update mongodb-v2.md

* updated README.md

* updated spec.json

* Code review changes

* updated ci_credentials.sh
2021-09-24 09:22:54 -04:00
Serhii Lazebnyi
26c9546a1c 🎉 New Source: Marketo (#5863)
* Add Marketo implementation

* Updated PR in docs

* Add bootstrap file

* Update to review

* Add gcc to docker
2021-09-23 18:51:47 +03:00
Yevhenii
63425923d0 Remove deprecated connectors: source-google-adwords-singer, source-google-search-console-singer, source-googleanalytics-singer (#6378) 2021-09-23 15:24:49 +03:00
Yevhenii
73162062db 🎉 New Source: Lever Hiring (#6141)
* Lever Hiring - New Connector
2021-09-22 12:51:00 +03:00
Oleksandr Sheheda
59cd5ca308 🎉 Source MSSQL: Added support for connection via SSH tunnels (#5966) (#6318)
* 🎉 Source MSSQL: Added support for connection via SSH tunnels (#5966)

* 🎉 Source MSSQL: Added support for connection via SSH tunnels (#5966)
updated image version

* 🎉 Source MSSQL: Added support for connection via SSH tunnels (#5966)
correction of remarks

* 🎉 Source MSSQL: Added support for connection via SSH tunnels (#5966)
bumb image version
2021-09-21 17:25:04 +03:00
midavadim
12cb3e3f9f 🎉 Source greenhouse: added identification of accessible streams for API keys with limited permissions (#6238)
* Added identification of accessible streams for API keys with limited permissions

* added credentials for API key with limited permissions (for user stream only)

* update docs and image version

* updated error message

* fixed formatting
2021-09-21 15:02:12 +03:00
Eugene
11f64882a9 🎉Source MySQl - Added support for connection via ssh (aka bastion server) (#6146)
* Source MySQL - Added ssh support
2021-09-21 10:57:31 +03:00
Jenny Brown
a9aba9c1c7 Create secrets manager API against Google Secrets store, feature flag (#6113)
* Create secrets manager API against Google Secrets store, plus feature flag on use.
* Run integration test at the right time, with config, for secrets persistence.
* Provide credentials for google secrets store access to tests
* Separate out secrets persistence test from kube for stability
2021-09-17 10:52:33 -05:00
Davin Chia
8094a1da08 Format. (#6214)
* Format.

* Add docker-compose back.
2021-09-17 21:41:43 +08:00
Jonathan Stacks
fe460ce83c 🎉 Create a Helm Chart For Airbyte (#5891)
See number #1868. This creates an initial helm chart for installing Airbyte in Kubernetes to make it easier for users who are more familiar with helm. It also includes GitHub actions to help continually test that the chart works in the most basic case.
All of the templates are based off of the kustomize folder, but minio and postgres have been removed in favor of adding the bitnami helm charts as dependencies since they have an active community and allow easily tweaking their install.
2021-09-17 13:21:16 +08:00
Dmytro
7a6da86baa add coverage report (#6045)
Co-authored-by: Dmytro Rezchykov <dmitry.rezchykov@zazmic.com>
2021-09-15 10:50:07 +03:00