jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-20 10:32:35 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,867 Commits 5,109 Branches 518 Tags
master
Commit Graph

97 Commits

Author SHA1 Message Date
Serhii Chvaliuk
05e505d1af Revert "🎉 Source Github: rename field mergeable to is_mergeable (#14274)" (#14338) 
* Revert "🎉 Source Github: rename field `mergeable` to `is_mergeable` (#14274)"
 2022-07-02 02:19:29 +03:00
Serhii Chvaliuk
2fa29a2ca4 🎉 Source Github: rename field mergeable to is_mergeable (#14274) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-06-30 20:09:39 +03:00
Serhii Chvaliuk
4072d46a7c 🎉 Source Github: use GraphQL for reviews stream (#13989) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-06-28 18:35:12 +03:00
Serhii Chvaliuk
7a15f2d4a5 🎉 Source Github: secondary rate limits has to retry (#13955) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-06-27 23:36:20 +03:00
Serhii Chvaliuk
f69a78c9a4 🎉 Source Github: break point added for workflows_runs stream (#13926) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-06-22 11:49:04 +03:00
Serhii Chvaliuk
62626ee690 🎉 Source Github: use GraphQL for pull_request_stats stream (#13763) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-06-16 20:18:49 +03:00
Serhii Chvaliuk
dd8aa06664 🎉 Source Github: Fix API sorting, fix get_starting_point caching (#13707) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-06-15 16:50:42 +03:00
Serhii Chvaliuk
9a4582ad7d 🐛 Source Github: enable caching only for parent streams (#13558) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-06-09 07:21:10 +03:00
Serhii Chvaliuk
38fa0fa8b3 🐛 Source Github: improve docs for GA (#13593) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-06-08 20:19:11 +03:00
Serhii Chvaliuk
5444317513 🐛 Source Github: fix different result from get_starting_point when reading by pages (#13531) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-06-08 20:06:06 +03:00
Serhii Chvaliuk
c10a268bde 🐛 Source Github: add incremental for WorkflowRuns (#13115) 
* add incremental for `workflowruns`

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-05-27 21:01:28 +03:00
Marcos Marx
dca2256a7c Bump 2022 license version (#13233) 
* Bump year in license short to 2022

* remove protocol from cdk
 2022-05-26 15:00:42 -03:00
Serhii Chvaliuk
8c394b3734 🐛 Source Github: add incremental for repositories, workflows, pull_request_comment_reactions, issue_reactions, issue_comment_reactions, commit_comment_reactions (#12294) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-05-13 21:18:24 +03:00
Serhii Chvaliuk
8cf45693b1 🐛 Source Github: add new streams TeamMembers, TeamMemberships (#11893) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-04-21 18:50:56 +03:00
Serhii Chvaliuk
e9946c9be3 Source Github: re-implement incremental for reviews stream (#11623) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-04-02 01:11:19 +03:00
Serhii Chvaliuk
b75295a368 Source Github: get_updated_state problem on reviews stream (#11567) 
* Improve error handling for `reviews` stream

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-03-31 11:05:54 +03:00
Amin Bz
a203d685b3 🎉 Source Github: add 2 new streams (workflows, workflow runs) (#9251) 
* 3 new streams to the github api and adding task_id in the stories stream for the connector asana

* pull request update bump version GitHub Asana

* correct schema

* remove changes on asana connector - moved to another pull request

* security alert stream add variable

* bump version github

* fix schema

* fix schemad

* solve conflic

* correct teams stream

* remove stream and fix some files

* remove config catalog

* correct schema

* solve fb conflict

* solve final conflict with files

* correct github streams

* correct assignes in config_catalog

* update docs and bump connector version

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
 2022-03-30 20:53:16 -03:00
Serhii Chvaliuk
0f475ce6ff 🐛 Source Github: test coverage more than 90% (#10967) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-03-19 13:14:53 +02:00
Davin Chia
5a575e42e0 Format connectors. (#11231) 2022-03-17 19:08:01 +08:00
Serhii Chvaliuk
d19754c169 🐛 Source Github: Fix error handling for 404 streams (#10878) 
* Fix, no error if "Projects" feature is disabled
* improve requests.codes.NOT_FOUND

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-03-10 18:02:51 +02:00
Serhii Chvaliuk
1bf94704fc 🐛 Source Github: add new stream ProjectCards (#10766) 
* add new stream `Deployments`

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-03-10 11:01:51 +02:00
Serhii Chvaliuk
b2aa69574c 🐛 Source Github: add new streams Deployments, ProjectColumns, PullRequestCommits (#10385) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-03-03 21:07:17 +02:00
Yevhenii
f01b0c769f 🎉 Source Github: add handling the secondary rate limits (#10193) 
* Source Github: add handling the secondary rate limits
 2022-02-09 15:26:53 +02:00
Anna Lvova
8749c7ab2c 🐛Source Github: remove BAD_GATEWAY code from backoff_time (#9999) 
* remove BAD_GATEWAY code from backoff_time

* bump version

* bump version

* add unit test

* bump version
 2022-02-09 12:10:16 +02:00
Baz
981df9c4ed 🐛 Source Github: log the error message for streams that are restricted for OAuth (#9868) 2022-02-02 14:12:47 +02:00
Yevhenii
2ddf0bcf65 🐛 Source Github: add custom pagination size for large streams (#9664) 
* Source Github: add custom pagination size for large streams
 2022-01-21 15:22:16 +02:00
Yevhenii
28b174ce39 Fix logger for function 'should_retry' (#9619) 
* Fix logging for function 'should_retry'
 2022-01-19 22:32:48 +02:00
Yevhenii
cb6d9abcab 🐛 Source Github: Remove optional parameter Accept for reaction's streams to fix error with 502 HTTP status code (#9492) 
* Source Github: Remove optional parameter Accept for reaction's streams to fix error with 502 HTTP status code
 2022-01-17 15:21:35 +02:00
Chris Wu
5b6b48ca10 🎉 Source GitHub: Use CDK caching and convert PR-related streams to incremental (#7250) 
* Source GitHub: Use CDK caching and convert PR-related streams to incremental

* Remove extra change

* Consolidate

* Address comments

* Fix integration test config

* Fix merge

* Update sample state

* Bump release version

* Bump version

* Address feedback

* Bump version

* Fix formatting
 2022-01-06 19:50:15 -03:00
Dmytro
11553ec828 Source github: Use default retry backoff on server errors (#9179) 2021-12-29 13:36:32 +02:00
augan-rymkhan
10f1b58d66 Source Github: Retry connection using HTTPAdapter (#8518) 
* retry connection with Github using HTTPAdapter

* updated the connector version

* updated source def and spec yaml

Co-authored-by: Auganbay <auganenu@gmail.com>
 2021-12-08 12:40:16 +06:00
Baz
a4a5cb8893 🐛 Source Stripe: Rearrange setup fields (#8250) 2021-11-26 16:06:30 +02:00
Yevhenii
96581f12af Publish PR #8030 (#8233) 
* Source GitHub: define pull_request_stats and reviews streams as pull_request substreams
* Source GitHub: Bump version to 0.2.6
* Source GitHub: Apply PR review suggestions
Co-authored-by: Jérémy Lourenço <jeremy@lourenco.io>
 2021-11-24 16:56:25 +02:00
Michel Tricot
1773e41e47 Shorten our headers + adds contributors file (#6478) 2021-09-27 10:45:50 -07:00
Yevhenii
1644f9016a 🎉 Source GitHub: Add option to pull commits from user-specified branches (#6223) 
* Add option to pull commits from user-specified branches

* Address comments part 1

* Fix Repositories stream error when repo is not part of an org

* Make compatible with old state version and fix request_params to use branch-specific value

Co-authored-by: Chris Wu <chris@faros.ai>
 2021-09-22 11:56:23 +03:00
Chris Wu
3695170bc5 🐛 Source GitHub: Add error handling for streams that are not applicable to some repos (#6227) 2021-09-19 18:34:36 -07:00
Chris Wu
775bb03065 🎉 GitHub Source: Don't minimize output fields (#5898) 2021-09-19 18:34:10 -07:00
Yevhenii
8c127d8efe 🎉 Source Github: add caching for all streams (#5949) 
* Source Github: add checking for all streams

* bump version, update changelogs
 2021-09-15 16:59:00 +03:00
Yevhenii
9b71c28902 🎉 Source Github: add reaction streams (#5860) 
* Source Github: add reaction streams

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
 2021-09-09 13:13:29 +03:00
Yevhenii
441d7cde76 🐛 Source Github: handling empty repos, check method using RepositoryStats stream (#5788) 
* update error handling for empty repositories, update check method using RepositoryStats stream

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
 2021-09-02 16:31:44 +03:00
Yevhenii
d74c47a863 🎉Source GitHub: Add more streams (#5757) 
* Add Organizations stream to Github Source
* Add Repositories stream
* Add Repositories stream spec
* Add Branches stream
* Add Tags stream
* Add ReviewComments stream
* Add users stream
* Add pull request stats stream

Co-authored-by: Chris Wu <chris@faros.ai>
Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
 2021-09-01 15:02:08 +03:00
oleh.zorenko
61f3963f5e 🐛 Source GitHub: handle negative backoff values (#5696) 
* Handle negative backoff values + update docs

* Bump connector version to `0.1.7`
 2021-08-27 18:41:59 +03:00
Yevhenii
03e1ff96b8 🐛 Source Github: Fix set up validation (#5456) 
* Fix set up validation

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
 2021-08-18 16:03:58 +03:00
Yevhenii
05fd4e76f3 Source Github: Support syncing multiple repositories/organizations (#5136) 
Support syncing multiple repositories/organizations

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
 2021-08-13 16:24:24 +03:00
Oleksandr
0170822ccc 🎉 Source Github: Extend existing streams with user property (#5156) 
* Added User property to certain schemas, updated acceptance-tests, bumped versions

* Added changelog

* moved users.json to the schemas/shared

* add newline to user.json

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
 2021-08-05 11:40:06 +03:00
oleh.zorenko
b405c9c0be 🐛 Source GitHub: fix bug with IssueEvents stream and add handling for rate limiting (#4708) 
* Few updates for GitHub source

Set correct `cursor_field` for `IssueEvents` stream.
Add rate limit handling.
Add handling for 403 error.
Add handling for 502 error.

Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2021-07-14 20:49:01 -04:00
oleh.zorenko
84ba3e79b3 🎉 Native GitHub connector (#4174) 
* GitHub source initial version

All streams are in `full_refresh` mode only.

* Run format command

* Add handling for 404 error in Teams stream

* Update creds naming for github

* Update acceptance tests

* Update check_connection()

* Code review fixes

Remove `/integration_tests/catalog.json` file.
Use `Collaborators` class in `check_connection()` function.
Remove excessive data from GithubStream class.

* Remove unused import

* Implement requested changes

* Add incremental streams

* Remove `supports_incremental`

* Update docs

* Implement requested changes

* Implement requested changes

* Implement requested changes

* Bump connector version
 2021-07-06 17:06:34 +03:00