jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-21 02:51:29 -05:00
Code Issues Packages Projects Releases Wiki Activity
7,813 Commits 5,109 Branches 518 Tags
f4374530e57bc99c64bc7092fbf6adf3e7d3961d
Commit Graph

55 Commits

Author SHA1 Message Date
Serhii Chvaliuk
f4374530e5 Source Github: improve 502 handling for comments stream (#17715) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-10-07 14:58:31 +03:00
Serhii Chvaliuk
8b4f65de9e Source Github: Skip repository if got HTTP 500 for WorkflowRuns stream (#17555) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-10-04 21:50:20 +03:00
Serhii Chvaliuk
a338df1040 🐛 Source Github: bugfix WorkflowJobs stream (#17287) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-09-30 14:45:25 +03:00
Denys Davydov
57c269d9c6 Source github: improve error logging (#16947) 
* #410 oncall source github: improve error logging

* source github: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-09-21 23:16:40 +03:00
Mainara Cavalcanti
97b9c74718 Source Github: add workflow_jobs stream (#16534) 
* feat(workflow-jobs)!: new class 'WorkflowJobs' to get job informations from Github;

* feat(workflow-jobs)!: unit test to new class 'WorkflowJobs';

* feat(test_stream/test_stream_workflow_jobs_read_incremental)!: support to method incremetal in unit test to class 'WorkflowJobs';

* feat(test_workflow): unit test incremental and full refresh to class 'WorkflowJobs';

* docs: updated github docs

* docs: updated github docs

* docs: updated github.md

* docs: updated github.md

* fix: add workflow_jobs in abnormal tests, use 'start date' in source and unit test;

* fix: add workflow_jobs in 'abnormal_state.json' and 'sample_state.json' for integration tests;

Co-authored-by: Paulo Roberto <paulo.rb.beserra@gmail.com>
Co-authored-by: Paulo Roberto <71179739+py-paulo@users.noreply.github.com>
 2022-09-21 10:19:35 -04:00
Cameron Yick
9d44dc205b 🐛 Source Github: handle case where user is None (#15420) 
* fix(source-github): handle case where user is None

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-08-12 10:29:13 +03:00
Serhii Chvaliuk
ae58fa52da 🎉 Source Github: PullRequestCommentReactions - re-implemented using GraphQL (#14795) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-08-02 14:57:27 +03:00
Serhii Chvaliuk
38d8d60f02 🎉 Source Github: add Retry for GraphQL API Resource limitations (#14376) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-07-05 00:37:39 +03:00
Serhii Chvaliuk
05e505d1af Revert "🎉 Source Github: rename field mergeable to is_mergeable (#14274)" (#14338) 
* Revert "🎉 Source Github: rename field `mergeable` to `is_mergeable` (#14274)"
 2022-07-02 02:19:29 +03:00
Serhii Chvaliuk
2fa29a2ca4 🎉 Source Github: rename field mergeable to is_mergeable (#14274) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-06-30 20:09:39 +03:00
Serhii Chvaliuk
4072d46a7c 🎉 Source Github: use GraphQL for reviews stream (#13989) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-06-28 18:35:12 +03:00
Serhii Chvaliuk
7a15f2d4a5 🎉 Source Github: secondary rate limits has to retry (#13955) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-06-27 23:36:20 +03:00
Serhii Chvaliuk
f69a78c9a4 🎉 Source Github: break point added for workflows_runs stream (#13926) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-06-22 11:49:04 +03:00
Serhii Chvaliuk
62626ee690 🎉 Source Github: use GraphQL for pull_request_stats stream (#13763) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-06-16 20:18:49 +03:00
Serhii Chvaliuk
dd8aa06664 🎉 Source Github: Fix API sorting, fix get_starting_point caching (#13707) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-06-15 16:50:42 +03:00
Serhii Chvaliuk
9a4582ad7d 🐛 Source Github: enable caching only for parent streams (#13558) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-06-09 07:21:10 +03:00
Serhii Chvaliuk
38fa0fa8b3 🐛 Source Github: improve docs for GA (#13593) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-06-08 20:19:11 +03:00
Serhii Chvaliuk
5444317513 🐛 Source Github: fix different result from get_starting_point when reading by pages (#13531) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-06-08 20:06:06 +03:00
Serhii Chvaliuk
c10a268bde 🐛 Source Github: add incremental for WorkflowRuns (#13115) 
* add incremental for `workflowruns`

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-05-27 21:01:28 +03:00
Marcos Marx
dca2256a7c Bump 2022 license version (#13233) 
* Bump year in license short to 2022

* remove protocol from cdk
 2022-05-26 15:00:42 -03:00
Serhii Chvaliuk
8c394b3734 🐛 Source Github: add incremental for repositories, workflows, pull_request_comment_reactions, issue_reactions, issue_comment_reactions, commit_comment_reactions (#12294) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-05-13 21:18:24 +03:00
Serhii Chvaliuk
8cf45693b1 🐛 Source Github: add new streams TeamMembers, TeamMemberships (#11893) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-04-21 18:50:56 +03:00
Serhii Chvaliuk
e9946c9be3 Source Github: re-implement incremental for reviews stream (#11623) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-04-02 01:11:19 +03:00
Serhii Chvaliuk
b75295a368 Source Github: get_updated_state problem on reviews stream (#11567) 
* Improve error handling for `reviews` stream

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-03-31 11:05:54 +03:00
Amin Bz
a203d685b3 🎉 Source Github: add 2 new streams (workflows, workflow runs) (#9251) 
* 3 new streams to the github api and adding task_id in the stories stream for the connector asana

* pull request update bump version GitHub Asana

* correct schema

* remove changes on asana connector - moved to another pull request

* security alert stream add variable

* bump version github

* fix schema

* fix schemad

* solve conflic

* correct teams stream

* remove stream and fix some files

* remove config catalog

* correct schema

* solve fb conflict

* solve final conflict with files

* correct github streams

* correct assignes in config_catalog

* update docs and bump connector version

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
 2022-03-30 20:53:16 -03:00
Serhii Chvaliuk
0f475ce6ff 🐛 Source Github: test coverage more than 90% (#10967) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-03-19 13:14:53 +02:00
Davin Chia
5a575e42e0 Format connectors. (#11231) 2022-03-17 19:08:01 +08:00
Serhii Chvaliuk
d19754c169 🐛 Source Github: Fix error handling for 404 streams (#10878) 
* Fix, no error if "Projects" feature is disabled
* improve requests.codes.NOT_FOUND

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-03-10 18:02:51 +02:00
Serhii Chvaliuk
1bf94704fc 🐛 Source Github: add new stream ProjectCards (#10766) 
* add new stream `Deployments`

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-03-10 11:01:51 +02:00
Serhii Chvaliuk
b2aa69574c 🐛 Source Github: add new streams Deployments, ProjectColumns, PullRequestCommits (#10385) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-03-03 21:07:17 +02:00
Yevhenii
f01b0c769f 🎉 Source Github: add handling the secondary rate limits (#10193) 
* Source Github: add handling the secondary rate limits
 2022-02-09 15:26:53 +02:00
Anna Lvova
8749c7ab2c 🐛Source Github: remove BAD_GATEWAY code from backoff_time (#9999) 
* remove BAD_GATEWAY code from backoff_time

* bump version

* bump version

* add unit test

* bump version
 2022-02-09 12:10:16 +02:00
Baz
981df9c4ed 🐛 Source Github: log the error message for streams that are restricted for OAuth (#9868) 2022-02-02 14:12:47 +02:00
Yevhenii
2ddf0bcf65 🐛 Source Github: add custom pagination size for large streams (#9664) 
* Source Github: add custom pagination size for large streams
 2022-01-21 15:22:16 +02:00
Yevhenii
28b174ce39 Fix logger for function 'should_retry' (#9619) 
* Fix logging for function 'should_retry'
 2022-01-19 22:32:48 +02:00
Yevhenii
cb6d9abcab 🐛 Source Github: Remove optional parameter Accept for reaction's streams to fix error with 502 HTTP status code (#9492) 
* Source Github: Remove optional parameter Accept for reaction's streams to fix error with 502 HTTP status code
 2022-01-17 15:21:35 +02:00
Chris Wu
5b6b48ca10 🎉 Source GitHub: Use CDK caching and convert PR-related streams to incremental (#7250) 
* Source GitHub: Use CDK caching and convert PR-related streams to incremental

* Remove extra change

* Consolidate

* Address comments

* Fix integration test config

* Fix merge

* Update sample state

* Bump release version

* Bump version

* Address feedback

* Bump version

* Fix formatting
 2022-01-06 19:50:15 -03:00
Dmytro
11553ec828 Source github: Use default retry backoff on server errors (#9179) 2021-12-29 13:36:32 +02:00
augan-rymkhan
10f1b58d66 Source Github: Retry connection using HTTPAdapter (#8518) 
* retry connection with Github using HTTPAdapter

* updated the connector version

* updated source def and spec yaml

Co-authored-by: Auganbay <auganenu@gmail.com>
 2021-12-08 12:40:16 +06:00
Baz
a4a5cb8893 🐛 Source Stripe: Rearrange setup fields (#8250) 2021-11-26 16:06:30 +02:00
Yevhenii
96581f12af Publish PR #8030 (#8233) 
* Source GitHub: define pull_request_stats and reviews streams as pull_request substreams
* Source GitHub: Bump version to 0.2.6
* Source GitHub: Apply PR review suggestions
Co-authored-by: Jérémy Lourenço <jeremy@lourenco.io>
 2021-11-24 16:56:25 +02:00
Michel Tricot
1773e41e47 Shorten our headers + adds contributors file (#6478) 2021-09-27 10:45:50 -07:00
Yevhenii
1644f9016a 🎉 Source GitHub: Add option to pull commits from user-specified branches (#6223) 
* Add option to pull commits from user-specified branches

* Address comments part 1

* Fix Repositories stream error when repo is not part of an org

* Make compatible with old state version and fix request_params to use branch-specific value

Co-authored-by: Chris Wu <chris@faros.ai>
 2021-09-22 11:56:23 +03:00
Chris Wu
3695170bc5 🐛 Source GitHub: Add error handling for streams that are not applicable to some repos (#6227) 2021-09-19 18:34:36 -07:00
Chris Wu
775bb03065 🎉 GitHub Source: Don't minimize output fields (#5898) 2021-09-19 18:34:10 -07:00
Yevhenii
8c127d8efe 🎉 Source Github: add caching for all streams (#5949) 
* Source Github: add checking for all streams

* bump version, update changelogs
 2021-09-15 16:59:00 +03:00
Yevhenii
9b71c28902 🎉 Source Github: add reaction streams (#5860) 
* Source Github: add reaction streams

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
 2021-09-09 13:13:29 +03:00
Yevhenii
441d7cde76 🐛 Source Github: handling empty repos, check method using RepositoryStats stream (#5788) 
* update error handling for empty repositories, update check method using RepositoryStats stream

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
 2021-09-02 16:31:44 +03:00
Yevhenii
d74c47a863 🎉Source GitHub: Add more streams (#5757) 
* Add Organizations stream to Github Source
* Add Repositories stream
* Add Repositories stream spec
* Add Branches stream
* Add Tags stream
* Add ReviewComments stream
* Add users stream
* Add pull request stats stream

Co-authored-by: Chris Wu <chris@faros.ai>
Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
 2021-09-01 15:02:08 +03:00
oleh.zorenko
61f3963f5e 🐛 Source GitHub: handle negative backoff values (#5696) 
* Handle negative backoff values + update docs

* Bump connector version to `0.1.7`
 2021-08-27 18:41:59 +03:00