1
0
mirror of synced 2025-12-25 11:06:55 -05:00
Commit Graph

76 Commits

Author SHA1 Message Date
Serhii Chvaliuk
8e6fb793bb Source Github: Use default behaviour, retry on 429 and all 5XX errors (#17852)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-10-12 11:35:42 +03:00
Serhii Chvaliuk
f4374530e5 Source Github: improve 502 handling for comments stream (#17715)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-10-07 14:58:31 +03:00
Evan Tahler
49cb3360de Remove redundant title labels from connector specs (#17544)
* Remove redundant title labels from connector specs

* Manually update specs

* add env variable

* Remove debugging log
2022-10-05 12:58:38 -07:00
Serhii Chvaliuk
8b4f65de9e Source Github: Skip repository if got HTTP 500 for WorkflowRuns stream (#17555)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-10-04 21:50:20 +03:00
Serhii Chvaliuk
a338df1040 🐛 Source Github: bugfix WorkflowJobs stream (#17287)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-09-30 14:45:25 +03:00
Denys Davydov
57c269d9c6 Source github: improve error logging (#16947)
* #410 oncall source github: improve error logging

* source github: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-21 23:16:40 +03:00
Mainara Cavalcanti
97b9c74718 Source Github: add workflow_jobs stream (#16534)
* feat(workflow-jobs)!: new class 'WorkflowJobs' to get job informations from Github;

* feat(workflow-jobs)!: unit test to new class 'WorkflowJobs';

* feat(test_stream/test_stream_workflow_jobs_read_incremental)!: support to method incremetal in unit test to class 'WorkflowJobs';

* feat(test_workflow): unit test incremental and full refresh to class 'WorkflowJobs';

* docs: updated github docs

* docs: updated github docs

* docs: updated github.md

* docs: updated github.md

* fix: add workflow_jobs in abnormal tests, use 'start date' in source and unit test;

* fix: add workflow_jobs in 'abnormal_state.json' and 'sample_state.json' for integration tests;

Co-authored-by: Paulo Roberto <paulo.rb.beserra@gmail.com>
Co-authored-by: Paulo Roberto <71179739+py-paulo@users.noreply.github.com>
2022-09-21 10:19:35 -04:00
Serhii Chvaliuk
255a5bbd5e 🐛 Source Github: validate input organizations and repositories (#15730)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-08-20 00:48:33 +03:00
Cameron Yick
9d44dc205b 🐛 Source Github: handle case where user is None (#15420)
* fix(source-github): handle case where user is None

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-08-12 10:29:13 +03:00
Serhii Chvaliuk
ae58fa52da 🎉 Source Github: PullRequestCommentReactions - re-implemented using GraphQL (#14795)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-08-02 14:57:27 +03:00
Serhii Chvaliuk
67333aa3bc 🎉 Source Github: bugfix schemas for streams deployments, workflow_runs, teams (#15049)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-07-30 00:51:50 +03:00
Serhii Chvaliuk
67dc38b014 🎉 Source Github: improve schema for stream pull_request_commits added "null" (#14613)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-07-12 16:17:19 +03:00
Serhii Chvaliuk
38d8d60f02 🎉 Source Github: add Retry for GraphQL API Resource limitations (#14376)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-07-05 00:37:39 +03:00
Serhii Chvaliuk
05e505d1af Revert "🎉 Source Github: rename field mergeable to is_mergeable (#14274)" (#14338)
* Revert "🎉 Source Github: rename field `mergeable` to `is_mergeable` (#14274)"
2022-07-02 02:19:29 +03:00
Serhii Chvaliuk
2fa29a2ca4 🎉 Source Github: rename field mergeable to is_mergeable (#14274)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-30 20:09:39 +03:00
Serhii Chvaliuk
4072d46a7c 🎉 Source Github: use GraphQL for reviews stream (#13989)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-28 18:35:12 +03:00
Serhii Chvaliuk
7a15f2d4a5 🎉 Source Github: secondary rate limits has to retry (#13955)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-27 23:36:20 +03:00
Serhii Chvaliuk
f69a78c9a4 🎉 Source Github: break point added for workflows_runs stream (#13926)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-22 11:49:04 +03:00
Serhii Chvaliuk
62626ee690 🎉 Source Github: use GraphQL for pull_request_stats stream (#13763)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-16 20:18:49 +03:00
Serhii Chvaliuk
dd8aa06664 🎉 Source Github: Fix API sorting, fix get_starting_point caching (#13707)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-15 16:50:42 +03:00
Serhii Chvaliuk
9a4582ad7d 🐛 Source Github: enable caching only for parent streams (#13558)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-09 07:21:10 +03:00
Serhii Chvaliuk
38fa0fa8b3 🐛 Source Github: improve docs for GA (#13593)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-08 20:19:11 +03:00
Serhii Chvaliuk
5444317513 🐛 Source Github: fix different result from get_starting_point when reading by pages (#13531)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-08 20:06:06 +03:00
Serhii Chvaliuk
c10a268bde 🐛 Source Github: add incremental for WorkflowRuns (#13115)
* add incremental for `workflowruns`

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-05-27 21:01:28 +03:00
Marcos Marx
dca2256a7c Bump 2022 license version (#13233)
* Bump year in license short to 2022

* remove protocol from cdk
2022-05-26 15:00:42 -03:00
Serhii Chvaliuk
8c394b3734 🐛 Source Github: add incremental for repositories, workflows, pull_request_comment_reactions, issue_reactions, issue_comment_reactions, commit_comment_reactions (#12294)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-05-13 21:18:24 +03:00
Andy
5aed8e2147 Update connector specs (#12482) 2022-05-04 22:44:44 -07:00
Serhii Chvaliuk
8cf45693b1 🐛 Source Github: add new streams TeamMembers, TeamMemberships (#11893)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-04-21 18:50:56 +03:00
Serhii Chvaliuk
77eca9f630 Source Github: Fix "PAT Credentials" in spec (#11678)
* Fix "PAT Credentials" in spec

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-04-04 23:59:57 +03:00
Serhii Chvaliuk
e9946c9be3 Source Github: re-implement incremental for reviews stream (#11623)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-04-02 01:11:19 +03:00
Serhii Chvaliuk
b75295a368 Source Github: get_updated_state problem on reviews stream (#11567)
* Improve error handling for `reviews` stream

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-03-31 11:05:54 +03:00
Amin Bz
a203d685b3 🎉 Source Github: add 2 new streams (workflows, workflow runs) (#9251)
* 3 new streams to the github api and adding task_id in the stories stream for the connector asana

* pull request update bump version GitHub Asana

* correct schema

* remove changes on asana connector - moved to another pull request

* security alert stream add variable

* bump version github

* fix schema

* fix schemad

* solve conflic

* correct teams stream

* remove stream and fix some files

* remove config catalog

* correct schema

* solve fb conflict

* solve final conflict with files

* correct github streams

* correct assignes in config_catalog

* update docs and bump connector version

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2022-03-30 20:53:16 -03:00
Serhii Chvaliuk
05605c6729 🐛 Source Github: improve docs & spec for BETA (#11212)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2022-03-24 21:55:36 +02:00
Serhii Chvaliuk
0f475ce6ff 🐛 Source Github: test coverage more than 90% (#10967)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-03-19 13:14:53 +02:00
Davin Chia
5a575e42e0 Format connectors. (#11231) 2022-03-17 19:08:01 +08:00
Serhii Chvaliuk
d19754c169 🐛 Source Github: Fix error handling for 404 streams (#10878)
* Fix, no error if "Projects" feature is disabled
* improve requests.codes.NOT_FOUND

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-03-10 18:02:51 +02:00
Serhii Chvaliuk
1bf94704fc 🐛 Source Github: add new stream ProjectCards (#10766)
* add new stream `Deployments`

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-03-10 11:01:51 +02:00
Serhii Chvaliuk
b2aa69574c 🐛 Source Github: add new streams Deployments, ProjectColumns, PullRequestCommits (#10385)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-03-03 21:07:17 +02:00
Marcos Marx
3288227863 format files (#10511) 2022-02-21 17:29:34 -03:00
midavadim
ef4221784e 🎉 Source GitHub - added more meaningful error description for connector check (#10211)
* added human-readable errors in case of incorrect organization or repo names

* added change history

* added change history

* bumped github image version

* bumped github image version in source_specs.yaml file
2022-02-14 15:02:40 +02:00
Yevhenii
f01b0c769f 🎉 Source Github: add handling the secondary rate limits (#10193)
* Source Github: add handling the secondary rate limits
2022-02-09 15:26:53 +02:00
Anna Lvova
8749c7ab2c 🐛Source Github: remove BAD_GATEWAY code from backoff_time (#9999)
* remove BAD_GATEWAY code from backoff_time

* bump version

* bump version

* add unit test

* bump version
2022-02-09 12:10:16 +02:00
Baz
981df9c4ed 🐛 Source Github: log the error message for streams that are restricted for OAuth (#9868) 2022-02-02 14:12:47 +02:00
LiRen Tu
a094142825 Format code (#9892) 2022-01-29 19:56:00 -08:00
Marcos Marx
9efa44f9d7 Source Github: correct spec + bump connector version (#9580)
* correct spec + bump connector version

* Update Dockerfile
2022-01-26 17:12:04 -03:00
Brian Leonard
eafaadfd69 GitHub Source: add fields for auto merge in pull_request stream (#9802)
* github schema

* GitHub dockerfile

* formatted

* 🎉Source HubSpot: Adds form_submission and property_history streams (#7787)

* Began working on HubSpot Form Submission Connector

* Added Property History Stream

* Added form_guid to as value to form_submissions_stream.

* Finalized the Form Submission Stream

* Added documentation and test config

* Corrected Version Number

* updated version number to 0.1.25

* removed or none worked on tests

* Changed code due to review comments & merges

* readded Propertyhistory after merging

* bump connector version

Co-authored-by: Tino Merl <tino.merl@park-sieben.com>
Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>

* bump connector version

Co-authored-by: Tino Merl <35485536+tinomerl@users.noreply.github.com>
Co-authored-by: Tino Merl <tino.merl@park-sieben.com>
Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2022-01-26 17:01:16 -03:00
Yevhenii
2ddf0bcf65 🐛 Source Github: add custom pagination size for large streams (#9664)
* Source Github: add custom pagination size for large streams
2022-01-21 15:22:16 +02:00
Yevhenii
28b174ce39 Fix logger for function 'should_retry' (#9619)
* Fix logging for function 'should_retry'
2022-01-19 22:32:48 +02:00
Yevhenii
cb6d9abcab 🐛 Source Github: Remove optional parameter Accept for reaction's streams to fix error with 502 HTTP status code (#9492)
* Source Github: Remove optional parameter Accept for reaction's streams to fix error with 502 HTTP status code
2022-01-17 15:21:35 +02:00
Chris Wu
5b6b48ca10 🎉 Source GitHub: Use CDK caching and convert PR-related streams to incremental (#7250)
* Source GitHub: Use CDK caching and convert PR-related streams to incremental

* Remove extra change

* Consolidate

* Address comments

* Fix integration test config

* Fix merge

* Update sample state

* Bump release version

* Bump version

* Address feedback

* Bump version

* Fix formatting
2022-01-06 19:50:15 -03:00