1
0
mirror of synced 2025-12-21 19:11:14 -05:00
Commit Graph

280 Commits

Author SHA1 Message Date
Serhii Chvaliuk
ae58fa52da 🎉 Source Github: PullRequestCommentReactions - re-implemented using GraphQL (#14795)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-08-02 14:57:27 +03:00
Serhii Chvaliuk
67333aa3bc 🎉 Source Github: bugfix schemas for streams deployments, workflow_runs, teams (#15049)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-07-30 00:51:50 +03:00
Serhii Chvaliuk
67dc38b014 🎉 Source Github: improve schema for stream pull_request_commits added "null" (#14613)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-07-12 16:17:19 +03:00
Serhii Chvaliuk
38d8d60f02 🎉 Source Github: add Retry for GraphQL API Resource limitations (#14376)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-07-05 00:37:39 +03:00
Serhii Chvaliuk
05e505d1af Revert "🎉 Source Github: rename field mergeable to is_mergeable (#14274)" (#14338)
* Revert "🎉 Source Github: rename field `mergeable` to `is_mergeable` (#14274)"
2022-07-02 02:19:29 +03:00
Serhii Chvaliuk
2fa29a2ca4 🎉 Source Github: rename field mergeable to is_mergeable (#14274)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-30 20:09:39 +03:00
Serhii Chvaliuk
4072d46a7c 🎉 Source Github: use GraphQL for reviews stream (#13989)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-28 18:35:12 +03:00
Serhii Chvaliuk
7a15f2d4a5 🎉 Source Github: secondary rate limits has to retry (#13955)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-27 23:36:20 +03:00
Serhii Chvaliuk
f69a78c9a4 🎉 Source Github: break point added for workflows_runs stream (#13926)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-22 11:49:04 +03:00
Serhii Chvaliuk
62626ee690 🎉 Source Github: use GraphQL for pull_request_stats stream (#13763)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-16 20:18:49 +03:00
Serhii Chvaliuk
dd8aa06664 🎉 Source Github: Fix API sorting, fix get_starting_point caching (#13707)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-15 16:50:42 +03:00
Serhii Chvaliuk
9a4582ad7d 🐛 Source Github: enable caching only for parent streams (#13558)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-09 07:21:10 +03:00
Serhii Chvaliuk
38fa0fa8b3 🐛 Source Github: improve docs for GA (#13593)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-08 20:19:11 +03:00
Serhii Chvaliuk
5444317513 🐛 Source Github: fix different result from get_starting_point when reading by pages (#13531)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-08 20:06:06 +03:00
Serhii Chvaliuk
c10a268bde 🐛 Source Github: add incremental for WorkflowRuns (#13115)
* add incremental for `workflowruns`

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-05-27 21:01:28 +03:00
Marcos Marx
dca2256a7c Bump 2022 license version (#13233)
* Bump year in license short to 2022

* remove protocol from cdk
2022-05-26 15:00:42 -03:00
Serhii Chvaliuk
8c394b3734 🐛 Source Github: add incremental for repositories, workflows, pull_request_comment_reactions, issue_reactions, issue_comment_reactions, commit_comment_reactions (#12294)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-05-13 21:18:24 +03:00
Andy
5aed8e2147 Update connector specs (#12482) 2022-05-04 22:44:44 -07:00
Serhii Chvaliuk
8cf45693b1 🐛 Source Github: add new streams TeamMembers, TeamMemberships (#11893)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-04-21 18:50:56 +03:00
Brian Leonard
c302af45ff Upgrade to Python 3.9 (#11763)
* Dockerfile to 3.9

* Python version

* More python updates

* 3.9 on GitHub actions and lint updates

* Test out 3.9.11 on GitHub actions

* install python with an action

* formatting: newline

* Also has python code

* only check first level for changed modules
Previous example (source-google-search-console/credentials)

* Test failure: there is no logger.trace
2022-04-11 20:51:37 -07:00
Serhii Chvaliuk
77eca9f630 Source Github: Fix "PAT Credentials" in spec (#11678)
* Fix "PAT Credentials" in spec

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-04-04 23:59:57 +03:00
Serhii Chvaliuk
e9946c9be3 Source Github: re-implement incremental for reviews stream (#11623)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-04-02 01:11:19 +03:00
Serhii Chvaliuk
b75295a368 Source Github: get_updated_state problem on reviews stream (#11567)
* Improve error handling for `reviews` stream

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-03-31 11:05:54 +03:00
Amin Bz
a203d685b3 🎉 Source Github: add 2 new streams (workflows, workflow runs) (#9251)
* 3 new streams to the github api and adding task_id in the stories stream for the connector asana

* pull request update bump version GitHub Asana

* correct schema

* remove changes on asana connector - moved to another pull request

* security alert stream add variable

* bump version github

* fix schema

* fix schemad

* solve conflic

* correct teams stream

* remove stream and fix some files

* remove config catalog

* correct schema

* solve fb conflict

* solve final conflict with files

* correct github streams

* correct assignes in config_catalog

* update docs and bump connector version

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2022-03-30 20:53:16 -03:00
Serhii Chvaliuk
05605c6729 🐛 Source Github: improve docs & spec for BETA (#11212)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2022-03-24 21:55:36 +02:00
Serhii Chvaliuk
0f475ce6ff 🐛 Source Github: test coverage more than 90% (#10967)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-03-19 13:14:53 +02:00
Davin Chia
5a575e42e0 Format connectors. (#11231) 2022-03-17 19:08:01 +08:00
Serhii Chvaliuk
d19754c169 🐛 Source Github: Fix error handling for 404 streams (#10878)
* Fix, no error if "Projects" feature is disabled
* improve requests.codes.NOT_FOUND

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-03-10 18:02:51 +02:00
Serhii Chvaliuk
1bf94704fc 🐛 Source Github: add new stream ProjectCards (#10766)
* add new stream `Deployments`

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-03-10 11:01:51 +02:00
Serhii Chvaliuk
b2aa69574c 🐛 Source Github: add new streams Deployments, ProjectColumns, PullRequestCommits (#10385)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-03-03 21:07:17 +02:00
Marcos Marx
3288227863 format files (#10511) 2022-02-21 17:29:34 -03:00
midavadim
ef4221784e 🎉 Source GitHub - added more meaningful error description for connector check (#10211)
* added human-readable errors in case of incorrect organization or repo names

* added change history

* added change history

* bumped github image version

* bumped github image version in source_specs.yaml file
2022-02-14 15:02:40 +02:00
Yevhenii
f01b0c769f 🎉 Source Github: add handling the secondary rate limits (#10193)
* Source Github: add handling the secondary rate limits
2022-02-09 15:26:53 +02:00
Anna Lvova
8749c7ab2c 🐛Source Github: remove BAD_GATEWAY code from backoff_time (#9999)
* remove BAD_GATEWAY code from backoff_time

* bump version

* bump version

* add unit test

* bump version
2022-02-09 12:10:16 +02:00
Baz
981df9c4ed 🐛 Source Github: log the error message for streams that are restricted for OAuth (#9868) 2022-02-02 14:12:47 +02:00
LiRen Tu
a094142825 Format code (#9892) 2022-01-29 19:56:00 -08:00
Marcos Marx
9efa44f9d7 Source Github: correct spec + bump connector version (#9580)
* correct spec + bump connector version

* Update Dockerfile
2022-01-26 17:12:04 -03:00
Brian Leonard
eafaadfd69 GitHub Source: add fields for auto merge in pull_request stream (#9802)
* github schema

* GitHub dockerfile

* formatted

* 🎉Source HubSpot: Adds form_submission and property_history streams (#7787)

* Began working on HubSpot Form Submission Connector

* Added Property History Stream

* Added form_guid to as value to form_submissions_stream.

* Finalized the Form Submission Stream

* Added documentation and test config

* Corrected Version Number

* updated version number to 0.1.25

* removed or none worked on tests

* Changed code due to review comments & merges

* readded Propertyhistory after merging

* bump connector version

Co-authored-by: Tino Merl <tino.merl@park-sieben.com>
Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>

* bump connector version

Co-authored-by: Tino Merl <35485536+tinomerl@users.noreply.github.com>
Co-authored-by: Tino Merl <tino.merl@park-sieben.com>
Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2022-01-26 17:01:16 -03:00
Yevhenii
961f2f6caf 🎉 Codecov: Implement Codecove into Sonar (#9666)
* Implement Codecov into Sonar config
2022-01-23 20:08:25 +02:00
Yevhenii
2ddf0bcf65 🐛 Source Github: add custom pagination size for large streams (#9664)
* Source Github: add custom pagination size for large streams
2022-01-21 15:22:16 +02:00
Yevhenii
28b174ce39 Fix logger for function 'should_retry' (#9619)
* Fix logging for function 'should_retry'
2022-01-19 22:32:48 +02:00
Yevhenii
cb6d9abcab 🐛 Source Github: Remove optional parameter Accept for reaction's streams to fix error with 502 HTTP status code (#9492)
* Source Github: Remove optional parameter Accept for reaction's streams to fix error with 502 HTTP status code
2022-01-17 15:21:35 +02:00
Chris Wu
5b6b48ca10 🎉 Source GitHub: Use CDK caching and convert PR-related streams to incremental (#7250)
* Source GitHub: Use CDK caching and convert PR-related streams to incremental

* Remove extra change

* Consolidate

* Address comments

* Fix integration test config

* Fix merge

* Update sample state

* Bump release version

* Bump version

* Address feedback

* Bump version

* Fix formatting
2022-01-06 19:50:15 -03:00
Christophe Duong
7727b86359 Include tcp port in Clickhouse destination configuration for normalization (#9340)
* Include tcp port in Clickhouse destination configuration for normalization

* revert custom dbt on clickhouse

* Bumpversion of destination connector

* Format code
2022-01-06 18:03:06 +01:00
Dmytro
11553ec828 Source github: Use default retry backoff on server errors (#9179) 2021-12-29 13:36:32 +02:00
Iryna Grankova
fefd5759c8 Update fields in source-connectors specifications: file, freshdesk, github, google-directory, google-workspace-admin-reports, iterable (#8524)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

Co-authored-by: Serhii Chvaliuk <grubberr@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-12-11 01:47:29 +02:00
augan-rymkhan
10f1b58d66 Source Github: Retry connection using HTTPAdapter (#8518)
* retry connection with Github using HTTPAdapter

* updated the connector version

* updated source def and spec yaml

Co-authored-by: Auganbay <auganenu@gmail.com>
2021-12-08 12:40:16 +06:00
Baz
a4a5cb8893 🐛 Source Stripe: Rearrange setup fields (#8250) 2021-11-26 16:06:30 +02:00
Yevhenii
96581f12af Publish PR #8030 (#8233)
* Source GitHub: define pull_request_stats and reviews streams as pull_request substreams
* Source GitHub: Bump version to 0.2.6
* Source GitHub: Apply PR review suggestions
Co-authored-by: Jérémy Lourenço <jeremy@lourenco.io>
2021-11-24 16:56:25 +02:00
Dmytro
c0cb8f338a Fix Github check connection for organizations with large number of re… (#8170) 2021-11-22 15:34:42 +02:00