1
0
mirror of synced 2025-12-25 02:09:19 -05:00

Revert "Revert "Merge branch 'master' of github.com:airbytehq/airbyte""

This reverts commit de66bf010d.
This commit is contained in:
Sherif Nada
2021-03-23 15:12:01 -07:00
parent de66bf010d
commit 77b72dcf5b
181 changed files with 17418 additions and 9915 deletions

View File

@@ -0,0 +1,56 @@
# Gitlab
## Overview
The Gitlab source supports both Full Refresh and Incremental syncs. You can choose if this connector will copy only the new or updated data, or all rows in the tables and columns you set up for replication, every time a sync is run.
This Gitlab source wraps the [Singer Gitlab Tap](https://gitlab.com/meltano/tap-gitlab).
### Output schema
This connector outputs the following streams:
* [Branches](https://docs.gitlab.com/ee/api/branches.html)
* [Commits](https://docs.gitlab.com/ee/api/commits.html) (Incremental)
* [Issues](https://docs.gitlab.com/ee/api/issues.html) (Incremental)
* [Pipelines](https://docs.gitlab.com/ee/api/pipelines.html) (Incremental)
* [Jobs](https://docs.gitlab.com/ee/api/jobs.html)
* [Projects](https://docs.gitlab.com/ee/api/projects.html) (Incremental)
* [Project Milestones](https://docs.gitlab.com/ee/api/milestones.html)
* [Project Merge Requests](https://docs.gitlab.com/ee/api/merge_requests.html) (Incremental)
* [Users](https://docs.gitlab.com/ee/api/users.html)
* [Groups](https://docs.gitlab.com/ee/api/groups.html)
* [Group Milestones](https://docs.gitlab.com/ee/api/group_milestones.html)
* [Group and Project members](https://docs.gitlab.com/ee/api/members.html)
* [Tags](https://docs.gitlab.com/ee/api/tags.html)
* [Releases](https://docs.gitlab.com/ee/api/releases/index.html)
* [Group Labels](https://docs.gitlab.com/ee/api/group_labels.html)
* [Project Labels](https://docs.gitlab.com/ee/api/labels.html)
* [Epics](https://docs.gitlab.com/ee/api/epics.html) (Incremental, only available for GitLab Ultimate and GitLab.com Gold accounts)
* [Epic Issues](https://docs.gitlab.com/ee/api/epic_issues.html) (only available for GitLab Ultimate and GitLab.com Gold accounts)
### Features
| Feature | Supported? |
| :--- | :--- |
| Full Refresh Sync | Yes |
| Incremental - Append Sync | Partially (not all streams) |
| SSL connection | Yes |
### Performance considerations
Gitlab has the [rate limits](https://docs.gitlab.com/ee/user/gitlab_com/index.html#gitlabcom-specific-rate-limits), but the Gitlab connector should not run into Gitlab API limitations under normal usage.
Please [create an issue](https://github.com/airbytehq/airbyte/issues) if you see any rate limit issues that are not automatically retried successfully.
## Getting started
### Requirements
* Gitlab Account
* Gitlab Personal Access Token wih the necessary permissions \(described below\)
### Setup guide
Log into Gitlab and then generate a [personal access token](https://docs.gitlab.com/ee/user/profile/personal_access_tokens.html).
Your token should have the `read_api` scope, that Grants read access to the API, including all groups and projects, the container registry, and the package registry.