jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-31 15:03:11 -05:00
Code Issues Packages Projects Releases Wiki Activity
11,968 Commits 5,135 Branches 518 Tags
9f6963ccfcddd7a573c4ca0ff94de41ce6175cc0
Commit Graph

61 Commits

Author SHA1 Message Date
Artem Inzhyyants
c734909b79 Source GitLab: add shared_runners_setting field to groups (#27869) 
* Source GitLab: add `additionalProperties` to all schemas; add `shared_runners_setting` field to groups

* Source GitLab: update docs

* Source GitLab: remove additionalProperties

* Source GitLab: update docs

* Source GitLab: update expected records
 2023-07-03 10:38:10 +02:00
Artem Inzhyyants
0b52a7de2c Source Gitlab: Fix formatting (#27679) 
* Source Gitlab: Fix formatting

* Source Gitlab: update docs
 2023-06-24 12:58:48 +02:00
Denys Davydov
2ee1837969 🐛 Source Gitlab: certify to GA + make API URL param optional (#27392) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26254 source gitlab: certify to GA

* #26254 make API URL optional field

* source gitlab: upd changelog

---------

Co-authored-by: Augustin <augustin@airbyte.io>
 2023-06-16 16:13:06 +03:00
Denys Davydov
ba773ce4ce 🐛 Source Gitlab: disallow http in cloud, disallow endpoints in URLs (#27346) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26254 source Gitlab: disallow enpoints in URLs, disallow bare http in cloud

* source gitlab: update changelog

* #26254 source gitlab: rm http from spec
 2023-06-15 11:11:54 +03:00
Denys Davydov
9812ccfb20 🐛 Source Gitlab: fix OAuth token expiry date (#27351) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #911 Source Gitlab: fix Oauth token expiry date

* #911 Source Gitlab: fix Oauth token expiry date

* Source Gitlab: update changelog

---------

Co-authored-by: Augustin <augustin@airbyte.io>
 2023-06-15 09:03:37 +03:00
Denys Davydov
41869692fb 🐛 Source Gitlab: skip 404 error (#27234) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #23541 source gitlab: skip 404 error

* source gitlab: upd changelog

* #source gitlab: upd stream schemas and bump version

* source gitlab: update merge request commits stream schema

* #23541 update expected records
 2023-06-12 14:42:24 +03:00
Denys Davydov
083667aeed 🐛 Source Gitlab: improve connectivity check (#27147) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #1275 source Gitlab: improve connection check

* source gitlab: update changelog

* #1275 source gitlab: rm debug code
 2023-06-08 18:11:08 +03:00
Denys Davydov
a3c75e7339 🐛 Source Gitlab: fail on extra columns (#27150) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #24555 source gitlab: fail on extra columns

* source gitlab: update stream schemas
 2023-06-08 17:42:23 +03:00
Roman Yermilov [GL]
473523485d Source Gitlab: update expected records for pipelines streams (#26947) 
* Source Gitlab: fix expected records

* Source Gitlab: update schema for missing field

* Source Gitlab: bump version
 2023-06-02 21:58:41 +04:00
Ben Church
1dabc6208e Metadata: add tags field (#26320) 
* Add optional tags field

* Remove duplicate icons

* Add programming tags to all

* Update docs

* supportUrl -> documentationUrl

* Ensure one language tag is applied

* Add keyvalue check

* rebase and fix tests

* Format

* Add cache buster

* Improve test

* Automated Commit - Formatting Changes

* Update error

* Fix missing tags

* Fix scaffold

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
 2023-05-26 16:13:09 -07:00
Ben Church
ccc701f22e Remove duplicate version declaration for source-gitlab (#26631) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
 2023-05-25 18:01:37 -05:00
Brent Souza
01b1673ad1 🎉Source Gitlab: preserve data in records with flattened keys (#22293) 
* Use get instead of pop to preserve object in dict

* update unit tests and schemas

* update schemas, fix tests, update version

* update version

* update expcted records

---------

Co-authored-by: Mal Hancock <mallory@archangelic.space>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2023-05-25 14:38:55 -03:00
Anatolii Yatsuk
44c23d1104 🐛Source GitLab: Fix syncing branches for the project with Repository feature disabled (#26422) 
Add handling blocked repository for branches stream
 2023-05-25 18:58:49 +03:00
Ben Church
248bbf94c1 HACKDAY: Icon CDN (#26158) 
* Move icons to connector folder

* Delete old icons

* Update upload logic

* Add icon url to definitions

* Update registry model

* Populate cdn url

* DNC butcher the pipeline

* Low hanging fruit fixes

* Fix bucket name

* Merge old and new approaches

* Fix metadata upload step

* Format

* Fix test
 2023-05-24 17:25:41 -07:00
Denys Davydov
5575d86f68 🐛 Source Hubspot, Gitlab, Salesloft, Pinterest: fix builds (#26188) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* connector health: fix builds for gitlab, salesloft, pinterest, hubspot

* conenctor health: update changelog

* Automated Change

* connector health - fix prop type

* connector health: upd expected records

* Automated Change

* empty commit to trigger ci

---------

Co-authored-by: davydov-d <davydov-d@users.noreply.github.com>
 2023-05-17 20:03:50 +03:00
Denys Davydov
180b86494a 🐛 Source Twilio, Source Gitlab, Source Hubspot: fix builds (#26063) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* Connector health: upd expected records for gitlab and hubspot

* source gitlab: update expected records

* source twilio: fix expected records + fix test config
 2023-05-15 14:50:47 +03:00
Denys Davydov
0bab0b6399 🐛 Source Gitlab, Source Hubspot, Source Snapchat-Marketing: fix builds (#25948) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* connector health: upd changelogs

* auto-bump connector version

* #connector health: update snapchat definition manually

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-05-11 07:40:32 +03:00
Augustin
7310494846 qa-checks: check metadata version matches dockerfile version (#25661) 2023-05-04 16:08:19 -07:00
Baz
1780ee10b1 🐛 CAT: fix close-com, confluence, gitlab, pipedrive, slack, xero expected records (#25780) 2023-05-03 16:06:44 +03:00
Prasanna Kumar
e2b46dd6af Source GitLab: Accept api_url with or without scheme (#21373) 
* feat: source-gitlab accept api_url w/ or w/o scheme

* 🪟🔧 Refactor ConnectorsView (#21531)

* WIP

* WIP

* wip

* more fixes

* fix test

* remove some more styled components and improve memoization

* review comment

* feat: source-gitlab accept api_url w/ or w/o scheme

* Revert allowedHosts missing value checks (#21923)

* bump versions

* update expected records

* auto-bump connector version

---------

Co-authored-by: Joe Reuter <joe@airbyte.io>
Co-authored-by: Evan Tahler <evan@airbyte.io>
Co-authored-by: Mal Hancock <mallory@archangelic.space>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-04-27 13:30:58 -07:00
Baz
226bbef621 🐛 Source GitLab: fix expected records for CAT (#25545) 2023-04-26 13:55:12 +03:00
Ben Church
5563179782 Dagster: rename catalog to registry (#25254) 
* rename catalog to registry in metadata service

* rename catalog to registry in metadata files

* Run generate models

* Fix missed renames

* Add github personal access token

* Run black

* Automated Change

---------

Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
 2023-04-18 22:15:11 +02:00
Augustin
ebc907cdf7 create metadata files for all connectors (#24964) 2023-04-13 07:45:04 +02:00
Ella Rohm-Ensing
900327726f Add bypasses for extra fields test (#24552) 
* Add bypass for extra fields test

* Add bypass for extra fields test
 2023-03-26 20:16:49 -05:00
Serhii Lazebnyi
d5c8f65cab Fix SAT for twitter, stripe, recharg and gitlab (#24283) 2023-03-21 19:24:11 +01:00
Arsen Losenko
bb8823ff32 Source Gitlab: Mark datefields in spec as dates (#22992) 
* Source Gitlab: Mark datefields in spec as dates

* Update changelog

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-03-03 17:47:34 +02:00
Serhii Lazebnyi
aec222f6fc Connector Health: Fixed SAT for Close.com, GitLab, Greenhouse, Recharge, Twilio (#23650) 
* Fixed expected records

* Added allowedHosts

* fix discovery gitlab
 2023-03-02 01:44:17 +01:00
Catherine Noll
7da6a3bb77 Run CATs with local CDK (#23084) 
Scripts to 

* Run CATs against the local CDK for one connector

* Run CATs against the local CDK for multiple connectors

* Create a connecter image with the local CDK

---------

Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2023-02-24 16:13:42 -05:00
Augustin
fbd6dbf091 python-connectors: remove explicit dependencies to connector-acceptance-test build (#23332) 2023-02-22 21:21:38 +01:00
Cole Snodgrass
2e099acc52 update headers from 2022 -> 2023 (#22594) 
* It's 2023!

* 2022 -> 2023

---------

Co-authored-by: evantahler <evan@airbyte.io>
 2023-02-08 13:01:16 -08:00
darynaishchenko
bc155da279 updated expected records (#22075) 2023-02-08 16:46:52 +02:00
Joe Reuter
6a10ae3e05 Rename source acceptance test to connector acceptance test (#21846) 
Rename source acceptance test to connector acceptance test
 2023-02-02 11:38:19 +01:00
Ella Rohm-Ensing
9e7f1b6a02 Turn off default httpavailability for source-gitlab (#22001) 
* Turn off default for source-gitlab (default won't work for some streams on this source)

* Update gitlab.md

* Update streams.py

* Update streams.py

* Update gitlab.md

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-30 16:05:07 +00:00
Denys Davydov
06e88849f0 Source Gitlab: fix missing data issue (#21713) 
* #21076 source gitlab: fix missing data issue

* #21076 source gitlab: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-24 09:13:05 +02:00
Baz
b69639e06f 🎉 Source Gitlab: add OAuth2.0 authentication support (#7506) 
* added support of oauth2.0

* added OAuthFlow.java part

* bumped version of the Dockerfile

* corrected SAT

* added unit_test for Oauth java part, added integration-test for java part

* added changelog

* fix java part test

* updated after review

* updated spec.json

* updated after review

* #7480 source gitlab: rm empty files

* #7480 source gitlab: add single use refresh token authenticator

* #7480 source gitlab: upd oauth implementation

* #7480 source gitlab: refactor auth

* #7480 fix oauth: java

* #7480 source gitlab: review fixes

* #7480 source gitlab: upd release stage

* #7480 source gitlab: fix unit tests

* #7480 source gitlab: update expected records

* #7480 source gitlab: upd sats

* #7480 source gitlab: upd expected records

* #7480 source Gitlab: use SingleUseRefreshTokenOauth as is

* #7480 sourcte gitlab: upd expected records

* auto-bump connector version

Co-authored-by: Denys Davydov <davydov.den18@gmail.com>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-18 19:59:15 +02:00
Evan Tahler
e39e1898c5 Expected Records to .jsonl format (#20850) 
* Expected Records to `.jsonl` format

* fix formatting template

* remove endline

* update templates

* Update docs/connector-development/testing-connectors/source-acceptance-tests-reference.md

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
 2023-01-03 15:55:36 -08:00
Yevhen Sukhomud
2a5d0344e7 Fix formatting (#20570) 
* Fix formatting

* try fixing quote escapes?

* unignore sql files

Co-authored-by: Edward Gao <edward.gao@airbyte.io>
 2022-12-16 13:43:42 -08:00
Alexandre Girard
2a44db69d1 source gitlab: revert availabilitystrategy and bump to latest version of the cdk (#20542) 
* bump

* revert AvailabilityStrategy changes

* auto-bump connector version

Co-authored-by: erohmensing <erohmensing@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-12-15 14:42:45 -08:00
Denys Davydov
9a62139cfb #14152 source Gitlab: certify to beta (#20511) 2022-12-15 16:31:28 +02:00
Denys Davydov
8f1f90af5b Source Gitlab: unit tests (#20479) 
* #20371 source gitlab: unit tests

* #20371 source gitlab: upd changelog

* #20371 source gitlab: revert httpAvailabilityStrategy

* #20371 source gitlab: rm availability strategy

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-12-15 13:01:33 +02:00
Denys Davydov
2ee250e238 Source Gitlab: fetch groups along with subgroups (#20384) 
* #11248 Source Gitlab: fetch groups along with subgroups

* #11248 source gitlab: upd changelog

* #11248 source gitlab: fix build

* #11248 source gitlab: fix build

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-12-13 12:35:44 +02:00
Denys Davydov
1fce890967 Source Gitlab: fix EpicIssues stream (#20348) 
* #12900 source Gitlab: fix EpicIssues stream

* #12900 source gitlab: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-12-11 22:07:05 +02:00
Denys Davydov
bd96b6144e Source gitlab - fix duplicate records issue (#20023) 
* #20022 source gitlab - fix duplicate records issue

* #20022 source gitlab - upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-12-02 21:19:16 +02:00
Denys Davydov
5da3a7c2a8 Source Gitlab: fix stream schema (#19986) 
* #12901 source gitlab: fix schema

* #12901 source gitlab: upd changelog

* #12901 fix SAT

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-12-01 20:51:20 +02:00
Pedro S. Lopez
938436bcc9 update connector specs and definitions with new .com documentation urls (#17585) 
* update definitions with new .com docs urls

* update docs urls in specs

* update generators

* regenerate scaffold connectors

* remove unrelated changes

* update more urls

* update specs

* fix tests

* run `:airbyte-config:specs:generateSeedConnectorSpecs` to fix formatting

* revert docs changes to make pr more reviewable

* revert generator readme changes to make more reviewable

* fix mysql strict encrypt expected spec

* fix postgres expected spec
 2022-10-11 11:04:23 -04:00
Chris Wu
06d588b71d Source Gitlab: add GroupIssueBoards stream (#13252) 
* GitLab Source: add GroupIssueBoards stream

* Address stream schema comments

* Address comments

* Bump version

* Add as empty stream
 2022-06-28 08:55:29 -03:00
Marcos Marx
dca2256a7c Bump 2022 license version (#13233) 
* Bump year in license short to 2022

* remove protocol from cdk
 2022-05-26 15:00:42 -03:00
jordan-glitch
98e5953d8d 🐛 Source Gitlab: allow container_expiration_policy to be nullable + fix null projects list (#11907) 
* allow nullable container_expiration_policy

* Update Dockerfile

* Update source_definitions.yaml

* Update source_specs.yaml

* fix unspecified projects

* add doc update

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
 2022-05-02 18:44:21 -03:00
Brian Leonard
c302af45ff Upgrade to Python 3.9 (#11763) 
* Dockerfile to 3.9

* Python version

* More python updates

* 3.9 on GitHub actions and lint updates

* Test out 3.9.11 on GitHub actions

* install python with an action

* formatting: newline

* Also has python code

* only check first level for changed modules
Previous example (source-google-search-console/credentials)

* Test failure: there is no logger.trace
 2022-04-11 20:51:37 -07:00
Adam Schmidt
87566e1a25 🎉 Source Gitlab: Ingest All Accessible Groups (#11140) 
* Use Groups API as default when group/project ids not supplied

* Gitlab doc update

* Gitlab doc update, fix UX typo

* review refactor

* remove test output

* small fixes

* bump conenctor version and update docs

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
 2022-03-23 12:57:58 -03:00