1
0
mirror of synced 2025-12-21 02:51:29 -05:00
Commit Graph

149 Commits

Author SHA1 Message Date
Anatolii Yatsuk
44c23d1104 🐛Source GitLab: Fix syncing branches for the project with Repository feature disabled (#26422)
Add handling blocked repository for branches stream
2023-05-25 18:58:49 +03:00
Ben Church
248bbf94c1 HACKDAY: Icon CDN (#26158)
* Move icons to connector folder

* Delete old icons

* Update upload logic

* Add icon url to definitions

* Update registry model

* Populate cdn url

* DNC butcher the pipeline

* Low hanging fruit fixes

* Fix bucket name

* Merge old and new approaches

* Fix metadata upload step

* Format

* Fix test
2023-05-24 17:25:41 -07:00
Denys Davydov
5575d86f68 🐛 Source Hubspot, Gitlab, Salesloft, Pinterest: fix builds (#26188)
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* connector health: fix builds for gitlab, salesloft, pinterest, hubspot

* conenctor health: update changelog

* Automated Change

* connector health - fix prop type

* connector health: upd expected records

* Automated Change

* empty commit to trigger ci

---------

Co-authored-by: davydov-d <davydov-d@users.noreply.github.com>
2023-05-17 20:03:50 +03:00
Denys Davydov
180b86494a 🐛 Source Twilio, Source Gitlab, Source Hubspot: fix builds (#26063)
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* Connector health: upd expected records for gitlab and hubspot

* source gitlab: update expected records

* source twilio: fix expected records + fix test config
2023-05-15 14:50:47 +03:00
Denys Davydov
0bab0b6399 🐛 Source Gitlab, Source Hubspot, Source Snapchat-Marketing: fix builds (#25948)
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* connector health: upd changelogs

* auto-bump connector version

* #connector health: update snapchat definition manually

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-05-11 07:40:32 +03:00
Augustin
7310494846 qa-checks: check metadata version matches dockerfile version (#25661) 2023-05-04 16:08:19 -07:00
Baz
1780ee10b1 🐛 CAT: fix close-com, confluence, gitlab, pipedrive, slack, xero expected records (#25780) 2023-05-03 16:06:44 +03:00
Prasanna Kumar
e2b46dd6af Source GitLab: Accept api_url with or without scheme (#21373)
* feat: source-gitlab accept api_url w/ or w/o scheme

* 🪟🔧 Refactor ConnectorsView (#21531)

* WIP

* WIP

* wip

* more fixes

* fix test

* remove some more styled components and improve memoization

* review comment

* feat: source-gitlab accept api_url w/ or w/o scheme

* Revert allowedHosts missing value checks (#21923)

* bump versions

* update expected records

* auto-bump connector version

---------

Co-authored-by: Joe Reuter <joe@airbyte.io>
Co-authored-by: Evan Tahler <evan@airbyte.io>
Co-authored-by: Mal Hancock <mallory@archangelic.space>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-27 13:30:58 -07:00
Baz
226bbef621 🐛 Source GitLab: fix expected records for CAT (#25545) 2023-04-26 13:55:12 +03:00
Ben Church
5563179782 Dagster: rename catalog to registry (#25254)
* rename catalog to registry in metadata service

* rename catalog to registry in metadata files

* Run generate models

* Fix missed renames

* Add github personal access token

* Run black

* Automated Change

---------

Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
2023-04-18 22:15:11 +02:00
Augustin
ebc907cdf7 create metadata files for all connectors (#24964) 2023-04-13 07:45:04 +02:00
Ella Rohm-Ensing
900327726f Add bypasses for extra fields test (#24552)
* Add bypass for extra fields test

* Add bypass for extra fields test
2023-03-26 20:16:49 -05:00
Serhii Lazebnyi
d5c8f65cab Fix SAT for twitter, stripe, recharg and gitlab (#24283) 2023-03-21 19:24:11 +01:00
Arsen Losenko
bb8823ff32 Source Gitlab: Mark datefields in spec as dates (#22992)
* Source Gitlab: Mark datefields in spec as dates

* Update changelog

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-03 17:47:34 +02:00
Serhii Lazebnyi
aec222f6fc Connector Health: Fixed SAT for Close.com, GitLab, Greenhouse, Recharge, Twilio (#23650)
* Fixed expected records

* Added allowedHosts

* fix discovery gitlab
2023-03-02 01:44:17 +01:00
Catherine Noll
7da6a3bb77 Run CATs with local CDK (#23084)
Scripts to 

* Run CATs against the local CDK for one connector

* Run CATs against the local CDK for multiple connectors

* Create a connecter image with the local CDK

---------

Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2023-02-24 16:13:42 -05:00
Augustin
fbd6dbf091 python-connectors: remove explicit dependencies to connector-acceptance-test build (#23332) 2023-02-22 21:21:38 +01:00
Cole Snodgrass
2e099acc52 update headers from 2022 -> 2023 (#22594)
* It's 2023!

* 2022 -> 2023

---------

Co-authored-by: evantahler <evan@airbyte.io>
2023-02-08 13:01:16 -08:00
darynaishchenko
bc155da279 updated expected records (#22075) 2023-02-08 16:46:52 +02:00
Joe Reuter
6a10ae3e05 Rename source acceptance test to connector acceptance test (#21846)
Rename source acceptance test to connector acceptance test
2023-02-02 11:38:19 +01:00
Ella Rohm-Ensing
9e7f1b6a02 Turn off default httpavailability for source-gitlab (#22001)
* Turn off default for source-gitlab (default won't work for some streams on this source)

* Update gitlab.md

* Update streams.py

* Update streams.py

* Update gitlab.md

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-01-30 16:05:07 +00:00
Denys Davydov
06e88849f0 Source Gitlab: fix missing data issue (#21713)
* #21076 source gitlab: fix missing data issue

* #21076 source gitlab: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-01-24 09:13:05 +02:00
Baz
b69639e06f 🎉 Source Gitlab: add OAuth2.0 authentication support (#7506)
* added support of oauth2.0

* added OAuthFlow.java part

* bumped version of the Dockerfile

* corrected SAT

* added unit_test for Oauth java part, added integration-test for java part

* added changelog

* fix java part test

* updated after review

* updated spec.json

* updated after review

* #7480 source gitlab: rm empty files

* #7480 source gitlab: add single use refresh token authenticator

* #7480 source gitlab: upd oauth implementation

* #7480 source gitlab: refactor auth

* #7480 fix oauth: java

* #7480 source gitlab: review fixes

* #7480 source gitlab: upd release stage

* #7480 source gitlab: fix unit tests

* #7480 source gitlab: update expected records

* #7480 source gitlab: upd sats

* #7480 source gitlab: upd expected records

* #7480 source Gitlab: use SingleUseRefreshTokenOauth as is

* #7480 sourcte gitlab: upd expected records

* auto-bump connector version

Co-authored-by: Denys Davydov <davydov.den18@gmail.com>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-01-18 19:59:15 +02:00
Evan Tahler
e39e1898c5 Expected Records to .jsonl format (#20850)
* Expected Records to `.jsonl` format

* fix formatting template

* remove endline

* update templates

* Update docs/connector-development/testing-connectors/source-acceptance-tests-reference.md

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
2023-01-03 15:55:36 -08:00
Yevhen Sukhomud
2a5d0344e7 Fix formatting (#20570)
* Fix formatting

* try fixing quote escapes?

* unignore sql files

Co-authored-by: Edward Gao <edward.gao@airbyte.io>
2022-12-16 13:43:42 -08:00
Alexandre Girard
2a44db69d1 source gitlab: revert availabilitystrategy and bump to latest version of the cdk (#20542)
* bump

* revert AvailabilityStrategy changes

* auto-bump connector version

Co-authored-by: erohmensing <erohmensing@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-12-15 14:42:45 -08:00
Denys Davydov
9a62139cfb #14152 source Gitlab: certify to beta (#20511) 2022-12-15 16:31:28 +02:00
Denys Davydov
8f1f90af5b Source Gitlab: unit tests (#20479)
* #20371 source gitlab: unit tests

* #20371 source gitlab: upd changelog

* #20371 source gitlab: revert httpAvailabilityStrategy

* #20371 source gitlab: rm availability strategy

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-12-15 13:01:33 +02:00
Denys Davydov
2ee250e238 Source Gitlab: fetch groups along with subgroups (#20384)
* #11248 Source Gitlab: fetch groups along with subgroups

* #11248 source gitlab: upd changelog

* #11248 source gitlab: fix build

* #11248 source gitlab: fix build

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-12-13 12:35:44 +02:00
Denys Davydov
1fce890967 Source Gitlab: fix EpicIssues stream (#20348)
* #12900 source Gitlab: fix EpicIssues stream

* #12900 source gitlab: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-12-11 22:07:05 +02:00
Denys Davydov
bd96b6144e Source gitlab - fix duplicate records issue (#20023)
* #20022 source gitlab - fix duplicate records issue

* #20022 source gitlab - upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-12-02 21:19:16 +02:00
Denys Davydov
5da3a7c2a8 Source Gitlab: fix stream schema (#19986)
* #12901 source gitlab: fix schema

* #12901 source gitlab: upd changelog

* #12901 fix SAT

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-12-01 20:51:20 +02:00
Pedro S. Lopez
938436bcc9 update connector specs and definitions with new .com documentation urls (#17585)
* update definitions with new .com docs urls

* update docs urls in specs

* update generators

* regenerate scaffold connectors

* remove unrelated changes

* update more urls

* update specs

* fix tests

* run `:airbyte-config:specs:generateSeedConnectorSpecs` to fix formatting

* revert docs changes to make pr more reviewable

* revert generator readme changes to make more reviewable

* fix mysql strict encrypt expected spec

* fix postgres expected spec
2022-10-11 11:04:23 -04:00
Chris Wu
06d588b71d Source Gitlab: add GroupIssueBoards stream (#13252)
* GitLab Source: add GroupIssueBoards stream

* Address stream schema comments

* Address comments

* Bump version

* Add as empty stream
2022-06-28 08:55:29 -03:00
Marcos Marx
dca2256a7c Bump 2022 license version (#13233)
* Bump year in license short to 2022

* remove protocol from cdk
2022-05-26 15:00:42 -03:00
jordan-glitch
98e5953d8d 🐛 Source Gitlab: allow container_expiration_policy to be nullable + fix null projects list (#11907)
* allow nullable container_expiration_policy

* Update Dockerfile

* Update source_definitions.yaml

* Update source_specs.yaml

* fix unspecified projects

* add doc update

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
2022-05-02 18:44:21 -03:00
Brian Leonard
c302af45ff Upgrade to Python 3.9 (#11763)
* Dockerfile to 3.9

* Python version

* More python updates

* 3.9 on GitHub actions and lint updates

* Test out 3.9.11 on GitHub actions

* install python with an action

* formatting: newline

* Also has python code

* only check first level for changed modules
Previous example (source-google-search-console/credentials)

* Test failure: there is no logger.trace
2022-04-11 20:51:37 -07:00
Adam Schmidt
87566e1a25 🎉 Source Gitlab: Ingest All Accessible Groups (#11140)
* Use Groups API as default when group/project ids not supplied

* Gitlab doc update

* Gitlab doc update, fix UX typo

* review refactor

* remove test output

* small fixes

* bump conenctor version and update docs

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
2022-03-23 12:57:58 -03:00
jdclarke5
bd71999a45 Source Gitlab: fix typo in specification (#9297) 2022-01-04 22:56:47 -03:00
Iryna Grankova
be303bdbad Update fields in source-connectors specifications: gitlab (#8991) 2021-12-23 12:24:12 +02:00
Christophe Duong
86ca36c5c0 Format code (#7978) 2021-11-15 14:51:10 +01:00
oleh.zorenko
cf04b8bb8e 🎉 Source GitLab: allow all domains to be used as api_url (#7108)
* Remove `pattern` field from `api_url` in spec file

* Bump connector's version + update docs
2021-10-18 16:24:36 +03:00
oleh.zorenko
51a2e45c50 🐛 Source Gitlab: fix pattern field in spec file, remove unused fields from config files, improve caching mechanism (#6932)
* Fix SAT

Fix how cache is used in this connector.
Fix pattern field in spec file.
Remove unused fields from invalid_config.json and sample_config.json files.

* Update docs

* Use cache from CDK

* Bump connector's version + update docs
2021-10-12 10:39:55 +03:00
Michel Tricot
1773e41e47 Shorten our headers + adds contributors file (#6478) 2021-09-27 10:45:50 -07:00
LiRen Tu
2906ec287a CI: Add action to check broken doc links (#5254)
* Add action to check broken doc links

* Ignore localhost

* Update config

* Fix broken links

* Use quiet mode

* Ignore PR link

* Fix more broken links

* Fix more broken links

* Fix more broken links

* Verify pattern

* Fix more broken links

* Separate full and pr check

* Update pattern

* Test invalid link

* Remove invalid link
2021-08-07 14:28:02 -07:00
Eugene Kulak
9de53688e3 SAT: remove deprecated validate_output_from_all_streams from configs (#5010)
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
2021-07-27 03:02:32 -04:00
Sherif A. Nada
b86ebf63fb Automatically pull latest SAT & build connector image in SAT runner (#4969) 2021-07-26 11:56:19 -07:00
Marcos Marx
6201100e72 Add entrypoint and bump version for remaining connectors. (#4539)
See the PR descriptions for all the connectors published.
2021-07-07 17:37:22 +08:00
Yevhenii
94f1d217b8 🎉 Native Gitlab connector (#4027)
* Create Airbyte-Native connector for Gitlab

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
2021-07-06 15:25:01 +03:00