1
0
mirror of synced 2025-12-21 11:01:41 -05:00
Commit Graph

46 Commits

Author SHA1 Message Date
Aaron ("AJ") Steers
26400425de feat: Add external documentation URLs to Group F source connectors (source-google-analytics-v4 through source-jina-ai-reader) (#69733)
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2025-11-18 18:04:50 -08:00
Charles
50a97db804 chore: migrate connectors from MIT to ELv2 (#63723) 2025-07-22 14:26:58 -07:00
Aaron ("AJ") Steers
5114bb5db9 Chore: Update "airbyte-lib" CLI references with newer PyAirbyte CLI refs (pyab validate) (#46696) 2024-10-14 16:07:10 +00:00
Augustin
601c3c455c Rename registries to registryOverrides in connector metadata (#43757) 2024-08-13 16:10:56 +02:00
Christo Grabowski
440df5dc82 Archive Google Workspace Admin Reports (#35967) 2024-03-13 10:10:04 -05:00
Christo Grabowski
b092a7f9c0 Disable Google Workspace Admin Reports in registries (#35965) 2024-03-13 09:16:56 -05:00
Augustin
8c862a8013 Fix tags in metadata.yaml files: declare cdk tags (#35670) 2024-03-07 04:32:29 -06:00
Joe Reuter
6660c45adc Publish to pypi batch5 (#34668) 2024-01-31 05:10:46 -06:00
Joe Reuter
4cfaebeacf airbyte-lib: Refactor follow-up (#34649) 2024-01-30 12:11:41 +01:00
Joe Reuter
f29234a2db airbyte-lib: Refactor connectors (#34552) 2024-01-30 03:22:13 -06:00
Augustin
0b33caecda Revert "[skip ci] formatting: add missing license headers (#33250)" (#33289) 2023-12-11 11:38:37 +01:00
Augustin
60c1cc01ad [skip ci] formatting: add missing license headers (#33250) 2023-12-11 10:15:18 +01:00
Augustin
368ba78b64 🧹doc: update connectors README and remove acceptance-test-docker.sh (#32209) 2023-11-06 12:36:07 -06:00
Marius Posta
7ae97175a6 gradle: fix repo wide behaviour (#30607) 2023-09-28 05:01:13 -07:00
Ben Church
5c56ac1d84 Airbyte-ci: Remove gradle task connectorAcceptanceTest (#30326) 2023-09-19 15:16:37 -05:00
Ben Church
40781313da Update Internal Fields: update ql levels to better resemble previous high strictness (#29450) 2023-08-15 18:03:10 -05:00
Augustin
00d9462216 cat/connectors-ci: replace docker runner with dagger runner in CAT (#28000) 2023-08-11 17:58:48 +02:00
Ben Church
2f7deaee02 [skip ci] Metadata: Remove leading underscore (#29024)
* DNC

* Add test models

* Add model test

* Remove underscore from metadata files

* Regenerate models

* Add test to check for key transformation

* Allow additional fields on metadata

* Delete transform
2023-08-03 10:56:13 -07:00
Ben Church
e9490e3fb6 Connector Levels: Add new internal metadata fields (#28904)
* Add airbyte internal

* Add tests

* First pass

* Set destinations to same levels as sources

* Best guess at missing statuses

* Best guess at _ql

* Add separate enum class

* Fix support level name

* Update templates

* Add one more test
2023-08-01 18:08:33 -05:00
Ben Church
1dabc6208e Metadata: add tags field (#26320)
* Add optional tags field

* Remove duplicate icons

* Add programming tags to all

* Update docs

* supportUrl -> documentationUrl

* Ensure one language tag is applied

* Add keyvalue check

* rebase and fix tests

* Format

* Add cache buster

* Improve test

* Automated Commit - Formatting Changes

* Update error

* Fix missing tags

* Fix scaffold

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
2023-05-26 16:13:09 -07:00
Ben Church
248bbf94c1 HACKDAY: Icon CDN (#26158)
* Move icons to connector folder

* Delete old icons

* Update upload logic

* Add icon url to definitions

* Update registry model

* Populate cdn url

* DNC butcher the pipeline

* Low hanging fruit fixes

* Fix bucket name

* Merge old and new approaches

* Fix metadata upload step

* Format

* Fix test
2023-05-24 17:25:41 -07:00
Augustin
7310494846 qa-checks: check metadata version matches dockerfile version (#25661) 2023-05-04 16:08:19 -07:00
Ben Church
5563179782 Dagster: rename catalog to registry (#25254)
* rename catalog to registry in metadata service

* rename catalog to registry in metadata files

* Run generate models

* Fix missed renames

* Add github personal access token

* Run black

* Automated Change

---------

Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
2023-04-18 22:15:11 +02:00
Augustin
ebc907cdf7 create metadata files for all connectors (#24964) 2023-04-13 07:45:04 +02:00
Catherine Noll
7da6a3bb77 Run CATs with local CDK (#23084)
Scripts to 

* Run CATs against the local CDK for one connector

* Run CATs against the local CDK for multiple connectors

* Create a connecter image with the local CDK

---------

Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2023-02-24 16:13:42 -05:00
Cole Snodgrass
2e099acc52 update headers from 2022 -> 2023 (#22594)
* It's 2023!

* 2022 -> 2023

---------

Co-authored-by: evantahler <evan@airbyte.io>
2023-02-08 13:01:16 -08:00
Joe Reuter
6a10ae3e05 Rename source acceptance test to connector acceptance test (#21846)
Rename source acceptance test to connector acceptance test
2023-02-02 11:38:19 +01:00
Pedro S. Lopez
938436bcc9 update connector specs and definitions with new .com documentation urls (#17585)
* update definitions with new .com docs urls

* update docs urls in specs

* update generators

* regenerate scaffold connectors

* remove unrelated changes

* update more urls

* update specs

* fix tests

* run `:airbyte-config:specs:generateSeedConnectorSpecs` to fix formatting

* revert docs changes to make pr more reviewable

* revert generator readme changes to make more reviewable

* fix mysql strict encrypt expected spec

* fix postgres expected spec
2022-10-11 11:04:23 -04:00
Marcos Marx
dca2256a7c Bump 2022 license version (#13233)
* Bump year in license short to 2022

* remove protocol from cdk
2022-05-26 15:00:42 -03:00
Brian Leonard
c302af45ff Upgrade to Python 3.9 (#11763)
* Dockerfile to 3.9

* Python version

* More python updates

* 3.9 on GitHub actions and lint updates

* Test out 3.9.11 on GitHub actions

* install python with an action

* formatting: newline

* Also has python code

* only check first level for changed modules
Previous example (source-google-search-console/credentials)

* Test failure: there is no logger.trace
2022-04-11 20:51:37 -07:00
Michele Zuccala
bfbacd0b43 🎉 Source Google Workspace Admin Reports: add support for Google Meet Audit Activity Events (#10244)
* source(google-workspace-admin-reports): add support for Google Meet Audit activity events

Signed-off-by: Michele Zuccala <michele@zuccala.com>

* remove required fields

* bump connector version

* run format

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
2022-02-24 17:59:46 -03:00
Iryna Grankova
fefd5759c8 Update fields in source-connectors specifications: file, freshdesk, github, google-directory, google-workspace-admin-reports, iterable (#8524)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

Co-authored-by: Serhii Chvaliuk <grubberr@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-12-11 01:47:29 +02:00
vitaliizazmic
3cbfb99dba 🎉 Source Google Workspace Admin Reports: migrate to the CDK
* Source Google Workspace Admin Reports #7531 - migrate to the CDK

* Source Google Workspace Admin Reports #7531 - skip full refresh test

* Source Google Workspace Admin Reports #7531 - bump version and update changelog
2021-11-08 19:05:24 +02:00
vitaliizazmic
1d922ca5fc 🐛 Source Facebook Marketing: SAT ignored fields in TestFullRefresh.test_sequential_reads
* Source Facebook Marketing #5190 - estimate cost_per_estimated_ad_recallers for AdsInsights streams if not presented in records

* Source Facebook Marketing #5190 - add ignored fields to full refresh test

* Source Facebook Marketing #5190 - annotations

* Source Facebook Marketing #5190 - reformat

* SAT #5190 - delete remove_ignored_fields

* Source Facebook Marketing #5190 - use dpath util for excluding fields

* Facebook marketing #5190 - follow EAFP principle

* Facebook Marketing #5190 - add unit tests.

* Source Facebook Marketing #5190 - fixing according to PR

* Source Facebook Marketing #5190 - support ignored fields by stream

* Source Facebook Marketing #5190 - update docs

* Source Facebook Marketing #5190 - merge conflicts

* Source Facebook Marketing #5190 - bump SAT version

* Source Facebook Marketing #5190 - fixing unit tests

* Source Facebook Marketing #5190 - bump
2021-11-01 17:45:06 +02:00
Arthur Galuza
ff2882dbf0 🎉 Source Google Workspace Admin: use SAT (#6878)
* Add SAT

* Upd changelog

* Refactor

* Upd acceptance-test-config

* Upd schemas

* Update docs

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-10-31 13:43:37 +03:00
Michel Tricot
1773e41e47 Shorten our headers + adds contributors file (#6478) 2021-09-27 10:45:50 -07:00
Jared Rhizor
b4793b2510 add AIRBYTE_ENTRYPOINT for kubernetes support (#3973)
* add AIRBYTE_ENTRYPOINT for kubernetes support

* bump versions

* bump version in seed

* Update generic template

* keep scaffold sources at 0.1.0

* add missing newline

* handle python base versions correctly

* re-bump mysql and postgres sources

* re-bump snowflake destination

* add skip tests option

* switch to running tests

* reverse conditional to make it safer

* fix publish to include the test running

* fix iterable version

* fix file generation

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-06-09 13:01:45 -07:00
Dmytro
a1035e007b 📚 Update all Python connectors READMEs with minimum required version (#3760) 2021-06-02 12:35:29 +03:00
Charles
0df53170c9 Stop formatting python with spotless (#3388) 2021-05-13 17:46:34 -07:00
Davin Chia
f660b0a946 Add template generation for Santa aka CDK. (#3034)
Template generation for new Source using the Santa CDK - provide basic scaffolding for someone implementing a new source.

General approach is to buff up comments in the original SDK, and add TODOs with secondary comments in the generated stub methods, as well as links to existing examples (e.g. Stripe or ExchangeRate api) users can look at.

Checked in and added tests for the generated modules.
2021-04-25 18:02:33 +08:00
Charles
f445fdb5b2 match styling for spotlessApply and format (#3017)
* as a java developer I want to be able to run spotlessApply without changing styles in python code
2021-04-23 09:21:41 -07:00
Sherif A. Nada
2d2d0173d6 Update codegen template READMEs (#2873) 2021-04-13 11:41:52 -07:00
vitaliizazmic
a8229244ec Google audit logs incremental sync #2694
* Google audit logs #2694 - incremental sync

* Google audit logs #2694 - incremental sync(reformat)

* Google audit logs #2694 - fix update state while incremental sync

* Google audit logs #2694 - update state to newest record time

* Google audit logs incremental sync #2694 - improving according to PR commits

* Google audit logs incremental sync #2694 - reformat

* Google audit logs incremental sync #2694 - adding log info

* Google audit logs incremental sync #2694 - bump version

* Google audit logs incremental sync #2694 - bump version (fix merge conflict)
2021-04-08 23:00:29 +03:00
Sherif A. Nada
ed89509cf0 update docs links for Google Workspace/Audit logs (#2789) 2021-04-07 13:49:46 -07:00
Jared Rhizor
0609011e05 fix connector base versioning (#2726)
* fix connector base versioning

* only run integration tests in non-bases directories

* upgrade datamodel-code-generator which coincidentally has already fixed this issue with generating List of Lists

* bump forgotten hubspot version

* fix build
2021-04-02 22:46:06 -07:00
vitaliizazmic
2327b353aa 🎉 New Source: Google Workspace Admin audit logs
* Google audit logs #2456 - Create new Google Workspace Admin Reports source for full refresh sync audit logs

* Update docs/integrations/sources/google-workspace-admin-reports.md

* Google audit logs #2456 - reformat

* Google audit logs #2456 - increase result per page

* Google audit logs #2456 - fix schema

* Google audit logs #2456 - add schemas package data

* Google audit logs #2456 - fixing timeout error

* Google audit logs #2456 - fixing configured_catalog.json

* Google audit logs #2456 - lookback spec parameter

* Google audit logs #2456 - remove end time

* skip testIdenticalFullRefreshes for source-google-workspace-admin-reports

* Tempo Source #2295 - reformat

* Update airbyte-integrations/connectors/source-google-workspace-admin-reports/source_google_workspace_admin_reports/spec.json

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
2021-04-01 02:27:38 +03:00