jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-20 18:39:31 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,480 Commits 5,109 Branches 518 Tags
yarden/source-mongodb-support-dynamic-arrays
Commit Graph

86 Commits

Author SHA1 Message Date
Artem Inzhyyants
c75ee5afc7 Source Azure Blob Storage: migrate to poetry (#36487) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
Co-authored-by: Catherine Noll <noll.catherine@gmail.com>
 2024-03-27 11:15:49 +01:00
Augustin
8c862a8013 Fix tags in metadata.yaml files: declare cdk tags (#35670) 2024-03-07 04:32:29 -06:00
Catherine Noll
58de015de4 File based sources fix sync mode bug (#34936) 
Includes:
Source Azure Blob Storage
Source GCS
Source Google Drive
Source Microsoft Onedrive
 2024-02-06 19:59:52 -05:00
Joe Reuter
320e69423e Publish to pypi batch14 (#34662) 2024-02-01 07:41:08 -06:00
Catherine Noll
a8bdeef904 Update file-based connectors for compatibility with concurrent CDK (#34681) 2024-01-31 08:48:38 -05:00
Catherine Noll
aec1082f46 Pin file-based sources to airbyte-cdk version 0.59.2 (#34661) 2024-01-30 13:30:02 -05:00
Joe Reuter
28dae9ac2c Publish to pypi (#34652) 2024-01-30 07:07:04 -06:00
Joe Reuter
4cfaebeacf airbyte-lib: Refactor follow-up (#34649) 2024-01-30 12:11:41 +01:00
Joe Reuter
f29234a2db airbyte-lib: Refactor connectors (#34552) 2024-01-30 03:22:13 -06:00
Joe Reuter
e728128238 Azure Blob Storage: Fix unstructured format (#34084) 2024-01-10 17:48:52 +01:00
Joe Reuter
5324da8303 S3, Google Drive, Azure Blob Storage: Update cdk (#33411) 
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
 2023-12-15 14:51:59 +01:00
Catherine Noll
f73827eb43 File-based CDK Sources: Hide primary key (#33187) 2023-12-06 13:01:47 -05:00
Joe Reuter
8f7abc2cc0 S3, Azure Blob Storage, GCS, Weviate, Milvus, Chroma, Qdrant: Bump cdk version (#32608) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-11-30 09:48:18 +01:00
Joe Reuter
b3396626ee S3, Azure Blob Storage, GCS, Pinecone, Weaviate, Milvus, Chroma, Qdrant: Update CDK to improve spec generation (#32357) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-11-14 16:53:27 +01:00
Ella Rohm-Ensing
ac3eb28de2 airbyte-ci: add format commands (#31831) 
Co-authored-by: Ben Church <ben@airbyte.io>
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Marius Posta <marius@airbyte.io>
Co-authored-by: alafanechere <alafanechere@users.noreply.github.com>
 2023-11-14 02:17:48 -06:00
Augustin
368ba78b64 🧹doc: update connectors README and remove acceptance-test-docker.sh (#32209) 2023-11-06 12:36:07 -06:00
Joe Reuter
7c7acade71 S3 and Azure Blob Storage: Update File CDK to support document file types (#31904) 
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
 2023-10-31 11:21:22 +01:00
Augustin
c544183339 Migrate connectors to use our python base image (Round 1) (#31543) 2023-10-18 20:06:10 +02:00
Denys Davydov
31e8170cd2 ✨ Source Azure Blob Storage: migrate to File-based CDK (#31336) 
Co-authored-by: davydov-d <davydov-d@users.noreply.github.com>
 2023-10-13 15:06:23 +03:00
Marius Posta
f8edc18039 airbyte-ci,gradle: replace airbyte-docker with airbyte-ci (#30743) 2023-10-04 08:38:17 -07:00
Aaron ("AJ") Steers
da32fc86bf 🚀 Launch Java CDK v0.1.0 (PR #30383) 
- Launch Java CDK `v0.1.0`. 🚀
- Remove `airbyte-docker` gradle plugin from java connectors.
- Add `airbyte-java-connector` gradle plugin.
- Remove `airbyte-commons` from global build.gradle.
- Add `/publish-java-cdk` slash command.
- Initial launch of `/airbyte-ci` slash command to test connectors.
 2023-09-27 15:46:02 -07:00
Marius Posta
51c67d7eaa gradle: remove airbyteDocker.outputs dependencies (#30314) 2023-09-11 17:16:27 -07:00
Marius Posta
f5c7c1c0b8 chore: get ./gradlew format to pass for the whole repo (same java style) (#29786) 2023-08-24 05:09:42 -05:00
Ben Church
40781313da Update Internal Fields: update ql levels to better resemble previous high strictness (#29450) 2023-08-15 18:03:10 -05:00
Ben Church
2f7deaee02 [skip ci] Metadata: Remove leading underscore (#29024) 
* DNC

* Add test models

* Add model test

* Remove underscore from metadata files

* Regenerate models

* Add test to check for key transformation

* Allow additional fields on metadata

* Delete transform
 2023-08-03 10:56:13 -07:00
Ben Church
e9490e3fb6 Connector Levels: Add new internal metadata fields (#28904) 
* Add airbyte internal

* Add tests

* First pass

* Set destinations to same levels as sources

* Best guess at missing statuses

* Best guess at _ql

* Add separate enum class

* Fix support level name

* Update templates

* Add one more test
 2023-08-01 18:08:33 -05:00
Ben Church
1dabc6208e Metadata: add tags field (#26320) 
* Add optional tags field

* Remove duplicate icons

* Add programming tags to all

* Update docs

* supportUrl -> documentationUrl

* Ensure one language tag is applied

* Add keyvalue check

* rebase and fix tests

* Format

* Add cache buster

* Improve test

* Automated Commit - Formatting Changes

* Update error

* Fix missing tags

* Fix scaffold

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
 2023-05-26 16:13:09 -07:00
Augustin
fd3655707e connectors-ci: add finalize_build logic to handle custom Dockerfiles (#26489) 2023-05-25 09:32:19 +02:00
Ben Church
248bbf94c1 HACKDAY: Icon CDN (#26158) 
* Move icons to connector folder

* Delete old icons

* Update upload logic

* Add icon url to definitions

* Update registry model

* Populate cdn url

* DNC butcher the pipeline

* Low hanging fruit fixes

* Fix bucket name

* Merge old and new approaches

* Fix metadata upload step

* Format

* Fix test
 2023-05-24 17:25:41 -07:00
Akash Kulkarni
889a5bc50b Run formatter (#25901) 2023-05-09 10:03:22 -07:00
Augustin
7310494846 qa-checks: check metadata version matches dockerfile version (#25661) 2023-05-04 16:08:19 -07:00
Jonathan Pearlin
a38af089e9 Track stream status in source (#24971) 
* WIP Track stream status in source

* Revert formatting

* Revert formatting changes

* Remove unnecessary file

* Automated Change

* Automated Change

* Use new stream status trace message

* Rename class

* Remove unnecessary import

* Formatting

* Add tests

* Fix compile issues

* Automated Commit - Formatting Changes

* Remove TODO

* Fix compilation error

* Split STOPPED into INCOMPLETE and COMPLETE

* Remove unused import

* Changelog updates for source-postgres

* Remove unused import

* auto-bump connector version

---------

Co-authored-by: jdpgrailsdev <jdpgrailsdev@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-04-26 15:14:25 -05:00
Ben Church
5563179782 Dagster: rename catalog to registry (#25254) 
* rename catalog to registry in metadata service

* rename catalog to registry in metadata files

* Run generate models

* Fix missed renames

* Add github personal access token

* Run black

* Automated Change

---------

Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
 2023-04-18 22:15:11 +02:00
Augustin
ebc907cdf7 create metadata files for all connectors (#24964) 2023-04-13 07:45:04 +02:00
Rodi Reich Zilberman
0bab1756b8 Rename airbyte-config module (#24885) 
* rename airbyte-config module

* Automated Commit - Formatting Changes

* sanity

* update import

* update import

* update script

* update script

* update script

* update script

* Automated Change

* Automated Change

* Automated Change

* Automated Change

* update awsdatalake icon

* point slash commands to new path

* sanity

* Automated Commit - Formatting Changes

* sanity

* Automated Change

* Automated Change

* sanity

---------

Co-authored-by: rodireich <rodireich@users.noreply.github.com>
 2023-04-06 10:47:30 -07:00
Marcos Marx
e7a8212b3a 🎉 New Source: Azure Blob Storage (publish) (#24767) 
* create azure blob storage source connector

* Azure Blob Storage source connector

* Azure Blob Storage source connector

* improve doc

* resolve conflicts

* add additional properties to true in spec

* add source def and acceptance test

* auto-bump connector version

---------

Co-authored-by: itaseskii <ivica.taseski94@gmail.com>
Co-authored-by: itaseski <itaseski@debian-BULLSEYE-live-builder-AMD64>
Co-authored-by: Sajarin <sajarindider@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-04-02 07:18:50 -03:00