jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-21 19:11:14 -05:00
Code Issues Packages Projects Releases Wiki Activity
22,318 Commits 5,109 Branches 518 Tags
baf4633ab8b51a55276115ea083837d8632fe217
Commit Graph

102 Commits

Author SHA1 Message Date
Ella Rohm-Ensing
aad9d400b1 resolve connector dependency workflow missing changelogs (#23314) 
* Add changelog entry for destination-clickhouse 0.2.2

* Delete csv.md

* local-csv.md -> csv.md
 2023-02-21 17:57:19 -05:00
Jon Martin
acadee08bc Add instructions for mounting Windows directory. (#21405) 
There're currently no directions as to what a user would need to change to be able to mount a raw directory into the Docker containers to be able to use a file as a source.
 2023-01-17 07:53:59 -03:00
Simon Späti
26053ef727 📝 Add warning for working with local files and Docker Desktop (/tmp and /private) (#21004) 2023-01-05 10:54:58 +01:00
Artem Inzhyyants
10d7bea363 Source File: Fix special characters bug (#21012) 
* Source File: Fix special characters bug

* Source File: bump version; update docs

* Source File: update SSH credentials in unit tests

* Source File: bump version (secure)

* Source File: update resources manually
 2023-01-04 20:58:42 +01:00
Artem Inzhyyants
54377e4eec Source File: increase timeout OC 1197 (#20740) 
* Source File: increase timeout OC 1197

* Source File: docs update; bump version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-12-21 14:28:40 -06:00
Evan Tahler
a55eb7df2d Fix CI Dependency Check Failures (#20666) 
* pardot

* plaid

* quickbooks

* appfollow

* appstore

* cloudtrail

* clickup

* clockify

* coda

* Coinmarketcap

* cooper

* dixa

* dv-360

* exchange-rates

* file

* gridly

* Hellobaton

* kustomer

* mailersend

* microsoft dataverse

* n8n

* PersistIq

* Survey Sparrow

* Twilio Taskrouter

* YouTube Analytics Business

* Younium

* Yahoo Finance Price

* Yandex Metrica

* Xero

* WooCommerce

* XKCD

* Webflow

* US Census API

* Qonto

* Pivotal Tracker

* KVDB

* Firestore

* Ignore even more connectors

* test run

* SFTP JSON

* cleanup

* move pardot changelog

* update links

* remove testing HACK

* Update docs/integrations/sources/dixa.md

Co-authored-by: Augustin <augustin@airbyte.io>

* Update docs/integrations/sources/kustomer-singer.md

Co-authored-by: Augustin <augustin@airbyte.io>

* Update docs/integrations/sources/pardot.md

Co-authored-by: Augustin <augustin@airbyte.io>

* Update docs/integrations/sources/kustomer-singer.md

Co-authored-by: Augustin <augustin@airbyte.io>

* Update docs/integrations/sources/pardot.md

Co-authored-by: Augustin <augustin@airbyte.io>

Co-authored-by: Augustin <augustin@airbyte.io>
 2022-12-20 16:57:25 -06:00
resoliwan
88c9844265 Source file: fix pandas read_csv header none issue. (#18587) 
* Source file: fix pandas read_csv header none issue.

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2022-12-02 19:43:03 -03:00
Arnaud Jeannin
0164355635 🎨 Add oss/cloud tags on doc for GA connectors (#19118) 
* feat: add cloud and oss tags

* put headers back

* fix: rm prettier style

* fix: aws styles
 2022-11-17 17:01:20 +01:00
Tyler B
524e2744be Add specifics for files stored in Google Drive (#19292) 
The URL for Google Drive cannot be the URL used for sharing and must be reformatted to work
 2022-11-10 13:42:32 -05:00
Serhii Chvaliuk
fce9184d86 Source File: using AirbyteConnectionStatus for "check" command instead of Exception (#19222) 2022-11-10 14:22:52 +01:00
Baz
91a10dae57 🐛 Source File: add retry logic for Connection reset by peer - 104 error (#18428) 2022-10-27 16:05:07 +03:00
Artem Inzhyyants
0daeb8dd7a 🐛 Source File: fix check method (#18481) 
* 🐛 Source File: fix check method

* 🐛 Source File: bump version

* 🐛 Source File: test for wrong format

* 🐛 Source File: docs update

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-26 18:34:10 +02:00
Serhii Chvaliuk
5b81897b96 Source File: add validate_and_transform of config (#18116) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-10-19 22:10:51 +03:00
Arsen Losenko
a28836e0c8 Source File: Handle UnicodeDecodeError in case of incorrect filetype (#17994) 
* Handle UnicodeDecodeError in case of incorrect filetype

* Update changelog and Dockerfile

* Update changelog with PR number

* Move try/except close to the end of method

* Add test and test files
 2022-10-17 12:20:03 +03:00
Baz
8c4b61c13b 🐛 Source File: add data presence validation for HTTPS for check_connection (#17504) 2022-10-03 18:44:56 +03:00
Augustin
ff4ea3961a Republish connectors using CDK 0.1.88 to 0.1.89 (#17304) 2022-09-28 18:18:59 +02:00
Denys Davydov
d780141f89 Source File: fix schema generation for json files containing an array (#16772) 
* #547 oncall Source File: fix schema generation for json files containing arrays

* source file: upda changelog

* #547 oncall: source file - upgrade source-file-secure

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-09-19 12:18:05 +03:00
Arsen Losenko
35257a0ec1 Source File: specify pyxlsb as engine for Excel file parsing (#15568) 
* Specify engine for excel files

* Add test for the chagne related to pyxlsb

* Update changelog and bump connector version

* Update PR link and number

* Update spec to include 'excel_binary' option, formatted files

* Update spec for source-file-secure to match changes made in source-file spec
 2022-08-26 17:34:16 +03:00
Denys Davydov
81bfb5c350 Source file: fix csv schema discovery (#15870) 
* #174 source file: fix csv schema discovery

* #174 source file: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-08-23 12:38:08 +03:00
Serhii Chvaliuk
e9fa2c4476 🎉 Source File: Convert 'nan' to 'null' (#15768) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-08-20 09:53:36 +03:00
Serhii Chvaliuk
f4adef7927 🎉 Source File: cache binary stream to file for discover (#15698) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-08-17 15:19:30 +03:00
Serhii Chvaliuk
5eef51ae15 🎉 Source File: cache binary stream to file (#15501) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-08-11 11:56:53 +03:00
midavadim
f143c8f02a 🎉 Source File - add support for custom encoding (#15293) 
* added support for custom encoding

* fixed unit test for utf16

* updated docs

* bumped connector version

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-08-10 21:13:51 +03:00
Serhii Chvaliuk
35125f8846 🎉 Source File: bump setup.py versions (#15269) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-08-06 12:28:03 +03:00
Denis Davydov
2570f9ce73 Source file: remove nested properties (#14535) 
* #13787 source file: remove nested properties

* #13787: upd changelog

* #13787 revert processing json array, add unit test

* #13787 source file: upgrade pyarrow to allow builds on aarch64

* #13787 source file: upd version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-07-13 11:29:51 +03:00
Christophe Duong
43f905b8f9 🎉 Add YAML format to source-file reader (#14588) 
* Add yaml reader

* Update docs

* Bumpversion of connector

* bump docs

* Update pyarrow dependency

* Upgrade pandas dependency

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-07-12 19:34:17 +02:00
Topher Lubaway
9c6c092a22 Revert "Improving docusaurus sidebar generation (#1927) (#14369)" (#14596) 
This reverts commit a2c194a11f.
 2022-07-11 15:27:14 -05:00
Mykyta Serbynevskiy
a2c194a11f Improving docusaurus sidebar generation (#1927) (#14369) 
* Improving docusaurus sidebar generation (#1927)

* Added "Career & open positions" folder to sidebar, adjusted "Project overview" folder

* Deleted "career-and-open-positions" folder from sidebar
 2022-07-08 14:18:27 -05:00
Serhii Chvaliuk
c021426752 🎉 Source File: Update airbyte-cdk>=0.1.47 to be compatible with latest SAT tests (#9974) 
* bump version 0.2.8 -> 0.2.9

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-02-01 19:50:47 +02:00
Augustin
14b301ce37 Update S3 and file sources docs: we do not support unstructured data (#9192) 2021-12-29 18:22:59 +01:00
Iryna Grankova
fefd5759c8 Update fields in source-connectors specifications: file, freshdesk, github, google-directory, google-workspace-admin-reports, iterable (#8524) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

Co-authored-by: Serhii Chvaliuk <grubberr@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2021-12-11 01:47:29 +02:00
Sherif A. Nada
e15c2a925f Fix UX handbook assets (#8020) 2021-11-16 11:02:07 -08:00
Yevhenii
269298c854 🎉 Source File: Migrate File source to CDK structure (#7387) 
* Migrate File source to CDK structure

* fix .dockerignore file

* remove SAT requirements

* update Dockerfile

* change Dockerfile to base images python:3.7-slim

* add SAT tests

* update tests

* add secret/config.json for source-file

* update changelogs
 2021-10-29 13:15:13 +03:00
Maksym Pavlenok
059645fad4 🎉 Source File: separate secure fork (#6768) 
* create a fork for the source-file connector

* update docs and tests

* update docs and tests

* add secrets

Co-authored-by: George Claireaux <george@claireaux.co.uk>

* switching among auth methods

* refactoring after reviews

* correction of doc

* update spec file



Co-authored-by: Maksym Pavlenok <maksym.pavlenok@globallogic.com>
Co-authored-by: George Claireaux <george@claireaux.co.uk>
 2021-10-20 12:28:26 +03:00
Abhi Vaidyanatha
ae32ecbb27 GitBook: [master] 186 pages and 77 assets modified 2021-10-08 21:17:47 +00:00
Abhi Vaidyanatha
15df1c6a2c 📚 Docs Refresh: Files Source (#6663) 
* Docs Refresh: Files

* Update title for Getting Started.

* Local files disabled note.

* Update docs/integrations/sources/file.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Update docs/integrations/sources/file.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2021-10-03 22:47:36 -07:00
Abhi Vaidyanatha
01b905a383 Add note to source-file about changing the parsed data type(s) (#5690) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-08-27 18:36:49 -07:00
Marcos Marx
b3c8214b72 Bump version for File connector (#5689) 
* source-file: adding support to XLSB format

* contributor pr + bump connector version

Co-authored-by: Muutech <info@muutech.com>
 2021-08-26 21:25:32 -03:00
Marcos Marx
e269c5f976 Test/Bump Version Source File (#5006) 
* Allow SFTP to define port

* Define port as a string

* Provide a clearer error if port parsing fails

* bump source file version

* try to resolve 409 azure

Co-authored-by: Madison Swain-Bowden <bowdenm@spu.edu>
 2021-07-27 19:29:13 -03:00
Marcos Marx
88d7953a18 Add CHANGELOG for Sources (#4215) 
* add changelog for postres source

* add changelog for mysql source

* add changelog for mssql source

* add changelog for file source

* add changelog for google sheets

* add full changelog for file source

* add full changelog for google sheet source

* add full changelog for mssql source

* add changelog for http requests

* add changelog for salesforce source

* add changelog for facebook marketing source

* add changelog for google analytics source

* add changelog for shopify native source connector
 2021-06-18 17:45:09 -03:00
Phlair
9360ed0da9 🎉 File source: Add support for Azure blob storage (#3660) 
Co-authored-by: Davin Chia <davinchia@gmail.com>
 2021-06-01 10:42:13 +08:00
Davin Chia
42686add8a Release connectors with namespace change. (#2990) 
Release all connectors affected by namespace change. Includes all JDBC sources and destinations.

Also add documentation for normalisation. Prerequisite to actually releasing 0.21.0-alpha.
 2021-04-21 11:35:08 +08:00
John Lafleur
55256d293d GitBook: [master] 55 pages and 36 assets modified 2021-04-05 00:43:26 +00:00
Christophe Duong
f7ada7c811 Fix docs formatting (#2282) 2021-03-03 17:45:07 +01:00
vitaliizazmic
caf673dfab Test file formats #1392 (#1768) 
Co-authored-by: Sherif Nada <snadalive@gmail.com>
 2021-02-02 14:49:11 -08:00
Eugene K
a54dd89418 Adopt connector best practices for File Source (providers) #1584 (#1738) 
Co-authored-by: Sherif Nada <snadalive@gmail.com>
 2021-01-27 16:49:33 -08:00
Shrif Nada
8aa97ed846 GitBook: [master] 4 pages and 13 assets modified 2020-11-13 17:26:05 +00:00
Christophe Duong
0d7ca6f424 Fix source file comments from #935 (#944) 
Adjust Source File from manual testings in #935
 2020-11-13 13:34:34 +01:00
Charles
ddffe3c6c6 temporarily pull out file source (#936) 2020-11-11 22:27:30 -08:00
Michel Tricot
5ecdfeb012 GitBook: [master] 8 pages and 42 assets modified 2020-11-11 02:46:18 +00:00