jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-21 02:51:29 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,485 Commits 5,109 Branches 518 Tags
bmoric/schema-mapping-postgres
Commit Graph

138 Commits

Author SHA1 Message Date
Augustin
ba40618bf6 source-file: [autopull] Upgrade base image to v1.2.2 (#39192) 2024-06-14 12:22:17 +02:00
Audrey Maldonado
b9690ba76e Wrapping changelog in details for a collapsible view (#38801) 2024-06-04 13:40:53 -04:00
Natik Gadzhi
cb80e6922a [tools] prettier rules for .md + formatting cleanup 2024-05-07 08:19:33 -07:00
Daryna Ishchenko
395effcf1d 🐛 Source File: add engine fastparquet to parquet reader options (#37799) 2024-05-07 17:23:40 +03:00
Anatolii Yatsuk
df17c85858 🏥 Source Connectors: Pin airbyte-cdk version to ^0 (#36267) 2024-03-20 21:46:57 -04:00
Aaron ("AJ") Steers
671ed4cdb1 Source File: Add Python 3.11 support (#35800) 2024-03-06 08:22:46 -08:00
Juan
c84c61b1e5 Update file.md (#35598) 2024-02-28 16:02:01 -05:00
Roman Yermilov [GL]
c379a7bd35 Source File: change header=0 to header=null in docs (#35595) 
CI tests failed because the version was not incremented, despite only a single line being altered in the documentation. This change is minor and can be safely merged.
 2024-02-23 20:21:25 +01:00
Julien COUTAND
a886ace52f ✨ Source File: support ZIP file (#32354) 
Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
Co-authored-by: Serhii Lazebnyi <serhii.lazebnyi@globallogic.com>
 2024-02-15 18:33:19 +01:00
mjgatz
f6b4436206 ✨ Source File: add fixed width file format support (#34678) 
Co-authored-by: mgreene <michael.greene@gravie.com>
Co-authored-by: Serhii Lazebnyi <serhii.lazebnyi@globallogic.com>
Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
 2024-02-13 19:58:35 +01:00
Augustin
103c9df8b6 ✨ source-file: migrate to poetry (#35186) 2024-02-13 04:57:51 -06:00
Joe Reuter
e2789b4f03 Update docusaurus to 3 (#33041) 2023-12-11 17:03:18 +01:00
Augustin
a41c4f5b3d Migrate connectors to use our python base image (Round 2) (#31599) 2023-10-19 17:58:45 +02:00
Pedro S. Lopez
d4ef599838 ✨ source-file: prevent local file usage on cloud deployment mode (#30984) 
Co-authored-by: pedroslopez <pedroslopez@users.noreply.github.com>
 2023-10-16 13:00:30 -07:00
Augustin
694d88f9ca ✨ source-file: 🪓 dockerfile and fix integration tests (#31341) 2023-10-13 10:12:17 +02:00
Denys Davydov
809d86bbb6 🐛 Source File: handle parse errors when running discovery (#30579) 2023-09-25 03:07:58 -05:00
Christo Grabowski
a0f74e825b 📝 Docs: Files Source setup steps update (#28090) 
* add connector setup steps

* add links to Azure Blob storage guides

* add instructions for azure blob

* expand SSH/SCP/SFTP configuration field section

* complete update of setup steps

* change limited tag for local filesystem to OSS

* minor fixes to file source page
 2023-07-12 08:31:24 -07:00
Juan
14c0212d89 Update File source doc (#27763) 
Included that AzBlob URL only needs the path to the file and not the base URL.
 2023-06-27 11:46:21 -04:00
Serhii Lazebnyi
0bdd8445cf Remove debug mode for pytest config (#27157) 
* Deleted pytest log level

* Force log level for smart open to error

* Bump version

* Bump version

* Delete extra space
 2023-06-08 19:17:15 +02:00
Augustin
c2b7043f3f connectors-ci: make source-file testable in airbyte-ci (#27107) 2023-06-08 15:03:59 +00:00
Daryna Ishchenko
2a1d7f37e2 🐛Source File: added parser error handling (#26275) 
* added parser error handling

* updated versions, added changelog

* Automated Change

---------

Co-authored-by: darynaishchenko <darynaishchenko@users.noreply.github.com>
 2023-05-25 19:02:57 +03:00
Serhii Chvaliuk
50c7cb438d Source File: add retry on SSHException('Error reading SSH protocol banner') - 2 (#26210) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2023-05-18 00:42:33 +03:00
Serhii Chvaliuk
033e62ad4c Source File Secure: bump source-file version 0.2.38 -> 0.3.7 (#26131) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2023-05-17 02:44:22 +03:00
Serhii Chvaliuk
63887f7fe0 Source File: add retry on SSHException('Error reading SSH protocol banner') (#26115) 
Signed-off-by: Serhii Chvaliuk <grubberr@gmail.com>
 2023-05-16 20:03:37 +03:00
Artem Inzhyyants
fc6165ee1c Source File: Check if reader options is JSON object (#26117) 
* Source File: check if reader options is JSON object

* Source File: bump version; update docs

* Source File: update error message

* Source File: format

* Source File: test fix

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-05-16 12:03:36 +00:00
Evan Tahler
3679dcd9d0 🐛 Fix date-time for airbyte types (#25965) 
* Fix airbyte types

* update firebolt test fixture

* Bump changelog PR ids

* update metadata files

* fix firebolt test

* fix file-source for date-time overload

* fix source-file changelog

* it's a date, not date-time

* another date

* auto-bump connector version

* manually bump definitions

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-05-12 01:15:30 +00:00
Evan Tahler
63d0402111 🐛 source-file GCP token is a secret (#25819) 
* source-file GCP token is a secret

* docs and changelog

* bump metadata

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-05-04 20:49:28 -07:00
Artem Inzhyyants
814b4f7f59 Source File: Handle network errors (#25641) 
* Source File: Handle network errors

* Source File: Add unit test

* Source File: bump version + docs update

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-05-01 15:52:05 +02:00
Artem Inzhyyants
a3fa2b15dd Source File: Fix OOM; read Excel files in chunks (#25575) 
* Source File: Use openpyxl to read excel files in chunks

* Source File: bump version

* Source File: update docs

* Source File Secure: bump version

* Source File Secure: add docstring

* Source File: use column names from reader options

* Source File: refactor; use pandas for non xlsx formats

* Source File: reformat

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-05-01 14:45:36 +02:00
Serhii Lazebnyi
3bfcddac2d 🎉Source File: Add datatime format parsing support for csv files (#25445) 
* Add datatime format parsing support

* Updated subject in docs

* Bump file secure

* PR number bumped

* Fix typo

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-04-25 11:57:10 +02:00
Ali Hassan
d7a3b2a04f 🐛 Source File: fix column data types for numerical values (#23759) 
* Fix column data types for numerical values

* Update unit tests

* Update Dockerfile version

* update dockerfile version for source-file-secure

* Update source-file in seed file

* Update doc

* Update source_specs.yaml

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2023-04-13 18:37:39 -03:00
Ujjwal Tyagi
812453fd8e Source File: fix example in Reader Options in specification (#24525) 
* Update file.md

* Update spec.json

* Update spec.json

* update versions and changelog

* bump version number

* update changelog and rebase

* auto-bump connector version

* fix integration test spec.json file

* remove unused files

* restore acceptance test

* convert all examples to string

* convert example to string

* regenerate seed

* change to airbyte.com

* Update source_specs.yaml

* Delete source_definitions.yaml

* regenerate source spec file

* update spec for file-secure

---------

Co-authored-by: Mal Hancock <mallory@archangelic.space>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2023-04-10 17:20:56 -03:00
Daryna Ishchenko
8bb84f2912 Source File: decrease give up rate, added better error message (#24588) 
* added fields description

* removed traceback from user messages

* bump version, added changelog

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-03-30 18:20:10 +03:00
Denys Davydov
9fe07dcf5d Source file: do not read whole file on check and discover (#24278) 
* #1681 source file: do not read whole file on check and discover

* #1681 source file: upd changelog

* #1681 source file: add allowed hosts

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-03-22 10:06:02 +02:00
Daryna Ishchenko
5f0d9f0f6f Source Files: decrease give up rate (#23723) 
* updated spec, docs, error messages

* added change log

* updated error message in unit tests

* added allowedHosts

* refactored error message and url descriprion

* updated example for url field in spec

* bump source-file verion for source-file-secure

* auto-bump connector version

* updated spec.json for source-file-secure

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-03-10 11:13:05 +02:00
Baz
3a4c45ba4d updated name and docs (#23331) 2023-02-23 01:35:13 +02:00
Ella Rohm-Ensing
aad9d400b1 resolve connector dependency workflow missing changelogs (#23314) 
* Add changelog entry for destination-clickhouse 0.2.2

* Delete csv.md

* local-csv.md -> csv.md
 2023-02-21 17:57:19 -05:00
Jon Martin
acadee08bc Add instructions for mounting Windows directory. (#21405) 
There're currently no directions as to what a user would need to change to be able to mount a raw directory into the Docker containers to be able to use a file as a source.
 2023-01-17 07:53:59 -03:00
Simon Späti
26053ef727 📝 Add warning for working with local files and Docker Desktop (/tmp and /private) (#21004) 2023-01-05 10:54:58 +01:00
Artem Inzhyyants
10d7bea363 Source File: Fix special characters bug (#21012) 
* Source File: Fix special characters bug

* Source File: bump version; update docs

* Source File: update SSH credentials in unit tests

* Source File: bump version (secure)

* Source File: update resources manually
 2023-01-04 20:58:42 +01:00
Artem Inzhyyants
54377e4eec Source File: increase timeout OC 1197 (#20740) 
* Source File: increase timeout OC 1197

* Source File: docs update; bump version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-12-21 14:28:40 -06:00
Evan Tahler
a55eb7df2d Fix CI Dependency Check Failures (#20666) 
* pardot

* plaid

* quickbooks

* appfollow

* appstore

* cloudtrail

* clickup

* clockify

* coda

* Coinmarketcap

* cooper

* dixa

* dv-360

* exchange-rates

* file

* gridly

* Hellobaton

* kustomer

* mailersend

* microsoft dataverse

* n8n

* PersistIq

* Survey Sparrow

* Twilio Taskrouter

* YouTube Analytics Business

* Younium

* Yahoo Finance Price

* Yandex Metrica

* Xero

* WooCommerce

* XKCD

* Webflow

* US Census API

* Qonto

* Pivotal Tracker

* KVDB

* Firestore

* Ignore even more connectors

* test run

* SFTP JSON

* cleanup

* move pardot changelog

* update links

* remove testing HACK

* Update docs/integrations/sources/dixa.md

Co-authored-by: Augustin <augustin@airbyte.io>

* Update docs/integrations/sources/kustomer-singer.md

Co-authored-by: Augustin <augustin@airbyte.io>

* Update docs/integrations/sources/pardot.md

Co-authored-by: Augustin <augustin@airbyte.io>

* Update docs/integrations/sources/kustomer-singer.md

Co-authored-by: Augustin <augustin@airbyte.io>

* Update docs/integrations/sources/pardot.md

Co-authored-by: Augustin <augustin@airbyte.io>

Co-authored-by: Augustin <augustin@airbyte.io>
 2022-12-20 16:57:25 -06:00
resoliwan
88c9844265 Source file: fix pandas read_csv header none issue. (#18587) 
* Source file: fix pandas read_csv header none issue.

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2022-12-02 19:43:03 -03:00
Arnaud Jeannin
0164355635 🎨 Add oss/cloud tags on doc for GA connectors (#19118) 
* feat: add cloud and oss tags

* put headers back

* fix: rm prettier style

* fix: aws styles
 2022-11-17 17:01:20 +01:00
Tyler B
524e2744be Add specifics for files stored in Google Drive (#19292) 
The URL for Google Drive cannot be the URL used for sharing and must be reformatted to work
 2022-11-10 13:42:32 -05:00
Serhii Chvaliuk
fce9184d86 Source File: using AirbyteConnectionStatus for "check" command instead of Exception (#19222) 2022-11-10 14:22:52 +01:00
Baz
91a10dae57 🐛 Source File: add retry logic for Connection reset by peer - 104 error (#18428) 2022-10-27 16:05:07 +03:00
Artem Inzhyyants
0daeb8dd7a 🐛 Source File: fix check method (#18481) 
* 🐛 Source File: fix check method

* 🐛 Source File: bump version

* 🐛 Source File: test for wrong format

* 🐛 Source File: docs update

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-26 18:34:10 +02:00
Serhii Chvaliuk
5b81897b96 Source File: add validate_and_transform of config (#18116) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-10-19 22:10:51 +03:00
Arsen Losenko
a28836e0c8 Source File: Handle UnicodeDecodeError in case of incorrect filetype (#17994) 
* Handle UnicodeDecodeError in case of incorrect filetype

* Update changelog and Dockerfile

* Update changelog with PR number

* Move try/except close to the end of method

* Add test and test files
 2022-10-17 12:20:03 +03:00