1
0
mirror of synced 2025-12-21 11:01:41 -05:00
Commit Graph

102 Commits

Author SHA1 Message Date
Airbyte
5bb6ec82da 🐙 source-file: run up-to-date pipeline [2024-10-12] (#45795) 2024-10-13 03:22:15 +03:00
Daryna Ishchenko
6b879cc621 docs: fix docs for sources - Facebook Marketing, Google Ads, Google Sheets, File (#46537) 2024-10-10 17:06:21 +03:00
Natalie Kwong
b0407dc16a docs: Add field anchors for top source docs (#45885) 2024-09-25 08:55:06 -05:00
Airbyte
45a26920e1 🐙 source-file: run up-to-date pipeline [2024-09-14] (#45499) 2024-09-15 03:22:07 +03:00
Airbyte
004fae94b3 🐙 source-file: run up-to-date pipeline [2024-09-07] (#45261) 2024-09-08 03:20:25 +03:00
Airbyte
fb3f1e9b85 🐙 source-file: run up-to-date pipeline [2024-08-31] (#44974) 2024-09-01 03:22:22 +03:00
Airbyte
4da9f53641 🐙 source-file: run up-to-date pipeline [2024-08-24] (#44637) 2024-08-25 03:21:55 +03:00
Airbyte
17cf47df4e 🐙 source-file: run up-to-date pipeline [2024-08-17] (#44286) 2024-08-18 03:20:10 +03:00
Daryna Ishchenko
fc35c03aa4 fix(connectors docs): updated connectors to follow standard template (#39328) 2024-08-14 10:53:16 -05:00
Airbyte
3edc408522 🐙 source-file: run up-to-date pipeline [2024-08-12] (#43896) 2024-08-12 19:49:27 +03:00
Augustin
d020ac8235 🐙 source-file: run up-to-date pipeline [2024-08-10] (#43675) 2024-08-11 02:18:30 +02:00
Augustin
126cc0563d 🐙 source-file: run up-to-date pipeline [2024-08-03] (#39978) 2024-08-04 02:36:12 +02:00
Carlos Alvarenga
bc36dd2052 Source file: Fix error on zipped files (#39909)
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
2024-08-01 16:10:24 -03:00
Natik Gadzhi
30643ae71f chore: replace AirbyteLogger with logging.Logger in connectors (#40215)
Co-authored-by: btkcodedev <btk.codedev@gmail.com>
2024-06-27 18:02:01 +02:00
Augustin
ba40618bf6 source-file: [autopull] Upgrade base image to v1.2.2 (#39192) 2024-06-14 12:22:17 +02:00
Audrey Maldonado
b9690ba76e Wrapping changelog in details for a collapsible view (#38801) 2024-06-04 13:40:53 -04:00
Natik Gadzhi
cb80e6922a [tools] prettier rules for .md + formatting cleanup 2024-05-07 08:19:33 -07:00
Daryna Ishchenko
395effcf1d 🐛 Source File: add engine fastparquet to parquet reader options (#37799) 2024-05-07 17:23:40 +03:00
Anatolii Yatsuk
df17c85858 🏥 Source Connectors: Pin airbyte-cdk version to ^0 (#36267) 2024-03-20 21:46:57 -04:00
Aaron ("AJ") Steers
671ed4cdb1 Source File: Add Python 3.11 support (#35800) 2024-03-06 08:22:46 -08:00
Juan
c84c61b1e5 Update file.md (#35598) 2024-02-28 16:02:01 -05:00
Roman Yermilov [GL]
c379a7bd35 Source File: change header=0 to header=null in docs (#35595)
CI tests failed because the version was not incremented, despite only a single line being altered in the documentation. This change is minor and can be safely merged.
2024-02-23 20:21:25 +01:00
Julien COUTAND
a886ace52f Source File: support ZIP file (#32354)
Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
Co-authored-by: Serhii Lazebnyi <serhii.lazebnyi@globallogic.com>
2024-02-15 18:33:19 +01:00
mjgatz
f6b4436206 Source File: add fixed width file format support (#34678)
Co-authored-by: mgreene <michael.greene@gravie.com>
Co-authored-by: Serhii Lazebnyi <serhii.lazebnyi@globallogic.com>
Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
2024-02-13 19:58:35 +01:00
Augustin
103c9df8b6 source-file: migrate to poetry (#35186) 2024-02-13 04:57:51 -06:00
Joe Reuter
e2789b4f03 Update docusaurus to 3 (#33041) 2023-12-11 17:03:18 +01:00
Augustin
a41c4f5b3d Migrate connectors to use our python base image (Round 2) (#31599) 2023-10-19 17:58:45 +02:00
Pedro S. Lopez
d4ef599838 source-file: prevent local file usage on cloud deployment mode (#30984)
Co-authored-by: pedroslopez <pedroslopez@users.noreply.github.com>
2023-10-16 13:00:30 -07:00
Augustin
694d88f9ca source-file: 🪓 dockerfile and fix integration tests (#31341) 2023-10-13 10:12:17 +02:00
Denys Davydov
809d86bbb6 🐛 Source File: handle parse errors when running discovery (#30579) 2023-09-25 03:07:58 -05:00
Christo Grabowski
a0f74e825b 📝 Docs: Files Source setup steps update (#28090)
* add connector setup steps

* add links to Azure Blob storage guides

* add instructions for azure blob

* expand SSH/SCP/SFTP configuration field section

* complete update of setup steps

* change limited tag for local filesystem to OSS

* minor fixes to file source page
2023-07-12 08:31:24 -07:00
Juan
14c0212d89 Update File source doc (#27763)
Included that AzBlob URL only needs the path to the file and not the base URL.
2023-06-27 11:46:21 -04:00
Serhii Lazebnyi
0bdd8445cf Remove debug mode for pytest config (#27157)
* Deleted pytest log level

* Force log level for smart open to error

* Bump version

* Bump version

* Delete extra space
2023-06-08 19:17:15 +02:00
Augustin
c2b7043f3f connectors-ci: make source-file testable in airbyte-ci (#27107) 2023-06-08 15:03:59 +00:00
Daryna Ishchenko
2a1d7f37e2 🐛Source File: added parser error handling (#26275)
* added parser error handling

* updated versions, added changelog

* Automated Change

---------

Co-authored-by: darynaishchenko <darynaishchenko@users.noreply.github.com>
2023-05-25 19:02:57 +03:00
Serhii Chvaliuk
50c7cb438d Source File: add retry on SSHException('Error reading SSH protocol banner') - 2 (#26210)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2023-05-18 00:42:33 +03:00
Serhii Chvaliuk
033e62ad4c Source File Secure: bump source-file version 0.2.38 -> 0.3.7 (#26131)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2023-05-17 02:44:22 +03:00
Serhii Chvaliuk
63887f7fe0 Source File: add retry on SSHException('Error reading SSH protocol banner') (#26115)
Signed-off-by: Serhii Chvaliuk <grubberr@gmail.com>
2023-05-16 20:03:37 +03:00
Artem Inzhyyants
fc6165ee1c Source File: Check if reader options is JSON object (#26117)
* Source File: check if reader options is JSON object

* Source File: bump version; update docs

* Source File: update error message

* Source File: format

* Source File: test fix

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-05-16 12:03:36 +00:00
Evan Tahler
3679dcd9d0 🐛 Fix date-time for airbyte types (#25965)
* Fix airbyte types

* update firebolt test fixture

* Bump changelog PR ids

* update metadata files

* fix firebolt test

* fix file-source for date-time overload

* fix source-file changelog

* it's a date, not date-time

* another date

* auto-bump connector version

* manually bump definitions

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-05-12 01:15:30 +00:00
Evan Tahler
63d0402111 🐛 source-file GCP token is a secret (#25819)
* source-file GCP token is a secret

* docs and changelog

* bump metadata

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-05-04 20:49:28 -07:00
Artem Inzhyyants
814b4f7f59 Source File: Handle network errors (#25641)
* Source File: Handle network errors

* Source File: Add unit test

* Source File: bump version + docs update

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-05-01 15:52:05 +02:00
Artem Inzhyyants
a3fa2b15dd Source File: Fix OOM; read Excel files in chunks (#25575)
* Source File: Use openpyxl to read excel files in chunks

* Source File: bump version

* Source File: update docs

* Source File Secure: bump version

* Source File Secure: add docstring

* Source File: use column names from reader options

* Source File: refactor; use pandas for non xlsx formats

* Source File: reformat

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-05-01 14:45:36 +02:00
Serhii Lazebnyi
3bfcddac2d 🎉Source File: Add datatime format parsing support for csv files (#25445)
* Add datatime format parsing support

* Updated subject in docs

* Bump file secure

* PR number bumped

* Fix typo

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-25 11:57:10 +02:00
Ali Hassan
d7a3b2a04f 🐛 Source File: fix column data types for numerical values (#23759)
* Fix column data types for numerical values

* Update unit tests

* Update Dockerfile version

* update dockerfile version for source-file-secure

* Update source-file in seed file

* Update doc

* Update source_specs.yaml

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
2023-04-13 18:37:39 -03:00
Ujjwal Tyagi
812453fd8e Source File: fix example in Reader Options in specification (#24525)
* Update file.md

* Update spec.json

* Update spec.json

* update versions and changelog

* bump version number

* update changelog and rebase

* auto-bump connector version

* fix integration test spec.json file

* remove unused files

* restore acceptance test

* convert all examples to string

* convert example to string

* regenerate seed

* change to airbyte.com

* Update source_specs.yaml

* Delete source_definitions.yaml

* regenerate source spec file

* update spec for file-secure

---------

Co-authored-by: Mal Hancock <mallory@archangelic.space>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
2023-04-10 17:20:56 -03:00
Daryna Ishchenko
8bb84f2912 Source File: decrease give up rate, added better error message (#24588)
* added fields description

* removed traceback from user messages

* bump version, added changelog

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-30 18:20:10 +03:00
Denys Davydov
9fe07dcf5d Source file: do not read whole file on check and discover (#24278)
* #1681 source file: do not read whole file on check and discover

* #1681 source file: upd changelog

* #1681 source file: add allowed hosts

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-22 10:06:02 +02:00
Daryna Ishchenko
5f0d9f0f6f Source Files: decrease give up rate (#23723)
* updated spec, docs, error messages

* added change log

* updated error message in unit tests

* added allowedHosts

* refactored error message and url descriprion

* updated example for url field in spec

* bump source-file verion for source-file-secure

* auto-bump connector version

* updated spec.json for source-file-secure

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-10 11:13:05 +02:00
Baz
3a4c45ba4d updated name and docs (#23331) 2023-02-23 01:35:13 +02:00