jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-21 11:01:41 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,485 Commits 5,109 Branches 518 Tags
bmoric/schema-mapping-postgres
Commit Graph

138 Commits

Author SHA1 Message Date
Baz
8c4b61c13b 🐛 Source File: add data presence validation for HTTPS for check_connection (#17504) 2022-10-03 18:44:56 +03:00
Augustin
ff4ea3961a Republish connectors using CDK 0.1.88 to 0.1.89 (#17304) 2022-09-28 18:18:59 +02:00
Denys Davydov
d780141f89 Source File: fix schema generation for json files containing an array (#16772) 
* #547 oncall Source File: fix schema generation for json files containing arrays

* source file: upda changelog

* #547 oncall: source file - upgrade source-file-secure

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-09-19 12:18:05 +03:00
Arsen Losenko
35257a0ec1 Source File: specify pyxlsb as engine for Excel file parsing (#15568) 
* Specify engine for excel files

* Add test for the chagne related to pyxlsb

* Update changelog and bump connector version

* Update PR link and number

* Update spec to include 'excel_binary' option, formatted files

* Update spec for source-file-secure to match changes made in source-file spec
 2022-08-26 17:34:16 +03:00
Denys Davydov
81bfb5c350 Source file: fix csv schema discovery (#15870) 
* #174 source file: fix csv schema discovery

* #174 source file: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-08-23 12:38:08 +03:00
Serhii Chvaliuk
e9fa2c4476 🎉 Source File: Convert 'nan' to 'null' (#15768) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-08-20 09:53:36 +03:00
Serhii Chvaliuk
f4adef7927 🎉 Source File: cache binary stream to file for discover (#15698) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-08-17 15:19:30 +03:00
Serhii Chvaliuk
5eef51ae15 🎉 Source File: cache binary stream to file (#15501) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-08-11 11:56:53 +03:00
midavadim
f143c8f02a 🎉 Source File - add support for custom encoding (#15293) 
* added support for custom encoding

* fixed unit test for utf16

* updated docs

* bumped connector version

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-08-10 21:13:51 +03:00
Serhii Chvaliuk
35125f8846 🎉 Source File: bump setup.py versions (#15269) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-08-06 12:28:03 +03:00
Denis Davydov
2570f9ce73 Source file: remove nested properties (#14535) 
* #13787 source file: remove nested properties

* #13787: upd changelog

* #13787 revert processing json array, add unit test

* #13787 source file: upgrade pyarrow to allow builds on aarch64

* #13787 source file: upd version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-07-13 11:29:51 +03:00
Christophe Duong
43f905b8f9 🎉 Add YAML format to source-file reader (#14588) 
* Add yaml reader

* Update docs

* Bumpversion of connector

* bump docs

* Update pyarrow dependency

* Upgrade pandas dependency

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-07-12 19:34:17 +02:00
Topher Lubaway
9c6c092a22 Revert "Improving docusaurus sidebar generation (#1927) (#14369)" (#14596) 
This reverts commit a2c194a11f.
 2022-07-11 15:27:14 -05:00
Mykyta Serbynevskiy
a2c194a11f Improving docusaurus sidebar generation (#1927) (#14369) 
* Improving docusaurus sidebar generation (#1927)

* Added "Career & open positions" folder to sidebar, adjusted "Project overview" folder

* Deleted "career-and-open-positions" folder from sidebar
 2022-07-08 14:18:27 -05:00
Serhii Chvaliuk
c021426752 🎉 Source File: Update airbyte-cdk>=0.1.47 to be compatible with latest SAT tests (#9974) 
* bump version 0.2.8 -> 0.2.9

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-02-01 19:50:47 +02:00
Augustin
14b301ce37 Update S3 and file sources docs: we do not support unstructured data (#9192) 2021-12-29 18:22:59 +01:00
Iryna Grankova
fefd5759c8 Update fields in source-connectors specifications: file, freshdesk, github, google-directory, google-workspace-admin-reports, iterable (#8524) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

Co-authored-by: Serhii Chvaliuk <grubberr@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2021-12-11 01:47:29 +02:00
Sherif A. Nada
e15c2a925f Fix UX handbook assets (#8020) 2021-11-16 11:02:07 -08:00
Yevhenii
269298c854 🎉 Source File: Migrate File source to CDK structure (#7387) 
* Migrate File source to CDK structure

* fix .dockerignore file

* remove SAT requirements

* update Dockerfile

* change Dockerfile to base images python:3.7-slim

* add SAT tests

* update tests

* add secret/config.json for source-file

* update changelogs
 2021-10-29 13:15:13 +03:00
Maksym Pavlenok
059645fad4 🎉 Source File: separate secure fork (#6768) 
* create a fork for the source-file connector

* update docs and tests

* update docs and tests

* add secrets

Co-authored-by: George Claireaux <george@claireaux.co.uk>

* switching among auth methods

* refactoring after reviews

* correction of doc

* update spec file



Co-authored-by: Maksym Pavlenok <maksym.pavlenok@globallogic.com>
Co-authored-by: George Claireaux <george@claireaux.co.uk>
 2021-10-20 12:28:26 +03:00
Abhi Vaidyanatha
ae32ecbb27 GitBook: [master] 186 pages and 77 assets modified 2021-10-08 21:17:47 +00:00
Abhi Vaidyanatha
15df1c6a2c 📚 Docs Refresh: Files Source (#6663) 
* Docs Refresh: Files

* Update title for Getting Started.

* Local files disabled note.

* Update docs/integrations/sources/file.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Update docs/integrations/sources/file.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2021-10-03 22:47:36 -07:00
Abhi Vaidyanatha
01b905a383 Add note to source-file about changing the parsed data type(s) (#5690) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-08-27 18:36:49 -07:00
Marcos Marx
b3c8214b72 Bump version for File connector (#5689) 
* source-file: adding support to XLSB format

* contributor pr + bump connector version

Co-authored-by: Muutech <info@muutech.com>
 2021-08-26 21:25:32 -03:00
Marcos Marx
e269c5f976 Test/Bump Version Source File (#5006) 
* Allow SFTP to define port

* Define port as a string

* Provide a clearer error if port parsing fails

* bump source file version

* try to resolve 409 azure

Co-authored-by: Madison Swain-Bowden <bowdenm@spu.edu>
 2021-07-27 19:29:13 -03:00
Marcos Marx
88d7953a18 Add CHANGELOG for Sources (#4215) 
* add changelog for postres source

* add changelog for mysql source

* add changelog for mssql source

* add changelog for file source

* add changelog for google sheets

* add full changelog for file source

* add full changelog for google sheet source

* add full changelog for mssql source

* add changelog for http requests

* add changelog for salesforce source

* add changelog for facebook marketing source

* add changelog for google analytics source

* add changelog for shopify native source connector
 2021-06-18 17:45:09 -03:00
Phlair
9360ed0da9 🎉 File source: Add support for Azure blob storage (#3660) 
Co-authored-by: Davin Chia <davinchia@gmail.com>
 2021-06-01 10:42:13 +08:00
Davin Chia
42686add8a Release connectors with namespace change. (#2990) 
Release all connectors affected by namespace change. Includes all JDBC sources and destinations.

Also add documentation for normalisation. Prerequisite to actually releasing 0.21.0-alpha.
 2021-04-21 11:35:08 +08:00
John Lafleur
55256d293d GitBook: [master] 55 pages and 36 assets modified 2021-04-05 00:43:26 +00:00
Christophe Duong
f7ada7c811 Fix docs formatting (#2282) 2021-03-03 17:45:07 +01:00
vitaliizazmic
caf673dfab Test file formats #1392 (#1768) 
Co-authored-by: Sherif Nada <snadalive@gmail.com>
 2021-02-02 14:49:11 -08:00
Eugene K
a54dd89418 Adopt connector best practices for File Source (providers) #1584 (#1738) 
Co-authored-by: Sherif Nada <snadalive@gmail.com>
 2021-01-27 16:49:33 -08:00
Shrif Nada
8aa97ed846 GitBook: [master] 4 pages and 13 assets modified 2020-11-13 17:26:05 +00:00
Christophe Duong
0d7ca6f424 Fix source file comments from #935 (#944) 
Adjust Source File from manual testings in #935
 2020-11-13 13:34:34 +01:00
Charles
ddffe3c6c6 temporarily pull out file source (#936) 2020-11-11 22:27:30 -08:00
Michel Tricot
5ecdfeb012 GitBook: [master] 8 pages and 42 assets modified 2020-11-11 02:46:18 +00:00
Charles
3d3b449472 fix link to csv destination from source file(#885) 2020-11-10 14:55:08 -08:00
Christophe Duong
4e0cc39b97 Add documentation for Source File (#879) 2020-11-10 21:02:26 +01:00