jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-21 11:01:41 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,480 Commits 5,109 Branches 518 Tags
yarden/source-mongodb-support-dynamic-arrays
Commit Graph

25 Commits

Author SHA1 Message Date
mjgatz
f6b4436206 ✨ Source File: add fixed width file format support (#34678) 
Co-authored-by: mgreene <michael.greene@gravie.com>
Co-authored-by: Serhii Lazebnyi <serhii.lazebnyi@globallogic.com>
Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
 2024-02-13 19:58:35 +01:00
Evan Tahler
63d0402111 🐛 source-file GCP token is a secret (#25819) 
* source-file GCP token is a secret

* docs and changelog

* bump metadata

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-05-04 20:49:28 -07:00
Ujjwal Tyagi
812453fd8e Source File: fix example in Reader Options in specification (#24525) 
* Update file.md

* Update spec.json

* Update spec.json

* update versions and changelog

* bump version number

* update changelog and rebase

* auto-bump connector version

* fix integration test spec.json file

* remove unused files

* restore acceptance test

* convert all examples to string

* convert example to string

* regenerate seed

* change to airbyte.com

* Update source_specs.yaml

* Delete source_definitions.yaml

* regenerate source spec file

* update spec for file-secure

---------

Co-authored-by: Mal Hancock <mallory@archangelic.space>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2023-04-10 17:20:56 -03:00
Daryna Ishchenko
5f0d9f0f6f Source Files: decrease give up rate (#23723) 
* updated spec, docs, error messages

* added change log

* updated error message in unit tests

* added allowedHosts

* refactored error message and url descriprion

* updated example for url field in spec

* bump source-file verion for source-file-secure

* auto-bump connector version

* updated spec.json for source-file-secure

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-03-10 11:13:05 +02:00
Eugene
33dfd5d6be Fixed "Ensure no file change" build issue. Only checkstyle changes, no logic chnages (#17885) 2022-10-12 15:06:28 +03:00
Pedro S. Lopez
938436bcc9 update connector specs and definitions with new .com documentation urls (#17585) 
* update definitions with new .com docs urls

* update docs urls in specs

* update generators

* regenerate scaffold connectors

* remove unrelated changes

* update more urls

* update specs

* fix tests

* run `:airbyte-config:specs:generateSeedConnectorSpecs` to fix formatting

* revert docs changes to make pr more reviewable

* revert generator readme changes to make more reviewable

* fix mysql strict encrypt expected spec

* fix postgres expected spec
 2022-10-11 11:04:23 -04:00
Arsen Losenko
35257a0ec1 Source File: specify pyxlsb as engine for Excel file parsing (#15568) 
* Specify engine for excel files

* Add test for the chagne related to pyxlsb

* Update changelog and bump connector version

* Update PR link and number

* Update spec to include 'excel_binary' option, formatted files

* Update spec for source-file-secure to match changes made in source-file spec
 2022-08-26 17:34:16 +03:00
Serhii Chvaliuk
35125f8846 🎉 Source File: bump setup.py versions (#15269) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-08-06 12:28:03 +03:00
Tim Werner
32e767c9f6 🎉 Source File: add user-agent option (#14488) 
* add user-agent option to source-file

* fix acceptance-test

* set version to 0.0 if version cannot be fetched

* vump connector version

* auto-bump connector version

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-07-13 13:46:05 -03:00
Christophe Duong
43f905b8f9 🎉 Add YAML format to source-file reader (#14588) 
* Add yaml reader

* Update docs

* Bumpversion of connector

* bump docs

* Update pyarrow dependency

* Upgrade pandas dependency

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-07-12 19:34:17 +02:00
Marcos Marx
d3b1d15ade Source File: correct spec json to match json format (#13738) 2022-06-28 13:11:35 -03:00
George Claireaux
26aa43b31e Source File: Update Dockerfile to latest Airbyte template (#11969) 
* update to our newer Dockerfile format

* fixes to source-file spec

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-04-13 16:39:59 +01:00
Iryna Grankova
fefd5759c8 Update fields in source-connectors specifications: file, freshdesk, github, google-directory, google-workspace-admin-reports, iterable (#8524) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

Co-authored-by: Serhii Chvaliuk <grubberr@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2021-12-11 01:47:29 +02:00
Yevhenii
269298c854 🎉 Source File: Migrate File source to CDK structure (#7387) 
* Migrate File source to CDK structure

* fix .dockerignore file

* remove SAT requirements

* update Dockerfile

* change Dockerfile to base images python:3.7-slim

* add SAT tests

* update tests

* add secret/config.json for source-file

* update changelogs
 2021-10-29 13:15:13 +03:00
Madison Swain-Bowden
2d5d7e8e98 🎉 Allow non-default source SFTP port (#4953) 
* Allow SFTP to define port

* Define port as a string

* Provide a clearer error if port parsing fails
 2021-07-27 18:52:55 -03:00
Phlair
9360ed0da9 🎉 File source: Add support for Azure blob storage (#3660) 
Co-authored-by: Davin Chia <davinchia@gmail.com>
 2021-06-01 10:42:13 +08:00
Sherif A. Nada
d4267818ae Source File: Support JsonL format (#2118) 2021-02-18 13:54:26 -08:00
vitaliizazmic
caf673dfab Test file formats #1392 (#1768) 
Co-authored-by: Sherif Nada <snadalive@gmail.com>
 2021-02-02 14:49:11 -08:00
Eugene K
a54dd89418 Adopt connector best practices for File Source (providers) #1584 (#1738) 
Co-authored-by: Sherif Nada <snadalive@gmail.com>
 2021-01-27 16:49:33 -08:00
Sherif A. Nada
f4c3ac70f9 annotate secret fields (#1012) 2020-11-19 15:13:23 -08:00
Christophe Duong
0d7ca6f424 Fix source file comments from #935 (#944) 
Adjust Source File from manual testings in #935
 2020-11-13 13:34:34 +01:00
Christophe Duong
70f0446677 Adapt Source File connector to JSON files to test normalization (#872) 
Fix spec.json for Source File and prepare JSON loader for nested schema testing
 2020-11-11 00:33:39 +01:00
Sherif A. Nada
6f817a855c add HTTPs into oneof in filespec (#842) 2020-11-06 18:00:38 -08:00
Christophe Duong
e823bcb04a Add Name to Source File specs to fix #772 (#832) 2020-11-06 19:35:06 +01:00
Christophe Duong
daf58b2dbd Add SourceFile integration (#716) 
Implement Source for files stored in GCS/S3/SFTP/SSH/SCP
 2020-11-02 18:43:59 +01:00