Aldo Gonzalez
3ef6fcf459
✨ feat(source-sftp-bulk): adjust file record message protocol ( #57514 )
2025-05-06 14:31:47 -06:00
Aldo Gonzalez
d4c848c285
feat(source-sftp-bulk): not mirroring paths toggle for file transfer ( #50972 )
...
When "Preserve Subdirectories in File Paths" disabled we will not replicate the directory structure in the source but put all the files in the stream root folder of the destination.
2025-01-16 08:43:39 -06:00
Aaron ("AJ") Steers
83ecbe0fc3
CI: apply pre-commit format fix from #49806 ( #49852 )
2024-12-18 14:05:43 -08:00
Aldo Gonzalez
567407eddd
✨ Feat(source-sftp): add get file helper for file-transfer ( #48434 )
2024-12-02 12:53:53 -06:00
Stephane Geneix
6294144c16
source-sftp-bulk: make the private key an airbyte secret ( #46739 )
...
simply making the private key an airbyte secret.
I also tested this change in cloud on an existing connection where the field was not an airbyteSecret, and everything worked smoothly
2024-11-06 10:45:15 -08:00
Aldo Gonzalez
f60e1494f9
✨ Feat(souce-sftp-bulk): file transfer changes ( #47703 )
2024-10-31 11:25:36 -06:00
Stephane Geneix
b46db59bee
source-sftp-bulk: fix tests ( #47218 )
...
## What
<!--
* Describe what the change is solving. Link all GitHub issues related to this change.
-->
## How
<!--
* Describe how code changes achieve the solution.
-->
## Review guide
<!--
1. `x.py`
2. `y.py`
-->
## User Impact
<!--
* What is the end result perceived by the user?
* If there are negative side effects, please list them.
-->
## Can this PR be safely reverted and rolled back?
<!--
* If unsure, leave it blank.
-->
- [ ] YES 💚
- [ ] NO ❌
2024-10-22 10:55:08 -07:00
Aldo Gonzalez
3866702778
✨ feat(Source sftp-bulk): upgrade to CDK 5 ( #46323 )
2024-10-03 07:55:51 -06:00
Serhii Lazebnyi
325525dd9e
refactor(source-sftp-bulk) bump CDK version to v4 ( #44028 )
2024-08-14 23:20:39 +02:00
Anton Karpets
4f0d12ec9b
✨ Source SFTP Bulk: avoid error on empty stream when running discover ( #38703 )
2024-05-28 16:00:29 +03:00
Artem Inzhyyants
b88ed51ef4
🚨 🚨 Source SFTP Bulk: migrate to file-based CDK ( #36256 )
...
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com >
2024-04-15 17:58:49 +02:00
Marius Posta
7ae97175a6
gradle: fix repo wide behaviour ( #30607 )
2023-09-28 05:01:13 -07:00
Ana Loureiro
a6d6b06303
Source SFTP-Bulk: Support custom CSV separators ( #19224 )
...
* manage different separators
* tests
* update tests
* add optional parameter for separator
* add default separator
* typo
* add trailing newline
* fix spec.json order
* bump dockerfile version
* update changelog
* auto-bump connector version
* retrigger checks
* retrigger checks
---------
Co-authored-by: Sunny Hashmi <6833405+sh4sh@users.noreply.github.com >
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2023-04-20 10:02:19 -04:00
Cole Snodgrass
2e099acc52
update headers from 2022 -> 2023 ( #22594 )
...
* It's 2023!
* 2022 -> 2023
---------
Co-authored-by: evantahler <evan@airbyte.io >
2023-02-08 13:01:16 -08:00
Joe Reuter
6a10ae3e05
Rename source acceptance test to connector acceptance test ( #21846 )
...
Rename source acceptance test to connector acceptance test
2023-02-02 11:38:19 +01:00
Henri Blancke
c469ea8c4f
🎉 New source: SFTP Bulk [python cdk] ( #17691 )
...
* [INIT] setup source-ftp
Signed-off-by: Henri Blancke <blanckehenri@gmail.com >
* [ADD] add logic
Signed-off-by: Henri Blancke <blanckehenri@gmail.com >
* [ADD] unit, integration, acceptance tests
Signed-off-by: Henri Blancke <blanckehenri@gmail.com >
* [UPD] update docs
Signed-off-by: Henri Blancke <blanckehenri@gmail.com >
* [UPD] clean up crew
Signed-off-by: Henri Blancke <blanckehenri@gmail.com >
* [UPD] update host to localhost
Signed-off-by: Henri Blancke <blanckehenri@gmail.com >
* [UPD] rename from ftp to sftp bulk
Signed-off-by: Henri Blancke <blanckehenri@gmail.com >
* [INIT] setup source-ftp
Signed-off-by: Henri Blancke <blanckehenri@gmail.com >
* [ADD] add logic
Signed-off-by: Henri Blancke <blanckehenri@gmail.com >
* [ADD] unit, integration, acceptance tests
Signed-off-by: Henri Blancke <blanckehenri@gmail.com >
* [UPD] update docs
Signed-off-by: Henri Blancke <blanckehenri@gmail.com >
* [UPD] clean up crew
Signed-off-by: Henri Blancke <blanckehenri@gmail.com >
* [UPD] update host to localhost
Signed-off-by: Henri Blancke <blanckehenri@gmail.com >
* [UPD] rename from ftp to sftp bulk
Signed-off-by: Henri Blancke <blanckehenri@gmail.com >
* update branch
* [FIX] integration tests
Signed-off-by: Henri Blancke <blanckehenri@gmail.com >
* [FIX] acceptance test fixture
Signed-off-by: Henri Blancke <blanckehenri@gmail.com >
* [UPD] change ftp port
Signed-off-by: Henri Blancke <blanckehenri@gmail.com >
* add uuid to image build
* add source def
* [FIX] generate ssh keys
Signed-off-by: Henri Blancke <blanckehenri@gmail.com >
* auto-bump connector version
Signed-off-by: Henri Blancke <blanckehenri@gmail.com >
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com >
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2022-10-27 23:58:30 -03:00
