1
0
mirror of synced 2025-12-21 11:01:41 -05:00
Commit Graph

7 Commits

Author SHA1 Message Date
Charles
0df53170c9 Stop formatting python with spotless (#3388) 2021-05-13 17:46:34 -07:00
Davin Chia
f660b0a946 Add template generation for Santa aka CDK. (#3034)
Template generation for new Source using the Santa CDK - provide basic scaffolding for someone implementing a new source.

General approach is to buff up comments in the original SDK, and add TODOs with secondary comments in the generated stub methods, as well as links to existing examples (e.g. Stripe or ExchangeRate api) users can look at.

Checked in and added tests for the generated modules.
2021-04-25 18:02:33 +08:00
Charles
f445fdb5b2 match styling for spotlessApply and format (#3017)
* as a java developer I want to be able to run spotlessApply without changing styles in python code
2021-04-23 09:21:41 -07:00
oleh.zorenko
df80593108 csv discovery takes too much memory (#2089) (#2883)
* csv discovery takes too much memory (#2089)

Use `chunksize` parameter when reading csv files.

* csv discovery takes too much memory (#2089)

Handle `None` value for `fields` variable in `client.read()` function.

* csv discovery takes too much memory (#2089)

Refactor code in `client.read()` function. Remove duplicate code.

* csv discovery takes too much memory (#2089)

Implement version with yield statements.

* csv discovery takes too much memory (#2089)

Update return annotation for load_dataframes().

* csv discovery takes too much memory (#2089)

Remove unused import.

* csv discovery takes too much memory (#2089)

Update source-file connector version from `0.2.1` to `0.2.2`.
2021-04-16 19:51:53 +03:00
Sherif A. Nada
d4267818ae Source File: Support JsonL format (#2118) 2021-02-18 13:54:26 -08:00
Eugene K
e9769c8159 Source File: fix issue with boolean types in schema (#1873) 2021-01-28 23:02:53 -08:00
Eugene K
a54dd89418 Adopt connector best practices for File Source (providers) #1584 (#1738)
Co-authored-by: Sherif Nada <snadalive@gmail.com>
2021-01-27 16:49:33 -08:00