1
0
mirror of synced 2025-12-20 18:39:31 -05:00

54 Commits

Author SHA1 Message Date
oleh.zorenko
df80593108 csv discovery takes too much memory (#2089) (#2883)
* csv discovery takes too much memory (#2089)

Use `chunksize` parameter when reading csv files.

* csv discovery takes too much memory (#2089)

Handle `None` value for `fields` variable in `client.read()` function.

* csv discovery takes too much memory (#2089)

Refactor code in `client.read()` function. Remove duplicate code.

* csv discovery takes too much memory (#2089)

Implement version with yield statements.

* csv discovery takes too much memory (#2089)

Update return annotation for load_dataframes().

* csv discovery takes too much memory (#2089)

Remove unused import.

* csv discovery takes too much memory (#2089)

Update source-file connector version from `0.2.1` to `0.2.2`.
2021-04-16 19:51:53 +03:00
Sherif A. Nada
d4267818ae Source File: Support JsonL format (#2118) 2021-02-18 13:54:26 -08:00
Eugene K
e9769c8159 Source File: fix issue with boolean types in schema (#1873) 2021-01-28 23:02:53 -08:00
Eugene K
a54dd89418 Adopt connector best practices for File Source (providers) #1584 (#1738)
Co-authored-by: Sherif Nada <snadalive@gmail.com>
2021-01-27 16:49:33 -08:00