1
0
mirror of synced 2025-12-21 11:01:41 -05:00
Commit Graph

8 Commits

Author SHA1 Message Date
Aaron ("AJ") Steers
e93015f27e Source Faker: Declare primary keys (#34644) 2024-01-30 11:06:43 -08:00
Evan Tahler
1b0ad2403f source-faker: unique state messages (#34344) 2024-01-18 01:45:12 +00:00
Evan Tahler
788a0ec7af Simplify faker offsets and limits (#27807) 2023-06-28 13:21:14 -07:00
Evan Tahler
94097d0325 source-faker: cursor = updated_at & remove records_per_sync (#27684)
* source-faker: cursor = updated_at & remove records_per_sync

* metadata

* flake
2023-06-24 15:31:53 -04:00
Alexandre Girard
677fa9756d Small fixes to support python3.8 (#23653)
* Use ** instead of |

* Using typing type

* Using typing type

* Using typing type

* Revert "Merge branch 'master' into alex/support_3.8"

This reverts commit 5c7581518e, reversing
changes made to 5cb47f8c70.

* Revert "Merge branch 'master' into alex/support_3.8"

This reverts commit 5cb47f8c70, reversing
changes made to 4058fce754.

* Revert "Merge branch 'master' into alex/support_3.8"

This reverts commit e1d109905a, reversing
changes made to da881ef0d7.

* reset changes

* undo borked publish

* downgrade bumpversion.cfg and Dockerfile too

* explicitely support >=3.8

* update readme
2023-03-01 19:14:27 -08:00
Cole Snodgrass
2e099acc52 update headers from 2022 -> 2023 (#22594)
* It's 2023!

* 2022 -> 2023

---------

Co-authored-by: evantahler <evan@airbyte.io>
2023-02-08 13:01:16 -08:00
Evan Tahler
2022f7d2a8 [faker] decouple stream state (#20492)
* [faker] decouple stream state

* add PR #

* commit Stream instantiate changes

* fixup expected record

* skip backward test for this version too

* Apply suggestions from code review

Co-authored-by: Augustin <augustin@airbyte.io>

* lint

* Create realistic datasets of 10GB, 100GB, and 1TB in size (#20558)

* Faker CSV Streaming utilities

* readme

* don't do a final pipe to jq or you will run out or ram

* doc

* Faker gets 250% faster (#20741)

* Faker is 250% faster

* threads in spec + lint

* pass tests

* revert changes to record helper

* cleanup

* update expected_records

* bump default records-per-slice to 1k

* enforce unique email addresses

* cleanup

* more comments

* `parallelism` and pass tests

* update expected records

* cleanup notes

* update readme

* update expected records

* auto-bump connector version

Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-01-02 18:04:44 -06:00
Evan Tahler
1e160b2858 Faker V0.3 - CDK, consistent naming, determinism, display name, and SAT (#19490)
* better comment to show sync types

* WIP - basics in place

* test cleanup

* emit `AirbyteEstimateTraceMessage`

* assert estimates emitted

* unit tests passing

* format

* flake

* check tests

* add newline

* lint

* check in with new file name

* bump acceptance test yml

* acceptance test progress

* deterministic purchases

* SAT making progress

* better disable

* adjust yaml

* change abnormal_state.json format

* per-stream state

* products for abnormal state

* products have state + incremental

* purchases state = total_user_records

* update docs and name

* disable proper version

* typo

* try disable 0.2.1

* kwargs

* v1.0.0

* lint

* backward_compatibility_tests_config

* auto-bump connector version

Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-12-01 14:53:38 -08:00