1
0
mirror of synced 2025-12-20 18:39:31 -05:00
Commit Graph

81 Commits

Author SHA1 Message Date
Aaron ("AJ") Steers
80456ef0b6 Source Faker: Enable zero-config execution by making 'count' an optional config param (#36167) 2024-03-21 11:02:07 -07:00
Augustin
9db75b0a54 source-faker: migrate to poetry (#35174) 2024-02-12 08:55:35 -06:00
Augustin
e30ad24f0c source-faker: adopt our base image (#35172) 2024-02-12 08:34:05 -06:00
Aaron ("AJ") Steers
e93015f27e Source Faker: Declare primary keys (#34644) 2024-01-30 11:06:43 -08:00
Evan Tahler
1b0ad2403f source-faker: unique state messages (#34344) 2024-01-18 01:45:12 +00:00
Aaron ("AJ") Steers
7d7f33c09f Source Faker: Add support for PyPi and AirbyteLib entrypoints (#34033) 2024-01-11 00:16:04 -08:00
Edward Gao
1f5c16a3d5 Source faker: change some fields to be integer (#29213)
* change some fields to be integer

* logistics

* fix tests?

* more fix tests?

* fine, breaking change :P

* migration doc

* metadata

* cat config

* uh
2023-08-08 17:31:18 -07:00
Ella Rohm-Ensing
841942b0e6 Ship a breaking change to faker (#28485)
* bump the metadata version

* add changelog and docker tag

* add breakingChanges metadata

* add migration guide

* resolve qa check failure becuase of missing header

* update changelog
2023-07-19 16:37:18 -06:00
Ella Rohm-Ensing
1d42821d11 bump faker (#28060)
* bump faker

* add pr ref
2023-07-07 14:20:18 -05:00
Evan Tahler
788a0ec7af Simplify faker offsets and limits (#27807) 2023-06-28 13:21:14 -07:00
Evan Tahler
94097d0325 source-faker: cursor = updated_at & remove records_per_sync (#27684)
* source-faker: cursor = updated_at & remove records_per_sync

* metadata

* flake
2023-06-24 15:31:53 -04:00
Evan Tahler
7351b6fff1 Update faker produced tables (#27220) 2023-06-09 11:50:29 -07:00
Evan Tahler
4fd9226a73 Source-Faker users gain address sub-object (#25903)
* Faker users gain address sub-object

* bump readme and metadata

* fixup expected records

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-05-09 16:24:01 +00:00
Evan Tahler
25542493ed source-faker v2.0.3 to test publication (#23259)
* `source-faker` v2.0.2 to test publication

* add PR number to changelog

* it's 2.0.3 now!

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-02-21 12:02:29 -08:00
Tyler B
03da6c6ead Correct typo in changelog "soruce" -> "source" (#22558) 2023-02-08 10:22:03 -05:00
Evan Tahler
e4f4412873 source-faker to Beta + Fix AllowedHosts Checks (#22117)
* beta faker + no allowed hosts

* V2.0.1

* fixup python checks

* add back allowedHosts

* simplify

* simplify releaseStage

* bump expected records

* More mock logger methods

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-01-31 06:13:19 +00:00
Amruta Ranade
cae63965bd Deployment docs and sidebar cleanup (#20965) 2023-01-03 19:18:35 +05:30
Evan Tahler
2022f7d2a8 [faker] decouple stream state (#20492)
* [faker] decouple stream state

* add PR #

* commit Stream instantiate changes

* fixup expected record

* skip backward test for this version too

* Apply suggestions from code review

Co-authored-by: Augustin <augustin@airbyte.io>

* lint

* Create realistic datasets of 10GB, 100GB, and 1TB in size (#20558)

* Faker CSV Streaming utilities

* readme

* don't do a final pipe to jq or you will run out or ram

* doc

* Faker gets 250% faster (#20741)

* Faker is 250% faster

* threads in spec + lint

* pass tests

* revert changes to record helper

* cleanup

* update expected_records

* bump default records-per-slice to 1k

* enforce unique email addresses

* cleanup

* more comments

* `parallelism` and pass tests

* update expected records

* cleanup notes

* update readme

* update expected records

* auto-bump connector version

Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-01-02 18:04:44 -06:00
Evan Tahler
1e160b2858 Faker V0.3 - CDK, consistent naming, determinism, display name, and SAT (#19490)
* better comment to show sync types

* WIP - basics in place

* test cleanup

* emit `AirbyteEstimateTraceMessage`

* assert estimates emitted

* unit tests passing

* format

* flake

* check tests

* add newline

* lint

* check in with new file name

* bump acceptance test yml

* acceptance test progress

* deterministic purchases

* SAT making progress

* better disable

* adjust yaml

* change abnormal_state.json format

* per-stream state

* products for abnormal state

* products have state + incremental

* purchases state = total_user_records

* update docs and name

* disable proper version

* typo

* try disable 0.2.1

* kwargs

* v1.0.0

* lint

* backward_compatibility_tests_config

* auto-bump connector version

Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-12-01 14:53:38 -08:00
Evan Tahler
05c99c1693 Faker emits AirbyteEstimateTraceMessage (#19197)
* Faker emits `AirbyteEstimateTraceMessage`

* update pr

* fix SAT

* auto-bump connector version

Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-11-15 15:58:22 -08:00
Evan Tahler
c81ea485ce Faster Faker (#18021)
* Faster Faker

* unit tests

* tests passing

* update pr link

* guard against small ranges

* Fixup product timezones

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-15 13:31:12 -07:00
Serhii Chvaliuk
6a8b053fb5 Use locally-installed qemu rather than docker-installed version (2) (#17889)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-10-12 17:46:24 +03:00
Evan Tahler
2d049f18cf Use locally-installed qemu rather than docker-installed version (#17848)
* Use locally-installed qemu rather than docker-installed version

* Bump faker for test

* Update docs/integrations/sources/faker.md

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>

* auto-bump connector version [ci skip]

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-11 10:32:57 -07:00
Evan Tahler
dcfcb75d0f AirbyteLogMessage.stack_trace for logging messages with related (non-fatal) errors (#16479)
* Test log message from faker

* AirbyteLogMessage gains stack_trace

* Fixup spacing

* bump python protocol

* fixup additionalProperties in faker spec

* bump faker version

* update docs

* use lineSeparator vs \r\n

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-12 16:01:57 -07:00
Topher Lubaway
9c6c092a22 Revert "Improving docusaurus sidebar generation (#1927) (#14369)" (#14596)
This reverts commit a2c194a11f.
2022-07-11 15:27:14 -05:00
Mykyta Serbynevskiy
a2c194a11f Improving docusaurus sidebar generation (#1927) (#14369)
* Improving docusaurus sidebar generation (#1927)

* Added "Career & open positions" folder to sidebar, adjusted "Project overview" folder

* Deleted "career-and-open-positions" folder from sidebar
2022-07-08 14:18:27 -05:00
Evan Tahler
edb74ec282 Faker Source emits times in proper ISO format (#13695)
* Faker Source emits times in ISO format

* fix product times

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-10 17:21:26 -07:00
Evan Tahler
0562e9558c Bump faker to test publication flow (#13298)
* Bump faker to test publication flow

* Add PR link

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-27 19:19:44 -07:00
Evan Tahler
40d1dc1421 Faker source gains purchases and products (#13248)
* Faker source gains purchases and products

* ranges start at 1

* fix nits

* lint

* user_ids start at 1

* v0.1.3

* fix IDs in test output recods

* auto-bump connector version

* lint

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-27 16:14:59 -07:00
Evan Tahler
e3cb566f79 Bump faker version to test M1 Connector builds (#13235)
* Bump faker version to test M1 Connector builds

* add PR link to changelog

* Remove birhtday, it  doesn't obey seed

* bump readme

* more birthday to remove

* remove image specificity in publish-command

* Set AMI for testing.

* test with including buildx emulators

* auto-bump connector version

* add TODO comment

Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-27 10:36:05 -07:00
Evan Tahler
8293ce3fbe 🎉 New Source: Faker (#11738)
* Faker WIP

* Update catalog to handle dates better

* Adding unit tests for faker source

* WIP  - tests mostly passing

* add docs

* bump python version and fix unit tests

* test array types

* remove comment

* better python map

* update `moduleDirectory`

* simplify intiilization\

* use `ConfiguredAirbyteCatalog` in test rather than custom dict class

* Tests passing by using deterministic time

* Bump birthdays

* Update airbyte-integrations/connectors/source-faker/integration_tests/acceptance.py

Co-authored-by: George Claireaux <george@claireaux.co.uk>

* remove bootstrap and stronger types

* better incremental support

* fixup un-used imports

* bump to test codecov

* Add connector to medatata files

Co-authored-by: George Claireaux <george@claireaux.co.uk>
2022-04-14 15:21:30 -07:00