8293ce3fbe
* Faker WIP * Update catalog to handle dates better * Adding unit tests for faker source * WIP - tests mostly passing * add docs * bump python version and fix unit tests * test array types * remove comment * better python map * update `moduleDirectory` * simplify intiilization\ * use `ConfiguredAirbyteCatalog` in test rather than custom dict class * Tests passing by using deterministic time * Bump birthdays * Update airbyte-integrations/connectors/source-faker/integration_tests/acceptance.py Co-authored-by: George Claireaux <george@claireaux.co.uk> * remove bootstrap and stronger types * better incremental support * fixup un-used imports * bump to test codecov * Add connector to medatata files Co-authored-by: George Claireaux <george@claireaux.co.uk>
1.5 KiB
1.5 KiB
Faker
Sync overview
The Faker source generates sample data using the python faker package. Specifically, we generate data that looks like an e-commerce company's users table with the faker.profile() method.
Output schema
Only Users is supported.
Data type mapping
Native Airbyte types (string, number, date, etc)
Features
| Feature | Supported?(Yes/No) | Notes |
|---|---|---|
| Full Refresh Sync | Yes | |
| Incremental Sync | Yes | |
| Namespaces | No |
Of note, if you choose Incremental Sync, state will be maintained between syncs, and once you hit count records, no new records will be added.
You can choose a specific seed (integer) as an option for this connector which will guarantee that the same fake records are generated each time. Otherwise, random data will be created on each subsequent sync.
Rate Limiting & Performance Considerations
N/A
Getting started
Requirements
None!
Setup guide
N/A
Changelog
| Version | Date | Pull Request | Subject |
|---|---|---|---|
| 0.1.0 | 2022-04-12 | 11738 | The Faker Source is created |