1
0
mirror of synced 2025-12-21 11:01:41 -05:00
Commit Graph

23 Commits

Author SHA1 Message Date
Aaron ("AJ") Steers
83ecbe0fc3 CI: apply pre-commit format fix from #49806 (#49852) 2024-12-18 14:05:43 -08:00
Edward Gao
1f5c16a3d5 Source faker: change some fields to be integer (#29213)
* change some fields to be integer

* logistics

* fix tests?

* more fix tests?

* fine, breaking change :P

* migration doc

* metadata

* cat config

* uh
2023-08-08 17:31:18 -07:00
Arsen Losenko
98d175c7a9 Source Faker: update expected records (#28146) 2023-07-11 21:13:19 +03:00
Evan Tahler
94097d0325 source-faker: cursor = updated_at & remove records_per_sync (#27684)
* source-faker: cursor = updated_at & remove records_per_sync

* metadata

* flake
2023-06-24 15:31:53 -04:00
Roman Yermilov [GL]
13cacdb161 Source Faker: fix expected records (#26351) 2023-05-23 14:15:40 +04:00
Evan Tahler
4fd9226a73 Source-Faker users gain address sub-object (#25903)
* Faker users gain address sub-object

* bump readme and metadata

* fixup expected records

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-05-09 16:24:01 +00:00
Baz
54e53ab3ea 🐛 CAT: updated expected records for Zendesk-Support, Faker, Harvest, Freshdesk (#25707)
* updated expected records for zendesk-support, faker, harvest, freshdesk sources

* updated freshdesk
2023-05-01 23:34:45 +03:00
Baz
6483e7f607 🐛 Source Faker: fix expected records (#25476) 2023-04-25 16:15:50 +03:00
Arsen Losenko
675df1aab7 Source Faker: update expected records (#25387) 2023-04-21 13:57:19 +03:00
Serhii Lazebnyi
03e1ec4cb8 Connector Health: Fixed SAT for close-com, facebook-marketing, freshsales, greenhouse, hubspot, intercom, jira, mixpanel, monday, pipedrive, recharge, sentry, slack, strava, stripe, trello, twitter, youtube-analytics, twillio, faker (#24361)
* Fix expected records for hubspot and intercom

* Fix typo for intercom

* Fix close com, fecebook marketing, freshsales, greenhouse expected records

* Fix intercom CAT

* Fix unittest for new pydentic version

* Fix facebook marketing unittests and jira CAT

* Fix formating for facebook marketing, jira and CAT for monday

* Fix pipedrive and recharge CAT

* Fix CAT for Slack, Strava, Stripe, Trello and Twitter

* Fix expected records for slack

* Fix CAT for Youtube and Sentry

* Fix unittests for mixpanel

* Added allowedHosts and fix facebook marketing CAT

* Fix CAT for Faker and Twillio

* Fix expected records for hubspot

* Fix expected records for Sentry

* Fix check status for GAv4
2023-03-28 20:31:41 +02:00
Serhii Lazebnyi
cfeabd3a4e Connector Health: Fixed SAT for Instagram, Facebook pages, Google Search Console, Stripe, Typeform, Hubspot, Sentry, Faker, Zendesk support, Slack, Jira (#23711)
* Fixed SAT

* Updated stripe and instagram

* Google search console add allowed hosts

* Fix hubspot, sentry, stripe

* Fix source faker and zendesk-support

* Fix google search console and hubspot

* Fix slack and jira acceptance tests

* Fix expected records for facebook marketing
2023-03-08 19:41:34 +01:00
Serhii Lazebnyi
3d8f81a3e4 Connector Health: Fixed SAT for Amazon Ads, Faker, Hubspot, Instagram, Pinterest, Sentry, Zendesk Talk (#23600)
* Fixed SAT for some connecotrs

* Fix unittest pinterest

* add allowedHosts

* Updated unittest for instagram

* Fix expected records instagram
2023-03-01 10:09:19 +01:00
Cole Snodgrass
2e099acc52 update headers from 2022 -> 2023 (#22594)
* It's 2023!

* 2022 -> 2023

---------

Co-authored-by: evantahler <evan@airbyte.io>
2023-02-08 13:01:16 -08:00
darynaishchenko
93186e7bc3 updated expected records for stream purchases (#22404) 2023-02-07 15:44:02 +02:00
Joe Reuter
6a10ae3e05 Rename source acceptance test to connector acceptance test (#21846)
Rename source acceptance test to connector acceptance test
2023-02-02 11:38:19 +01:00
Evan Tahler
e4f4412873 source-faker to Beta + Fix AllowedHosts Checks (#22117)
* beta faker + no allowed hosts

* V2.0.1

* fixup python checks

* add back allowedHosts

* simplify

* simplify releaseStage

* bump expected records

* More mock logger methods

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-01-31 06:13:19 +00:00
Evan Tahler
2022f7d2a8 [faker] decouple stream state (#20492)
* [faker] decouple stream state

* add PR #

* commit Stream instantiate changes

* fixup expected record

* skip backward test for this version too

* Apply suggestions from code review

Co-authored-by: Augustin <augustin@airbyte.io>

* lint

* Create realistic datasets of 10GB, 100GB, and 1TB in size (#20558)

* Faker CSV Streaming utilities

* readme

* don't do a final pipe to jq or you will run out or ram

* doc

* Faker gets 250% faster (#20741)

* Faker is 250% faster

* threads in spec + lint

* pass tests

* revert changes to record helper

* cleanup

* update expected_records

* bump default records-per-slice to 1k

* enforce unique email addresses

* cleanup

* more comments

* `parallelism` and pass tests

* update expected records

* cleanup notes

* update readme

* update expected records

* auto-bump connector version

Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-01-02 18:04:44 -06:00
Evan Tahler
1e160b2858 Faker V0.3 - CDK, consistent naming, determinism, display name, and SAT (#19490)
* better comment to show sync types

* WIP - basics in place

* test cleanup

* emit `AirbyteEstimateTraceMessage`

* assert estimates emitted

* unit tests passing

* format

* flake

* check tests

* add newline

* lint

* check in with new file name

* bump acceptance test yml

* acceptance test progress

* deterministic purchases

* SAT making progress

* better disable

* adjust yaml

* change abnormal_state.json format

* per-stream state

* products for abnormal state

* products have state + incremental

* purchases state = total_user_records

* update docs and name

* disable proper version

* typo

* try disable 0.2.1

* kwargs

* v1.0.0

* lint

* backward_compatibility_tests_config

* auto-bump connector version

Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-12-01 14:53:38 -08:00
Evan Tahler
c81ea485ce Faster Faker (#18021)
* Faster Faker

* unit tests

* tests passing

* update pr link

* guard against small ranges

* Fixup product timezones

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-15 13:31:12 -07:00
Evan Tahler
40d1dc1421 Faker source gains purchases and products (#13248)
* Faker source gains purchases and products

* ranges start at 1

* fix nits

* lint

* user_ids start at 1

* v0.1.3

* fix IDs in test output recods

* auto-bump connector version

* lint

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-27 16:14:59 -07:00
Evan Tahler
e3cb566f79 Bump faker version to test M1 Connector builds (#13235)
* Bump faker version to test M1 Connector builds

* add PR link to changelog

* Remove birhtday, it  doesn't obey seed

* bump readme

* more birthday to remove

* remove image specificity in publish-command

* Set AMI for testing.

* test with including buildx emulators

* auto-bump connector version

* add TODO comment

Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-27 10:36:05 -07:00
Marcos Marx
dca2256a7c Bump 2022 license version (#13233)
* Bump year in license short to 2022

* remove protocol from cdk
2022-05-26 15:00:42 -03:00
Evan Tahler
8293ce3fbe 🎉 New Source: Faker (#11738)
* Faker WIP

* Update catalog to handle dates better

* Adding unit tests for faker source

* WIP  - tests mostly passing

* add docs

* bump python version and fix unit tests

* test array types

* remove comment

* better python map

* update `moduleDirectory`

* simplify intiilization\

* use `ConfiguredAirbyteCatalog` in test rather than custom dict class

* Tests passing by using deterministic time

* Bump birthdays

* Update airbyte-integrations/connectors/source-faker/integration_tests/acceptance.py

Co-authored-by: George Claireaux <george@claireaux.co.uk>

* remove bootstrap and stronger types

* better incremental support

* fixup un-used imports

* bump to test codecov

* Add connector to medatata files

Co-authored-by: George Claireaux <george@claireaux.co.uk>
2022-04-14 15:21:30 -07:00