* add specs module with logic to fetch specs on build
* format + build and add gradle dependency for new script
* check seed file for existing specs + refactor
* add tests + a bit more refactoring
* run gw format
* update yaml config persistence to merge specs into definitions
* add comment
* delete secrets migration to be consistent with master
* add dep
* add tests for GcsBucketSpecFetcher
* get rid of static block + format
* DRY up parse call
* add GCS details to comment
* formatting + fix test
* update comment
* do not format seed specs files
* change signature of run to allow cloud to reuse this script
* run gw format
* revert commits that change signature of run
* fix comment typo
Co-authored-by: Davin Chia <davinchia@gmail.com>
* rename enum to be distinct from the enum in cloud
* add missing dependencies between modules
* add readme for seed connector spec generator
* reword
* reference readme in comment
* ignore 'spec' field in newFields logic
Co-authored-by: Davin Chia <davinchia@gmail.com>
* fixed bug which crashes okta log incremental sync
* bump connector version
* update acceptance test
* rollback pendulum function
* add comment
* bump version
* run format
Co-authored-by: collin <collinscangarella@gmail.com>
* initial commit
* finish implementing full_refresh
* add other tables
* cleaning up
* add docs and use requests_native_auth
* fix function return different number of values
* change package author
* fix schema
* fix schema bug
* linting
* fix unit test
* clean up
* add null for schemas
* remove fc_widget_collaboration col
* change accpt test
* add creds
* run format
* add config files
* run format
Co-authored-by: Tuan Nguyen <anhtuan.nguyen@me.com>
* initial commit
* finish implementing full_refresh
* add other tables
* cleaning up
* add docs and use requests_native_auth
* fix function return different number of values
* change package author
* fix schema
* fix schema bug
* linting
* fix unit test
* clean up
* add null for schemas
* remove fc_widget_collaboration col
* Added delay to for all streams, removed logic which increase reqs rate because it does not take into consideration actual number of requests made in previous and next streams.
* Fixed argmument passing
* Increased timeout for SAT
* Increased timeout for SAT
* bump version
* bumped connector version, updated change log
Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
* Source Google Directory #7415 - migrate to the CDK
* Source Google Directory #5190 - fix timeout error
* Source Google Directory #7415 - fix according to PR review
* Source Google Directory #7415 - added etag and lastLoginTime to ignored fields for full refresh acceptance test
* Source Google Directory #7415 - fix full refresh acceptance test config
* Source Google Directory #7415 - bump version
* Fix data type tests in CdcPostgresSourceComprehensiveTest
* update style format
* bump version for postgres source
* bump version for postgres source in json definition
* remove unnecessary comments from test and bump version for postgres strict encrypt source
* resolved potential conflicts with debezium utils in mssql converter implementation
* resolved potential conflicts with debezium utils in mssql converter implementation
* Update notes for money type in postgres.md
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* Update docs/integrations/sources/postgres.md
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* added test cases for converting data values for postgres cdc, remove time zone utc from test container
* remove redundant void message from test
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* update style format
* fix time zone in DebeziumConverterUtilsTest
* set utc time zone in DataTypeUtils
* set utc time zone for date format
* revert changes regarding timezone in date format, disable tests with number and duration
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* feat: adds destination-elasticsearch
* feat: adds destination-elasticsearch es server container
* refactor: header configuration
* update: only call createIndex when preparing the writes
* update: reuse container
* fix: make index names valid and use namespace
* refactor: use bulk process and buffered consumer
* refactor: fix bulk process and buffered consumer
* chore: update documentation
* update: remove ssl reference
* fix: bulk indexing
adds test logging config to inspect http wire
begins work for overrwriting existing records
* docs: update for authentication
* refactor: simplify config
* refactor: cleanup indices, implement auth
* update: cleanup equals/toString in Elasticsearch ConnectionConfiguration
* chore: use conventions and remove unused code
* update: close underlying rest connection
* update: enable `supportsNormalization`
* refactor: better encapsulate index naming
* update: allow upserting
* update: use oneOf for auth method
* refactor: use encapsulated auth object
* chore: pretty
* update: simplify auth header creation
* chore: remove unused class
* update: use boolean as field type
* adds: elasticsearch example server
* fix: api secret test
* run format
* add eof
* add eof elasticSearch yaml file
Co-authored-by: Jeremy Branham <Jeremy@Savantly.net>
Co-authored-by: Jeremy <jdbranham@hotmail.com>
* feat: adds destination-elasticsearch
* feat: adds destination-elasticsearch es server container
* refactor: header configuration
* update: only call createIndex when preparing the writes
* update: reuse container
* fix: make index names valid and use namespace
* refactor: use bulk process and buffered consumer
* refactor: fix bulk process and buffered consumer
* chore: update documentation
* update: remove ssl reference
* fix: bulk indexing
adds test logging config to inspect http wire
begins work for overrwriting existing records
* docs: update for authentication
* refactor: simplify config
* refactor: cleanup indices, implement auth
* update: cleanup equals/toString in Elasticsearch ConnectionConfiguration
* chore: use conventions and remove unused code
* update: close underlying rest connection
* update: enable `supportsNormalization`
* refactor: better encapsulate index naming
* update: allow upserting
* update: use oneOf for auth method
* refactor: use encapsulated auth object
* chore: pretty
* update: simplify auth header creation
* chore: remove unused class
* update: use boolean as field type
* adds: elasticsearch example server
* fix: api secret test
* feat(67): add support for 'spec' using Python HTTP API source template and stripe as an example
* chore(67): add sample state and config
* feat(67): add check functionality for paystack source by fetching first customer
* feat(67): add support for discover and read customer stream
* feat(67): add paystack source connector to UI
* feat(67): update source definitions to use 0.1.0
* Hacktoberfest 67 paystack source (#1)
* feat(67): add support for 'spec' using Python HTTP API source template and stripe as an example
* chore(67): add sample state and config
* feat(67): add check functionality for paystack source by fetching first customer
* feat(67): add support for discover and read customer stream
* feat(67): add paystack source connector to UI
* feat(67): update source definitions to use 0.1.0
Co-authored-by: Foluso Ogunlana <foluso_ogunlana@stearsng.com>
* feat(67): update stream state cursor field to be integer and to match API record field name
* chore(67): add unit tests for source and streams
* chore(67): store formatted date time in state to match type of catalog
* chore(67): add configuration for acceptance integration tests
* docs(67): update docs and summary with paystack
* chore(67): add essential schemas to be catalogued for new streams
* feat(67): add support for critical streams - transactions subscriptions transfers refunds settlements
* docs(67): update image and bootstrap
* chore(67): update builds.md to include paystack badge
* docs(67): add changelog and source definition JSON file
* docs(67): add paystack to integrations readme
* chore(67): update check_connection to airbyte standard
* refactor to simplify streams and remove constants file
* fix(67): correct "null, null" values in schemas
* chore(67): update file formatting with gradle format
Co-authored-by: Foluso <5675998+foogunlana@users.noreply.github.com>
* fix: chats stream is only pulling for first page
* fix: integration tests
* fix: remove cred
* bump version in source definition
* Fixed: integration tests
