* Initial implementation: Support for `archive` stream
* Added support for `most_popular` streams (emailed, shared, viewed)
* Add `expected_records.txt` for acceptance tests
* Added Documentation
* Updated changelog with PR id
* Add support for incremental syncs
* Reduce size and remove most_popular streams from expected_records.txt
* Remove `expected_records.txt`
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
* Postgres/MySQL Source Strict Encrypt: stop enforce SSL if ssl mode disabled
* fixed checkstyle
* updated changelog
* add tests
* replaced MySQL test to mysql-strict-encrypt module
* fixed Connection Refused for mysql test
* replaced Postgres Source strict-encrypt tests into new class
* bump version
* auto-bump connector version
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Make pytest aware of backward compatibility mark
* Unit tests for duplicate values in enum properties
* Add docs about airbyte enforcements to enum usage
* Add docs info to test
* add younium source along with documentation
* add documentationUrl
* remove newlines eof
* remove additional newlines
* remove TODO file
* add titles to all params in spec.yaml
* add younium to source def
* run format
* auto-bump connector version
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* feat: initial commit source senseforce
This commit is the initial commit to the senseforce.io source.
It contains the auto-generated lowcode CDK source connector files
as well as the spec definition of the connector.
Not working yet.
* feat: stream slicing and incremental sync [pass]
This commit adds the stream slicing and incremental sync feature.
This commit passes all configured acceptance tests.
* docs: Update documentation
* change: remove unused schema readme
* change: remove catalog.json from integration_tests
* add senseforce to source def
* run format
* correct tests
* auto-bump connector version
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Source TPI Central: add a check for HTTP URLs in config
* Update changelog
* Fix tests
* Add missing attributes to fix the test that wasn't working
* Add HTTPS URL check to SAT tests
* Remove previously added changes
* added new source for ip2whois
* updated documentation link
* fixes for review comments
* format connector
* run format
* auto-bump connector version
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Add new source: The Guardian API
* Add documentation
* Fix custom paginator, it now stops without throwing an error
* Update the-guardian-api.md with PR number and link
* Remove catalog file, add titles to all properties in spec.yaml
* Add incremental sync, change parameter names
* format
* remove order from spec
* add guardian to source def
* auto-bump connector version
Co-authored-by: Vincent Koc <koconder@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
* convex source
* fixed unit tests
* use the smaller test instance
* fix integration tests and pagination
* fix tableName casing in api call
* fix logo
* more shapes -- thinking about moving this to an internal api
* use new /json_schemas api
* use new APIs
* remove unused start_date
* doc skeleton
* fix deletes with incremental sync
* fix test of json_schema
* fix expected records
* merge
* version and docs
* fix test
* fix docs url
* mention that you need to ask convex to enable it for your account
* docs
* two stage pagination for initial sync. some unit tests not working
* fixed all the unit tests, but we need to push backends before acceptance tests work
* fix snapshot pagination
* fix integration tests
* some checkboxes from the PR description
* Update airbyte-integrations/connectors/source-convex/source_convex/source.py
Co-authored-by: Sujay Jayakar <sujayakar314+github@gmail.com>
* Update airbyte-integrations/connectors/source-convex/source_convex/source.py
Co-authored-by: Sujay Jayakar <sujayakar314+github@gmail.com>
* stop storing the delta_has_more in state
* fix mypy
* use UTC timestamps
* rename instance_name to deployment_name
* include data format request param
* remove dev docker image
* fix unit test
* documentation
* .
* code review
* documentation and change deployment_name to deployment_url
* fix pip dependency
* regenerate the spec file
Co-authored-by: Sujay Jayakar <sujayakar314+github@gmail.com>
* Add improvements to "Building a connector the hard way"
* add log_error() formatting to pass SAT tests
* Update to new version of acceptance-test-config.yml
* Edit tutorial directory to match tutorial
* Change permissions on acceptance-test-docker.sh
This reverts commit 40b2d98053.
* Adds TLS check to mongodb destination and migrates util constants
* Migrates MongodbSourceUitls to general purprose Utils file
* Updates expected_spec.json to include SSH tunnel
* Bumps connector version and removes connector from being hidden in UI
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* solve conflicts
* solve conflict in json schema
* bump to version 0.1.8 for the changes of this pr
* change ad account id in the schemas
* query to include data plane attributes (#18531)
* query to include data plane attributes
* rename functions
* fix java build
* more renaming fix
* Fix unit tests in source relational db (#18789)
* Fix unit tests
* Add extra test case for record count > 1
* Store record count in variable
* ci: use custom test-reporter action to upload job results (#18004)
* ci: use custom action to upload job results
* Correct coinmarket spec (#18790)
* correct coinmarket spec
* remove duplicate support normalization from source spec
* rollback coinmarketcap version in source def seed
* update connector version
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Parameterize test_empty_streams and test_stream_with_1_airbyte_column by destination (#18197)
* Remove lines that always add Postgres to list of destinations
* Parameterize all tests in test_ephemeral by destination
* 🐛 Source Facebook Marketing: reduce request limit after specific error (#18734)
* 🐛 Source Facebook Marketing: reduce request limit after specific error
* 🐛 Source Facebook Marketing: bump version; update docs
* 🐛 Source Facebook Marketing: add test
* 🐛 Source Facebook Marketing: increase timeout
* [charts/airbyte-cron] Cleanup env vars (#18787)
* [charts/airbyte-cron] Cleanup env vars
* Remove unused env var
* Use equalsIgnoreCase (#18810)
* Bump helm chart version reference to 0.40.40 (#18815)
Co-authored-by: perangel <perangel@users.noreply.github.com>
Co-authored-by: Kyryl Skobylko <xpuska513@gmail.com>
* 🐛Destination Google Sheets: Fix empty headers list (#18729)
* Fix empty headers list
* Updated PR number
* Bumped version
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* 🐛Source Exchange Rates: Fix handling error during check connection (#18726)
* Fix handling error during check connection
* Updated PR number
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Add normalization changelog and bump normalization version in platform (#18813)
* Remove ConfigPersistence usage from SecretsMigrator (#18747)
* remove config persistence from seeding logic (#18749)
* Remove the bulk actions from ConfigPersistence (#18800)
* hide ConfigPersistence inside ConfigRepository to discourage use (#18803)
* ci: add job and run id to test reports (#18832)
* Bump Airbyte version from 0.40.17 to 0.40.18 (#18827)
Co-authored-by: grishick <grishick@users.noreply.github.com>
* 🪟🔧 Remove styled components (round 1) (#18766)
* refactor EditorHeader (untested)
* refactor BaseClearView
* delete unused Subtitle
* refactor ConfirmationModal
* refactor Arrow
* refactor BulkHeader
* refactor CatalogTreeSearch
* refactor StreamFieldTable
* refactor StreamHeader
* refactor ConnectorIcon
* refactor TreeRowWrapper
* refactor DeleteBlock
* refactor EmptyResourceBlock
* revert unintended element change
* fixed acceptance tests (#18699)
* 🪟🔧 Reactor Breadcrumbs component to use anchors (#18764)
* refactor breadcrumbs to use actual links
* PR comments on styles
* increase test timeout for some webapp tests to prevent flakes (#18807)
* Remove "Filters and Segments" from Google Analytics v4 (#18508)
Filters and Segments info was incorrectly added to the Google Analytics v4 connector instead of the Google Analytics (Universal Analytics) Connector.
* Add notes about EU OAUth (#18835)
EU OAuth is not fully tested so adding a note to account for that.
* 🪟🐛 Fix: visual regression in ConnectorIcon (#18849)
* fix visual regression
* remove unused prop
* Add links to demo page (#18828)
* mysql-source:fix tinyint unsigned handling (#18619)
* mysql-source:fix tinyint unsigned handling
* update doc
* format
* upgrade version
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* 🪟🎉 Allow environment specific sections in docs (#18829)
* Allow environment specific sections in docs
* Change syntax to lower case
* ci: replace GITHUB_OUTPUT with GITHUB_ENV on multiline variables (#18809)
* ci: replace GITHUB_OUTPUT with GITHUB_ENV on multiline variables
* ci: replace github set-ouput with new syntax in ./tools/bin/
* Add connection ID to span (#18852)
* edited connector docs (#18855)
* 🪟🔧 Upgrade husky to 8.0.1 (#18719)
* Upgrade Husky
* Upgrade Husky
* Upgrade Husky
* Upgrade Husky
* Upgrade Husky
* ci: replace GITHUB_OUTPUT with GITHUB_ENV for multiline variables (#18857)
* Avoid NPE when adding connection ID to trace (#18856)
* Filter exit errors by operation name (#18850)
* add label
* auto-bump connector version
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Xiaohan Song <xiaohan@airbyte.io>
Co-authored-by: Liren Tu <tuliren@gmail.com>
Co-authored-by: Conor <cpdeethree@users.noreply.github.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Greg Solovyev <grishick@users.noreply.github.com>
Co-authored-by: Artem Inzhyyants <36314070+artem1205@users.noreply.github.com>
Co-authored-by: perangel <perangel@gmail.com>
Co-authored-by: Jonathan Pearlin <jonathan@airbyte.io>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: perangel <perangel@users.noreply.github.com>
Co-authored-by: Kyryl Skobylko <xpuska513@gmail.com>
Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
Co-authored-by: Charles <charles@airbyte.io>
Co-authored-by: Octavia Squidington III <90398440+octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Joey Marshment-Howell <josephkmh@users.noreply.github.com>
Co-authored-by: darynaishchenko <80129833+darynaishchenko@users.noreply.github.com>
Co-authored-by: Michael Siega <109092231+mfsiega-airbyte@users.noreply.github.com>
Co-authored-by: Tyler B <104733644+TBernstein4@users.noreply.github.com>
Co-authored-by: Yowan Ramchoreeter <26179814+YowanR@users.noreply.github.com>
Co-authored-by: Tim Roes <tim@airbyte.io>
Co-authored-by: Subodh Kant Chaturvedi <subodh1810@gmail.com>
Co-authored-by: Volodymyr Pochtar <v.pochtar@gmail.com>
Co-authored-by: Amruta Ranade <11484018+Amruta-Ranade@users.noreply.github.com>
* Generate source
* Add candidates stream
* Fix docs
* Add offers stream
* Fix schema
* Use a single primary_key field
* Add departments stream
* Add sample state
* Fix company ID number
* Update PR number
* Update configured catalog
* Fix schema
* Add newlines
* Add title to properties in spec.yaml
* run format and add recruitee to source def
* auto-bump connector version
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* draft for fastbill
* adding documentation
* fixing common errors
* make requested changes according to review
* requested changes according to review
* compressing code even more
* format
* run format
* auto-bump connector version
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
* Adding transactions for klarna source integration
* Fixing tests
* Adding payout stream
* Finalizing connector
* Adding new lines af EOF
* Applying code review suggestions. Adding doc for klarna. Adding title in spec.yaml
* run format
* format files
* add to source def
* auto-bump connector version
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* mssql-source:upgrade debezium version to 1.9.6
* more improvements
* upgrade version
* auto-bump connector version
* fix test
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
API changes to support the progress bar.
- The eventual idea is for the save_stats route to be called by the workers during replication. Workers will save stats for a job id and attempt number.
- Make modifications to the /jobs/list and the /jobs/get_debug_info routes to also return estimated bytes/records.
We need both estimated metadata, as well as running states to calculate progress bar and throughput.
- add the save_stats route. This is the route that will be called by workers. I've done my best to reuse existing openapi bodies to reduce duplication.
- add the estimatedRecords and estimatedBytes fields to the AttemptStats body. This is part of the AttemptRead and the AttemptStreamStats objects. This eventually filters up to the jobs/list and jobs/get_debug_info objects. This also adds these to all the endpoints that were previously returning stats information. I think the duplicated data is a small issue and don't think it's worth splitting out a new api objects, though I will gladly do so if folks feel strongly.
minor changes to the AttemptApiController to support the new route.
- I've stubbed out the handlers for now since the backend is not yet implemented.
* Bump version for redshift, bigquery, and snowflake
* auto-bump connector version
* auto-bump connector version
* Log failed refresh token response
* Revert snowflake version bump
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
