* improve SAT test for incrementals to walk through steam states not just the latest
* convert batch to tuple and pr feedback
* bump version and update changelog
* patch pytest so test doesn't get skipped
* update changelog and dockerfile again
* add SAT case for airbyte trace message on failure
* add ability to opt-out
* add tests
* add option to docs
* bump version, update changelog
* fix type errors
* update changelog
* added AirbyteLoggedException class
* adding in int runr
* changes
* refactored to AirbyteTracedException to align with python impl.
* added catch for Exceptions that are already AirbyteTracedException
* refactor to static class & catch with UncaughtExceptionHandler
* testing ExceptionHandler
* add tests
* added docs section on using AirbyteTraceMessageUtility
* made AirbyteMessage maker methods more intuitive
* fix spotbugs errors
* format
* SAT: add `threshold_days` incremental test option
* fix: support cursor values that are already dates
* dont use constant value
* update docs
* use pendulum for date parsing
* bump cdk version
* use pendulum for duration
* add support for unix timestamps
* bump version, update changelog
* allow importing IncrementalMixin from airbyte_cdk.sources.streams
* format file
* update docs with hint on where to import IncrementalMixin from
* bump cdk version to 0.1.54
* update changelog
* only build python 3.9
* update changelog with python dep bump
* Dockerfile to 3.9
* Python version
* More python updates
* 3.9 on GitHub actions and lint updates
* Test out 3.9.11 on GitHub actions
* install python with an action
* formatting: newline
* Also has python code
* only check first level for changed modules
Previous example (source-google-search-console/credentials)
* Test failure: there is no logger.trace
* Brings pairity for doc checks from cloud
* WIP Sidebar config
It's sketchy JSON let's commit before we break i
* MVP sidebars
summary.md is no longer functional
it's higherarchy was translated into sidebar.js
as a JSON format that docusaurus likes
* Removes another unused readme
* using yq + more success/failure comments
* added gradle process + git push
* dummy bump to test publish
* dummy bump to test publish
* dummy bump to test publish
* bump version
* fix connector variable
* bump version
* only git add necessary files
* remove git config
* bump version
* making octavia user
* version bump
* auto-bump connector version
* added docs and auto-bumo flag
* bump version
* separate IMAGE_NAME and IMAGE_VERSION env vars from sentry prep
* version bump
* auto-bump connector version
* added entry to apify changelog for clarity
* added details on /publish command
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* using yq + more success/failure comments
* added gradle process + git push
* dummy bump to test publish
* dummy bump to test publish
* dummy bump to test publish
* bump version
* fix connector variable
* bump version
* only git add necessary files
* remove git config
* bump version
* making octavia user
* version bump
* auto-bump connector version
* added docs and auto-bumo flag
* bump version
* separate IMAGE_NAME and IMAGE_VERSION env vars from sentry prep
* version bump
* auto-bump connector version
* added entry to apify changelog for clarity
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Original API used in the example is no longer free, so while following the tutorial I found a different API to use in the tutorial and updated the example code to match the new API. Also made a few small changes.
Update Build-a-connector tutorial
* Update screenshots and instructions to match current UI
* Update code examples to use Polygon.io API
* Add links to language-specific guides
* Consistently use Python (uppercase P) when referring to the language
and python (lowercase) p in code samples
* Consistently do not use "." in lists
* Add an image of Airbyte startup banner
* Add a note for M1 macs
* Remove unused images
* Make Dockerfile consistent with the tutorial
* add support for streams with state attribute
* fix pre-commit and format
* update state attribute docs and logic
* added IncrementalMixin
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
* add specs module with logic to fetch specs on build
* format + build and add gradle dependency for new script
* check seed file for existing specs + refactor
* add tests + a bit more refactoring
* run gw format
* update yaml config persistence to merge specs into definitions
* add comment
* add dep
* add tests for GcsBucketSpecFetcher
* get rid of static block + format
* DRY up parse call
* add GCS details to comment
* formatting + fix test
* update comment
* do not format seed specs files
* change signature of run to allow cloud to reuse this script
* run gw format
* revert commits that change signature of run
* fix comment typo
Co-authored-by: Davin Chia <davinchia@gmail.com>
* rename enum to be distinct from the enum in cloud
* add missing dependencies between modules
* add readme for seed connector spec generator
* reword
* reference readme in comment
* ignore 'spec' field in newFields logic
* rearrange dependencies so that CONNECTORS_BASE build does not depend on SeedConnectorSpecGenerator
* run format
* add some more helpful info to the GCS fetch failure message
* add more info
* get rid of unnecessary static block
* Fix publishing docs (#7589)
* Fix publishing docs
* Reorder steps and add a comment about rebuilding the platform
* Update README.md
Co-authored-by: Lake Mossman <lake@airbyte.io>
* add dependency and rebuild
* update PR template with seed connector generation steps
* revert formatting changes to PR template
* Update build.gradle
* Remove unnecessary dep
Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: Christophe Duong <christophe.duong@gmail.com>
