* Source Close.com: add human readable titles to `api-key` and `start_date` fields
- Added `api-key` title: `API Key`
- Added `start_date` title: `Replication Start Date`
* update version to 0.4.1 in metadata.yaml
* update version to 0.4.1 in Dockerfile
* update close-com.md changelog to 0.4.1
* Update airbyte-integrations/connectors/source-close-com/source_close_com/spec.json
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
---------
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* Add logging functionality
- Add logging for DB version (all JDBC sources)
- Add logging for Xmin values
* Automated Change
* Renaming + comments
* More comments
* Initial commit for xmin prototype
- Add spec.json
- Catalog
- Try to change incremental query
* Skeleton for sync
Decision is to use a whole new sync method
* With cursor
* Working catalog + attempt at xmin record iterator
* Unit tested code
* Fix build break
* Fixing state
* more xmin
* Revert unchanged files
* Addressing code review comments
* use generated pojo
* Add iniital XminStateManagerTest
* Additional unit tests
* Added unit test
* Update xmin state manager test
* Remove spec.json xmin option
* Fixed bug where full refresh streams were not being filtered out for Xmin
* Fix latest safe change boundary issue
* Xmin spec update
* Fix
* Automated Commit - Format and Process Resources Changes
* Remove full_refresh as an option for xmin syncs and always include incremental syncs
* Fix integ test
* revert unused files
* revert
* Bump docker + update change log
* Modify order of CDC
* Update expected_spec.json
* Update expected_json
Fix acceptance tests
* Reverse order for xmin replication
* Update expected strict encrypt json
* Fix broken XminCtidUtilsTest
- Logic was added to XminCtidUtils to filter for incremental syncs, but the test data wasn't updated to represent this. This doesn't require any publishing
---------
Co-authored-by: akashkulk <akashkulk@users.noreply.github.com>
Co-authored-by: subodh <subodh1810@gmail.com>
* Removed comma from the value of order field for square source connector specification, which was causing it to be a String instead of an Integer
* increment connector version
* add changelog entry
---------
Co-authored-by: Sunny Hashmi <6833405+sh4sh@users.noreply.github.com>
* Add logging functionality
- Add logging for DB version (all JDBC sources)
- Add logging for Xmin values
* Automated Change
* Renaming + comments
* More comments
* Initial commit for xmin prototype
- Add spec.json
- Catalog
- Try to change incremental query
* Skeleton for sync
Decision is to use a whole new sync method
* With cursor
* Working catalog + attempt at xmin record iterator
* Unit tested code
* Fix build break
* Fixing state
* more xmin
* Revert unchanged files
* Addressing code review comments
* use generated pojo
* Add iniital XminStateManagerTest
* Additional unit tests
* Added unit test
* Update xmin state manager test
* Remove spec.json xmin option
* Fixed bug where full refresh streams were not being filtered out for Xmin
* Fix latest safe change boundary issue
* Xmin spec update
* Fix
* Automated Commit - Format and Process Resources Changes
* Remove full_refresh as an option for xmin syncs and always include incremental syncs
* Fix integ test
* revert unused files
* revert
* Bump docker + update change log
* Modify order of CDC
* Update expected_spec.json
* Update expected_json
Fix acceptance tests
* Reverse order for xmin replication
* Update expected strict encrypt json
---------
Co-authored-by: akashkulk <akashkulk@users.noreply.github.com>
Co-authored-by: subodh <subodh1810@gmail.com>
* Add `audience` and `user_interest` streams
* Updated PR number
* Fix unit tests
* Added space to shcema
---------
Co-authored-by: Ben Church <ben@airbyte.io>
* wip
* wip 2
* undo unwatned change
* some refactoring
* fix few tests
* more fixing
* more fixes
* Automated Commit - Format and Process Resources Changes
* more improvements
* 1 more test
* another test
* add flag for ctid enabling
* fix conflicts
* else block is not required
* use emittedAt
* skip WAL processing if streams under vacuuming
---------
Co-authored-by: subodh1810 <subodh1810@users.noreply.github.com>
Co-authored-by: Augustin <augustin@airbyte.io>
* Adds data as JsonNode to pass through, running into memory issues so add JVM args to attach VisualVM
* JsonNode
* Lowers the optimal batch size to see if this improvements movement
* Fixes NPE by checking if PartialAirbyteMessage contains a PartialAirbyteRecord
* Fixes config switch when config is not explicitly set (config migration needed)
* Adds logic to check if queue has elements before getting timeOfLastMessage
* Add PartialSerialisedMessage test. (#27452)
* Test deserialise.
* Add tests.
* Simplify and fix tests.
* Format.
* Adds tests for deserializeAirbyteMessage
* Adds tests for deserializeAirbyteMessage with bad data
* Cleans up deserializeAirbyteMessage and throws Exception when invalid message
* More code cleanup
---------
Co-authored-by: ryankfu <ryan.fu@airbyte.io>
* 🤖 Auto format destination-snowflake code [skip ci]
* Cleans up code w/o JVM args & rebase
* 🤖 Auto format destination-snowflake code [skip ci]
* Adds breadcrumb on the STATE message deviation and where the deserialize/serialize is done to unpack
* 🤖 Auto format destination-snowflake code [skip ci]
* Adds back line formatter removed and comment describing rational for lower batchSize
* Bumps Snowflake version and type checks
* Added note to remove PartialAirbyteRecordMessage with low resource testing
* Automated Commit - Format and Process Resources Changes
* Fix issue with multiple namespaces in snowflake not writing to the correct staging schema
* Fix issue with multiple namespaces in snowflake not writing to the correct staging schema
* remove stage name maniuplating method
* update readme
* Source Stripe: update credit_notes expected records (#27941)
* Source Zendesk Talk: update expected records (#27942)
* Source Xero: update expected records (#27943)
* Metadata: Persist Registry entries (#27766)
* DNC
* Update poetry
* Update dagster
* Apply partition
* Get metadata entry
* Use helpers
* Write registry entry to appropriate location
* Delete when registry removed
* Update to use new file (broken)
* Render registry from registry entries
* Run format
* Fix plural issue
* Update to all metadata file blobs
* Fix test
* Update to all blobs
* Add ignore validation error for version logic
* Rename to max_run_request
* Pedros review
* Ella suggestions
Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>
* Update airbyte-ci/connectors/metadata_service/orchestrator/orchestrator/assets/registry_entry.py
Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>
* Update naming
* Add tests for connector type and deletion
* Test safe parse
* Format
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>
* Fix Dagster Deploy Failure (#27955)
* Add pydantic
* Add pydantic to orchestration deploy pipeline
* 🐛 Source Jira: update expected records (#27951)
* Source Jira: update expected records
* Update issues expected records
* Source Zendesk Chat: update expected records (#27965)
* 🐛 Source Pipedrive: update expected records (#27967)
* 🐛 Source Pinterest: update expected records (#27964)
* ✨ Source Amazon-Ads: Add streams for portfolios and sponsored brands v3 (#27607)
* Add stream for sponsored brands v3
* Add new stream Portfolios
* Source Google Search Console: added discover and googleNews to searchType (#27952)
* added discover and googleNews to searchType
* updated changelog
* fixed types for streams
* 🎉 Source Instagram: Improve, refactor `STATE` management (#27908)
* add test for enabling
* update versions
* fix test
* update other snowflake loading method types
* remove standard
---------
Co-authored-by: ryankfu <ryan.fu@airbyte.io>
Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: ryankfu <ryankfu@users.noreply.github.com>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Arsen Losenko <20901439+arsenlosenko@users.noreply.github.com>
Co-authored-by: Ben Church <ben@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>
Co-authored-by: Anatolii Yatsuk <35109939+tolik0@users.noreply.github.com>
Co-authored-by: Daryna Ishchenko <80129833+darynaishchenko@users.noreply.github.com>
Co-authored-by: Baz <oleksandr.bazarnov@globallogic.com>
* docs: update close.com source page
- Added link to source
- Added step-by-step instructions for creating API key
- Addressed edge case wherein first-time users have slightly different setup steps
- Expanded setup steps,
- Added example of date formatting
- Fixed minor typos
* docs: updates to close.com source page
