1
0
mirror of synced 2025-12-30 12:04:43 -05:00
Commit Graph

5267 Commits

Author SHA1 Message Date
Artem Inzhyyants
77db5a32bd Source Google Ads: Add metrics & segment to Campaigns (#28042)
* Source Google Ads: extend campaigns schema: add metrics & segment

* Source Google Ads: bump version

* Source Google Ads: update docs

* Source Google Ads: update expected_records.jsonl

* Source Google Ads: update schema
2023-07-10 13:19:53 +02:00
Jimmy Ma
c7916d798d Add Orchestrator Diagram to the docs (#16675) 2023-07-09 19:20:38 -07:00
girarda
38709f997e Bump Airbyte version from 0.50.6 to 0.50.7 2023-07-09 19:38:07 +00:00
Mauricio A
f2b48d0025 Fixing vulnerabilities for source-salesforce - Premium support (#28021)
* Attempt #2 for source-salesforce vulnerabilites fixes
CVE-2022-40897
https://security-tracker.debian.org/tracker/CVE-2023-29383
https://security-tracker.debian.org/tracker/CVE-2023-31484
https://security-tracker.debian.org/tracker/CVE-2016-2781

* Changes requested during PR.
2023-07-07 17:12:23 -03:00
Ella Rohm-Ensing
1d42821d11 bump faker (#28060)
* bump faker

* add pr ref
2023-07-07 14:20:18 -05:00
michaelcabiareyes
89391ded3d 🐛 Source Okta: Fix Infinite Loop in GroupMembers Stream (#20833)
* Source Okta: Fix Unlimited Looping in GroupMembers Stream

* Source Okta: Resolve unit test error through removal of next_page_token param

* Source Okta: Revert changes in min_cursor_value

* fix unit test and bump connector version

* fix formatting

---------

Co-authored-by: Vincent Koc <vincentkoc@ieee.org>
Co-authored-by: michaelcabiareyes <michaelcabaireyes@gmail.com>
Co-authored-by: Mal Hancock <mhancock@archangelic.space>
Co-authored-by: Mal Hancock <mallory@archangelic.space>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
2023-07-07 12:38:14 -03:00
Anna Geller
d7dc6b52d2 📝 New documentation page: orchestrating Airbyte and Airbyte Cloud syncs with Kestra (#27695)
* Add documentation about Kestra Airbyte integration

* Update using-kestra-plugin.md

* Update using-kestra-plugin.md

* Update using-kestra-plugin.md
2023-07-07 08:52:54 -05:00
Serhii Lazebnyi
af9b332589 Source Google Ads: Add audience and user_interest streams (#27959)
* Add `audience` and `user_interest` streams

* Updated PR number

* Fix unit tests

* Added space to shcema

---------

Co-authored-by: Ben Church <ben@airbyte.io>
2023-07-07 14:42:18 +02:00
Denys Davydov
a924142791 Destination Google Sheets: migrate to advanced auth (#28035)
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #27975 destination google sheets: migrate from authSpecification to advancedAuth

* destination google sheets: upd changelog
2023-07-07 13:29:45 +03:00
Baz
9675cc12a2 🐛 Source Facebook Marketing: restore reduced request record limit after successful response (#27979) 2023-07-07 12:41:57 +03:00
Daryna Ishchenko
845b77102d 🎉 Source RD Station Marketing: migrated to advancedOAuth (#28009)
* migrated to advancedOAuth

* updated changelog
2023-07-07 03:48:12 -05:00
Denys Davydov
125c6af5ac 🚨🚨 Source Facebook Marketing: use SDK v17 (#27563)
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* source facebook-marketing: use SDK version 17

* source fb marketing: upd changelog

* 🤖 Auto format source-facebook-marketing code [skip ci]

* fix unit tests

* source fb marketing: fix CATs

* fix typo

* fix CAT

* Update backward compatibitliy disabled version

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Mal Hancock <mallory@archangelic.space>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
2023-07-06 18:05:01 -03:00
Joe Bell
b03be1b714 🐛 Destination Snowflake: Merge old snowflake work (#27935)
* Adds data as JsonNode to pass through, running into memory issues so add JVM args to attach VisualVM

* JsonNode

* Lowers the optimal batch size to see if this improvements movement

* Fixes NPE by checking if PartialAirbyteMessage contains a PartialAirbyteRecord

* Fixes config switch when config is not explicitly set (config migration needed)

* Adds logic to check if queue has elements before getting timeOfLastMessage

* Add PartialSerialisedMessage test. (#27452)

* Test deserialise.

* Add tests.

* Simplify and fix tests.

* Format.

* Adds tests for deserializeAirbyteMessage

* Adds tests for deserializeAirbyteMessage with bad data

* Cleans up deserializeAirbyteMessage and throws Exception when invalid message

* More code cleanup

---------

Co-authored-by: ryankfu <ryan.fu@airbyte.io>

* 🤖 Auto format destination-snowflake code [skip ci]

* Cleans up code w/o JVM args & rebase

* 🤖 Auto format destination-snowflake code [skip ci]

* Adds breadcrumb on the STATE message deviation and where the deserialize/serialize is done to unpack

* 🤖 Auto format destination-snowflake code [skip ci]

* Adds back line formatter removed and comment describing rational for lower batchSize

* Bumps Snowflake version and type checks

* Added note to remove PartialAirbyteRecordMessage with low resource testing

* Automated Commit - Format and Process Resources Changes

* Fix issue with multiple namespaces in snowflake not writing to the correct staging schema

* Fix issue with multiple namespaces in snowflake not writing to the correct staging schema

* remove stage name maniuplating method

* update readme

* Source Stripe: update credit_notes expected records (#27941)

* Source Zendesk Talk: update expected records (#27942)

* Source Xero: update expected records (#27943)

* Metadata: Persist Registry entries (#27766)

* DNC

* Update poetry

* Update dagster

* Apply partition

* Get metadata entry

* Use helpers

* Write registry entry to appropriate location

* Delete when registry removed

* Update to use new file (broken)

* Render registry from registry entries

* Run format

* Fix plural issue

* Update to all metadata file blobs

* Fix test

* Update to all blobs

* Add ignore validation error for version logic

* Rename to max_run_request

* Pedros review

* Ella suggestions

Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>

* Update airbyte-ci/connectors/metadata_service/orchestrator/orchestrator/assets/registry_entry.py

Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>

* Update naming

* Add tests for connector type and deletion

* Test safe parse

* Format

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>

* Fix Dagster Deploy Failure (#27955)

* Add pydantic

* Add pydantic to orchestration deploy pipeline

* 🐛 Source Jira: update expected records (#27951)

* Source Jira: update expected records

* Update issues expected records

* Source Zendesk Chat: update expected records (#27965)

* 🐛 Source Pipedrive: update expected records (#27967)

* 🐛 Source Pinterest: update expected records (#27964)

*  Source Amazon-Ads: Add streams for portfolios and sponsored brands v3 (#27607)

* Add stream for sponsored brands v3
* Add new stream Portfolios

* Source Google Search Console: added discover and googleNews to searchType (#27952)

* added discover and googleNews to searchType

* updated changelog

* fixed types for streams

* 🎉 Source Instagram: Improve, refactor `STATE` management (#27908)

* add test for enabling

* update versions

* fix test

* update other snowflake loading method types

* remove standard

---------

Co-authored-by: ryankfu <ryan.fu@airbyte.io>
Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: ryankfu <ryankfu@users.noreply.github.com>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Arsen Losenko <20901439+arsenlosenko@users.noreply.github.com>
Co-authored-by: Ben Church <ben@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>
Co-authored-by: Anatolii Yatsuk <35109939+tolik0@users.noreply.github.com>
Co-authored-by: Daryna Ishchenko <80129833+darynaishchenko@users.noreply.github.com>
Co-authored-by: Baz <oleksandr.bazarnov@globallogic.com>
2023-07-06 12:28:52 -05:00
midavadim
d1802154ae 🎉 Amazon Ads - new streams for bids and keyword recommendations (#28002)
* added new streams for amazon adgroup bids keyword recommendations

* updated docs and configured catalog

* updated version in metadata

* fix test

* updated docs

* fix doc after merge

* fix comments

* updated version

* fux typo
2023-07-06 13:18:33 -04:00
Artem Inzhyyants
5bdad0a87d Source Zendesk: add streams: PostVotes, PostCommentVotes (#27991)
* Source Zendesk Support: Add stream: `Post Comments`

* Source Zendesk Support: update docs

* Source Zendesk Support: update configured_catalog.json

* Source Zendesk Support: update test config

* Source Zendesk Support: bump version

* Source Zendesk Support: update unittests

* Source Zendesk Support: Update List name for parse

* Source Zendesk Support: add streams: `PostVotes`, `PostCommentVotes`

* Source Zendesk Support: fix formatting

* Source Zendesk Support: update catalog

* Source Zendesk Support: update test config

* Source Zendesk Support: bump version
2023-07-06 18:10:08 +02:00
Mal Hancock
71c4be1128 🐛 Source Tiktok Marketing: Update ad_groups schema (#27988)
* update schema and expected_records

* update docs
2023-07-06 09:54:59 -06:00
Artem Inzhyyants
7e232c5612 🚨🚨 Source Pipedrive: Remove followers_count field from Products stream (#27832)
* Source PipeDrive: update expected records

* Source PipeDrive: update `Products` schema

* Source PipeDrive: update docs

* Source Pipedrive: update docs

* Source Pipedrive: update test config

* Update acceptance-test-config.yml
2023-07-06 17:02:48 +02:00
Joe Reuter
5ec16b0ead Incremental data feed sync docs (#27654)
* incremental data feed sync docs

* adjust documentation for new UI

* Update docs/connector-development/connector-builder-ui/incremental-sync.md

Co-authored-by: Lake Mossman <lake@airbyte.io>

* Update docs/connector-development/connector-builder-ui/incremental-sync.md

Co-authored-by: Lake Mossman <lake@airbyte.io>

* Update docs/connector-development/connector-builder-ui/incremental-sync.md

Co-authored-by: Lake Mossman <lake@airbyte.io>

---------

Co-authored-by: Lake Mossman <lake@airbyte.io>
2023-07-06 10:46:00 -04:00
Artem Inzhyyants
dca40d6a26 Source Zendesk Support: Add stream: Post Comments (#27961)
* Source Zendesk Support: Add stream: `Post Comments`

* Source Zendesk Support: update docs

* Source Zendesk Support: update configured_catalog.json

* Source Zendesk Support: update test config

* Source Zendesk Support: bump version

* Source Zendesk Support: update unittests

* Source Zendesk Support: Update List name for parse

* Source Zendesk Support: fix formatting

* Source Zendesk Support: update expected_records
2023-07-06 16:06:50 +02:00
Augustin
de43104278 octavia-cli: deserialize selected field to a SelectedFieldInfo instance (#27559)
Co-authored-by: Malik Diarra <malik@airbyte.io>
2023-07-05 15:21:53 -07:00
Christo Grabowski
ece711d0fa 📝 docs: update confluence source page (#27927)
* docs: update confluence source page

* docs: update confluence source page
2023-07-05 15:13:43 -04:00
Christo Grabowski
ffb8953879 📝 docs: update chartmogul source page (#27925)
* docs: update chartmogul source page

* docs: update chartmogul source page
2023-07-05 15:13:27 -04:00
Christo Grabowski
bbbf1e66a6 📝 docs: update close.com source page (#27922)
* docs: update close.com source page

- Added link to source
- Added step-by-step instructions for creating API key
- Addressed edge case wherein first-time users have slightly different setup steps
- Expanded setup steps,
- Added example of date formatting
- Fixed minor typos

* docs: updates to close.com source page
2023-07-05 15:13:06 -04:00
Christo Grabowski
11952ce9bd 📝 docs: update delighted source page (#27928)
* 📝 docs: update delighted source page

* docs: update delighted.md

* fixed reference to incorrect source
2023-07-05 15:12:43 -04:00
Artem Inzhyyants
2849aa510f Source PayPal: mark Client ID and Client Secret as required fields (#27968)
* Source PayPal Transactions: update spec

* Source PayPal Transactions: update docs

* Source Paypal: update docs

* Source PayPal Transactions: update test config

* Source PayPal Transactions: update test config

---------

Co-authored-by: Augustin <augustin@airbyte.io>
2023-07-05 13:06:09 -05:00
chaucodes
ef24e7c999 Added June Changelog to docs 2023-07-05 10:31:07 -07:00
Baz
903724d905 🎉 Source Instagram: Improve, refactor STATE management (#27908) 2023-07-05 17:57:13 +03:00
Daryna Ishchenko
8970634947 Source Google Search Console: added discover and googleNews to searchType (#27952)
* added discover and googleNews to searchType

* updated changelog

* fixed types for streams
2023-07-05 16:55:19 +03:00
Anatolii Yatsuk
df135afa26 Source Amazon-Ads: Add streams for portfolios and sponsored brands v3 (#27607)
* Add stream for sponsored brands v3
* Add new stream Portfolios
2023-07-05 15:56:04 +03:00
Arsen Losenko
2ded988944 🐛 Source Pinterest: update expected records (#27964) 2023-07-05 15:33:27 +03:00
Arsen Losenko
0a9860bf9b 🐛 Source Pipedrive: update expected records (#27967) 2023-07-05 15:33:02 +03:00
Lake Mossman
810e4421ab Switch "request parameters" to "query parameters" in connector builder docs (#27896)
* Switch request parameters to query parameters in connector builder docsg

* fix more occurrences
2023-07-03 11:16:45 -07:00
Artem Inzhyyants
e387a5c0d6 Source Google Ads: handle Authorization Error (#27913)
* Source Google Ads: handle Authorization Error

* Source Google Ads: update docs

* Source Google Ads: bump version
2023-07-03 20:11:52 +02:00
Denys Davydov
e9fba26a99 🐛 Source Google Analytics Data API: limit custom report page size (#27909)
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #2277 source google data analytics: limit page size of custom reports streams

* upd changelog

* limit page size only for check command
2023-07-03 20:19:00 +03:00
Denys Davydov
660d87e770 🐛 Source Google Ads: fix query template (#27835)
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #2393 source google ads: fix query template

* source google ads: update changelog

* source google ads: add config and catalog to test click_view stream
2023-07-03 18:29:15 +03:00
Amélie
196fbbcf79 Update broken link in Meilisearch connector documentation (#27828) 2023-07-03 09:19:06 -05:00
Artem Inzhyyants
c734909b79 Source GitLab: add shared_runners_setting field to groups (#27869)
* Source GitLab: add `additionalProperties` to all schemas; add `shared_runners_setting` field to groups

* Source GitLab: update docs

* Source GitLab: remove additionalProperties

* Source GitLab: update docs

* Source GitLab: update expected records
2023-07-03 10:38:10 +02:00
Denys Davydov
a4e0f20bb2 🐛 Source Hubspot: use fully qualified name for custom objects (#27658)
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #2294 Source Hubspot: use fully qualified name to access custom objects

* #27658 source hubspot: upd changelog

* #2294 source hubspot: review fixes

* source hubspot: test commit to reset ci cache

---------

Co-authored-by: Augustin <augustin@airbyte.io>
2023-07-03 02:27:43 -05:00
girarda
bdbe549a90 Bump Airbyte version from 0.50.5 to 0.50.6 2023-07-02 18:47:03 +00:00
Edward Gao
52b8cbe39d Revert "Destination Bigquery: Scaffolding for destinations v2 (#27268)" (#27891)
* Revert "Destination Bigquery: Scaffolding for destinations v2 (#27268)"

This reverts commit ba3e39bb0c.

* bump versions to 1.5.1 everywhere
2023-06-30 20:26:48 -04:00
Marcos Marx
62ee7026e6 Docs: update contributing guides (#27812)
* changes

* update how to pr and readme

* update contributeing guides

* update code of conduct text

* update submit new connector

* submit new connector doc

* make one line for submit new conn find request

* improve words
2023-06-30 15:00:15 -06:00
Marcos Marx
f27b8ba602 Collecting Metrics docs: improve words and add doc to sidebar (#27883)
* improve words and add doc to sidebar

* update words in collecting metrics docs'
2023-06-30 13:31:20 -06:00
Marcos Marx
4684b68334 add collecting metrics as paid feature doc (#27870) 2023-06-30 11:42:46 -06:00
Roman Yermilov [GL]
b51f285e2d Source Zendesk Support: fix missing headers (#27765)
* Source Zendesk Support: fix missing headers
2023-06-30 21:18:16 +04:00
Daryna Ishchenko
a08911e4ce Source Google Search Console: add new streams (#27831)
* Source Google Search Console: Add new streams

* added new streams

* updated changelog

* updated minor version

* updated SAT

---------

Co-authored-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
2023-06-30 14:55:21 +03:00
midavadim
957f21da43 :rotating_light:🚨 Source Hubspot - fixed incremental for engagement stream (#27161)
* fixed incremental for engagement stream

* added comments

* updated docs

* updated schema for email_events

* updated expected records and increased major connector version

* added backward_compatibility_tests_config

* added email_event record with value in browser.version field

* 🤖 Auto format source-hubspot code [skip ci]

* fixed expected records

* updated version if docker file

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
2023-06-29 18:12:29 -04:00
Maxime Carbonneau-Leclerc
e8ddda9709 🐛 Source Square: update following state management changes in the CDK (#27762)
* Update square stream_slices

* Fix unit tests

* Version bump and changelogs

* Update changelogs

* Format code

* Update CDK version to fix bug

* Fix unit tests

* Increase CDK version
2023-06-29 15:33:04 -04:00
Maxime Carbonneau-Leclerc
22f7445db6 🐛 Source Greenhouse: update following state management changes in the CDK (#27773)
* Update greenhouse custom component

* Force airbyte-cdk version

* Fix code, bump version and update changelogs

* Fix unit tests

* Fix tests

* Fix set_initial_state for GreenHouseSubstreamSlicer

* Reformat using black

* isort

* Update update_state to close_slice

* Simplify code and format

* Update considering fix

* Update CDK version to fix bug
2023-06-29 15:22:59 -04:00
Maxime Carbonneau-Leclerc
96aa72d3b2 🐛 Source Posthog: update following state management changes in the CDK (#27764)
* Update interface based on new Cursor interface

* Update version and changelogs

* Update unit tests

* Fix cursor assignation

* Update update_state to close_slice

* Update considering fix

* Update CDK version to fix bug
2023-06-29 15:03:25 -04:00
Maxime Carbonneau-Leclerc
baaabf4390 🐛 Source Zenloop: update CDK version to avoid bug introduced during data feed release (#27838)
* Update CDK version to fix bug

* Version bump
2023-06-29 14:45:17 -04:00