Ben Church
68e4d503ef
Update gradle command to remove gitignored files ( #26924 )
...
* Update gradle command to remove gitignored files
* fix typo
* Automated Commit - Format and Process Resources Changes
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com >
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com >
2023-06-02 02:24:59 +00:00
Augustin
1166d41d18
connectors-ci: get modified files from PR API ( #26889 )
2023-06-02 00:46:37 +02:00
Augustin
de052da4f4
cat: fix test_catalog_has_supporte_data_types when / in stream property ( #26868 )
2023-05-31 22:10:55 +00:00
Augustin
801dea2129
connectors-ci: dynamic dependency resolution and test trigger ( #26740 )
2023-05-31 14:50:22 +00:00
midavadim
812aa3aca6
🎉 Source Hubspot: added custom availability strategy ( #26418 )
...
* Added custom availability strategy which catches permission errors from parent streams
* added PR number to doc
* Automated Change
* fixed expected records
* updated version in metadata
* Automated Change
* merged the latest changes
* updated doc
* updated doc
* Automated Change
---------
Co-authored-by: midavadim <midavadim@users.noreply.github.com >
2023-05-31 13:12:28 +00:00
Ben Church
248bbf94c1
HACKDAY: Icon CDN ( #26158 )
...
* Move icons to connector folder
* Delete old icons
* Update upload logic
* Add icon url to definitions
* Update registry model
* Populate cdn url
* DNC butcher the pipeline
* Low hanging fruit fixes
* Fix bucket name
* Merge old and new approaches
* Fix metadata upload step
* Format
* Fix test
2023-05-24 17:25:41 -07:00
Ben Church
84afcde697
Delete registry ( #26374 )
2023-05-22 16:59:46 -05:00
Artem Inzhyyants
ffad67dd55
Source Pinterest: Add pattern for start_date ( #25984 )
...
* Source Pinterest: Add pattern for start_date
* Source Pinterest: update docs
* Source Pinterest: fix backward compatibility
* Source Pinterest: handle wrong date format
* Source Pinterest: add unit test
* Source Pinterest: fix test
---------
Co-authored-by: artem1205 <artem1205@users.noreply.github.com >
2023-05-22 21:13:37 +00:00
Augustin
80032f73f9
connectors-ci: deprecate slash publish ( #25865 )
2023-05-22 10:10:56 +02:00
Edward Gao
50e784b844
🐛 Destination Snowflake: mitigate infinite retries in snowflake jdbc driver ( #26323 )
...
* switch to forked snowflake jdbc driver
* oops. rebuild with retryCount < 100
* Automated Change
* version bumps + changelog
---------
Co-authored-by: edgao <edgao@users.noreply.github.com >
2023-05-20 06:08:34 -07:00
Denys Davydov
1c8d7aa4f9
🐛 Source Mixpanel: fix build ( #26310 )
...
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds
* source square: fix expected records
* Automated Change
* Automated Change
---------
Co-authored-by: davydov-d <davydov-d@users.noreply.github.com >
2023-05-19 19:36:43 +00:00
Ben Church
016ec1b1bb
Delete registry ( #26315 )
2023-05-19 13:26:14 -05:00
Sajarin
a3cd983dbb
[non-forked] Source Freshservice API: add stream for customer satisfaction survey responses endpoint ( #25929 )
...
* Source Freshservice API: change field data type from integer to string to match API
* Source Freshservice API: correct data types for phone number fields
* Source Freshservice API: correct data types for phone number fields
* add missing testing dependencies
* remove unnecessary install
* Source Freshservice: add stream for customer satisfaction survey responses
* version bump
* fix: linting
* update integration test files with new stream
* bump dockerfile, readme and metadata.yaml
* fix dockerfile and broken cat schema file
* Automated Change
* Automated Change
* fix dockerfile whitespace and add null to schema fields for csat stream
* Automated Change
* Update freshservice.md
* Automated Change
---------
Co-authored-by: Adam Roderick <aroder@gmail.com >
Co-authored-by: Adam Roderick <23650+aroder@users.noreply.github.com >
Co-authored-by: sajarin <sajarin@users.noreply.github.com >
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com >
2023-05-19 13:58:17 -04:00
Ben Church
dcec1b236b
Registry: Refactor and Remove registry download from git. ( #26217 )
2023-05-19 09:05:09 -07:00
Denys Davydov
90de330942
🐛 Source Square: fix build ( #26298 )
...
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds
* Connector health: upd CAT config for source-square
* Automated Change
---------
Co-authored-by: davydov-d <davydov-d@users.noreply.github.com >
2023-05-19 18:12:52 +03:00
Marcos Marx
9ac8ba41a1
✨ Source Notion: add parent field to blocks streams ( #26286 )
...
* add parent field to blocks
* udpate docs
* Automated Change
* Automated Change
* format oss registry and update notion
* Automated Change
* Update notion.md
2023-05-19 10:06:17 -03:00
Augustin
8fff0dbb14
connectors-ci: force image's layers compression to GZIP ( #26291 )
2023-05-19 12:02:03 +02:00
Augustin
4527542f9a
connectors-ci: check compression type on image layers ( #26138 )
2023-05-19 09:07:37 +02:00
Edward Gao
d5e6bc0bfd
tiny fix in /publish output ( #26267 )
2023-05-18 22:09:17 +00:00
Duy Nguyen
1a45a66133
Source Postgres: Number(38,0) is incorrectly translated to a destination Double instead of BigInt ( #25898 )
...
* Translate Numeric with no decimals to BigInt + relevant tests
* Update CDC to handle numeric/decimal arrays correctly
* Revert spacing
* Preserve Decimal scale of numeric columns
* Bumped versions to 2.0.29 + docs
* Bumped versions in metadata.yaml
* Automated Change
---------
Co-authored-by: nguyenaiden <nguyenaiden@users.noreply.github.com >
2023-05-18 13:02:27 -07:00
Edward Gao
c25afc4adb
🐛 Destination BigQuery (+denormalized): correctly parse buffer count from config ( #26213 )
...
* fix logic in parsing config
* simplify logic
* ugh
* holy moly that took way too many iterations
* version bumps / changelog
* Automated Change
* ✨ Destination Bigquery: stop running normalization container for DAT (#25925 )
* readme update
* allow passing additional flags to test containers
* remove build dependency
* Automated Change
* versioning updates
* restore denormalized change from master
* formatting changes
* formatting
* Automated Change
* update metadata file
---------
Co-authored-by: jbfbell <jbfbell@users.noreply.github.com >
* fix version (#26218 )
* Source Airtable: skip missing streams (#25946 )
* Source Airtable: skip missing streams
* Move stream removal to a separate method, cover with tests
* Update changelog
* Fix flake warnings
* Update docs/integrations/sources/airtable.md
Co-authored-by: Sherif A. Nada <snadalive@gmail.com >
* Update docs/integrations/sources/airtable.md
Co-authored-by: Sherif A. Nada <snadalive@gmail.com >
* Automated Change
* Update link to docs in warning
* Automated Change
* Automated Change
* Automated Change
* “Empty-Commit”
---------
Co-authored-by: Sherif A. Nada <snadalive@gmail.com >
Co-authored-by: arsenlosenko <arsenlosenko@users.noreply.github.com >
* 🎉 New Source: Ringcentral [Low code CDK] (#25701 )
* Initial commit - All test passed
* add stream fax cover
* refactor docs
* fix schema, Added pagination
* Add several streams, fix schema
* fix schema, add streams, refactor docs
* EOF
* Resolve conflicts
* Resolve conflicts
* add metadata file
---------
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com >
* rebump version
* Automated Change
---------
Co-authored-by: edgao <edgao@users.noreply.github.com >
Co-authored-by: Joe Bell <joseph.bell@airbyte.io >
Co-authored-by: jbfbell <jbfbell@users.noreply.github.com >
Co-authored-by: Joe Reuter <joe@airbyte.io >
Co-authored-by: Arsen Losenko <20901439+arsenlosenko@users.noreply.github.com >
Co-authored-by: Sherif A. Nada <snadalive@gmail.com >
Co-authored-by: arsenlosenko <arsenlosenko@users.noreply.github.com >
Co-authored-by: btkcodedev <btk.codedev@gmail.com >
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com >
2023-05-18 16:45:24 +00:00
Artem Inzhyyants
00c8e03da7
Source Google Ads: handle refresh error ( #26209 )
...
* Source Google Ads: handle refresh error
* Source Google Ads: update docs
* Automated Change
* Source Google Ads: add unit tests
* Automated Change
* Empty-Commit
---------
Co-authored-by: artem1205 <artem1205@users.noreply.github.com >
2023-05-18 17:28:32 +02:00
btkcodedev
4be1baf041
🎉 New Source: Ringcentral [Low code CDK] ( #25701 )
...
* Initial commit - All test passed
* add stream fax cover
* refactor docs
* fix schema, Added pagination
* Add several streams, fix schema
* fix schema, add streams, refactor docs
* EOF
* Resolve conflicts
* Resolve conflicts
* add metadata file
---------
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com >
2023-05-18 11:25:45 -03:00
Arsen Losenko
9fb3542160
Source Airtable: skip missing streams ( #25946 )
...
* Source Airtable: skip missing streams
* Move stream removal to a separate method, cover with tests
* Update changelog
* Fix flake warnings
* Update docs/integrations/sources/airtable.md
Co-authored-by: Sherif A. Nada <snadalive@gmail.com >
* Update docs/integrations/sources/airtable.md
Co-authored-by: Sherif A. Nada <snadalive@gmail.com >
* Automated Change
* Update link to docs in warning
* Automated Change
* Automated Change
* Automated Change
* “Empty-Commit”
---------
Co-authored-by: Sherif A. Nada <snadalive@gmail.com >
Co-authored-by: arsenlosenko <arsenlosenko@users.noreply.github.com >
2023-05-18 12:15:23 +03:00
Joe Bell
9a4be977c1
✨ Destination Bigquery: stop running normalization container for DAT ( #25925 )
...
* readme update
* allow passing additional flags to test containers
* remove build dependency
* Automated Change
* versioning updates
* restore denormalized change from master
* formatting changes
* formatting
* Automated Change
* update metadata file
---------
Co-authored-by: jbfbell <jbfbell@users.noreply.github.com >
2023-05-18 00:46:32 +00:00
Baz
30869b5a8e
🐛 Source Salesforce: update expected records after credentials rotation ( #26139 )
...
* fixed
* Automated Change
* Automated Change
* Automated Change
* dummy update to retrigger CI
* Automated Change
* updated
---------
Co-authored-by: bazarnov <bazarnov@users.noreply.github.com >
2023-05-17 20:56:52 +00:00
Serhii Chvaliuk
30d8bb4133
Source Github: implement client-side throttling of requests ( #25793 )
...
Signed-off-by: Serhii Chvaliuk <grubberr@gmail.com >
2023-05-17 22:18:37 +03:00
Denys Davydov
5575d86f68
🐛 Source Hubspot, Gitlab, Salesloft, Pinterest: fix builds ( #26188 )
...
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds
* connector health: fix builds for gitlab, salesloft, pinterest, hubspot
* conenctor health: update changelog
* Automated Change
* connector health - fix prop type
* connector health: upd expected records
* Automated Change
* empty commit to trigger ci
---------
Co-authored-by: davydov-d <davydov-d@users.noreply.github.com >
2023-05-17 20:03:50 +03:00
Baz
a6dfbeb5f9
🐛 Source Slack: limit the lookback window range to prevent Overflow with dates ( #26186 )
2023-05-17 16:03:59 +03:00
Artem Inzhyyants
8fadfbd8e5
Source Facebook Marketing: handle config errors ( #26000 )
...
* Source Facebook Marketing: handle account ID
* Source Facebook Marketing: handle wrong account id
* Source Facebook Marketing: refactor wrong insights fields in custom streams
* Source Facebook Marketing: handle code 100 for wrong account
* Automated Change
---------
Co-authored-by: artem1205 <artem1205@users.noreply.github.com >
2023-05-17 13:03:08 +02:00
Serhii Chvaliuk
033e62ad4c
Source File Secure: bump source-file version 0.2.38 -> 0.3.7 ( #26131 )
...
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com >
2023-05-17 02:44:22 +03:00
Artem Inzhyyants
0eefa33bcb
Source Google Sheets: handle config errors ( #26097 )
...
* Source Google Sheets: handle config errors
* Source Google Sheets: update docs
* Source Google Sheets: fix test
* Source Google Sheets: add unit tests
* auto-bump connector version
* Automated Change
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
Co-authored-by: artem1205 <artem1205@users.noreply.github.com >
2023-05-17 00:14:26 +02:00
Ben Church
1d856ab943
Feat: Metadata Service remove old catalog system ( #26013 )
...
* Remove Definition File References from Python files (#25590 )
* Remove check_images_exist.sh
* Update definitions.py
* Update build_report.py
* Update tools/bin/ci_integration_workflow_launcher.py
* Update tools/bin/ci_check_dependency.py
* tools/bin/scan_all_spec_airbyte_secret.py
* Remove qa engine references
* Revert "Remove check_images_exist.sh"
This reverts commit 7675162789#25593 )
* Remove Definition File References from Java files (LocalDefinitionProvider), shell scripts and docs (#25592 )
* Remove CombinedConnectorCatalogGenerator.java
* Update local definition provider
* Update local def test
* Add spec mask downloader
* Make downloader work
* Delete generators and add tests
* REMOVE THE YAML FILES
* Roughly update docs
* Update shell scripts
* Remove unused
* Add connector metadata file doc
* Apply suggestions from code review
Co-authored-by: Augustin <augustin@airbyte.io >
* Additional PR comments
* Run format tasks
---------
Co-authored-by: Augustin <augustin@airbyte.io >
* Remove unused import
* bundle registry
* Ignore future updates
* Update registry
* new registry
* Readd maskeddatainterceptor
* Automated Change
* Remove icon validation
* Automated Change
* Automated Change
* Source Amazon Ads: get rid of `fail_on_extra_columns: false` in SAT (#25913 )
* Source Amazon Ads: small schema fixes
* Source Amazon Ads: update changelog
* Source Amazon Ads: update unittest
* Source Amazon Ads: unittest additional property is boolean
* Source Amazon Ads: bump version
* auto-bump connector version
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
* connectors-ci: make spec-cache / metadata bucket and creds not required for pre-release (#26119 )
* Automated Change
---------
Co-authored-by: Augustin <augustin@airbyte.io >
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com >
Co-authored-by: Roman Yermilov [GL] <86300758+roman-yermilov-gl@users.noreply.github.com >
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2023-05-16 11:40:11 -07:00
Roman Yermilov [GL]
ce9eb8ab4c
Source Github: better error explanation for 401 ( #26025 )
...
* Source Github: better error explanation for 401
* Source Github: bump version, update changelog
* Source Github: fix test name
* Source Github: fix unittests
* Source Github: bump version
* auto-bump connector version
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2023-05-16 22:35:22 +04:00
Roman Yermilov [GL]
94d0d61248
Source Amazon Ads: get rid of fail_on_extra_columns: false in SAT ( #25913 )
...
* Source Amazon Ads: small schema fixes
* Source Amazon Ads: update changelog
* Source Amazon Ads: update unittest
* Source Amazon Ads: unittest additional property is boolean
* Source Amazon Ads: bump version
* auto-bump connector version
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2023-05-16 21:47:33 +04:00
Serhii Chvaliuk
63887f7fe0
Source File: add retry on SSHException('Error reading SSH protocol banner') ( #26115 )
...
Signed-off-by: Serhii Chvaliuk <grubberr@gmail.com >
2023-05-16 20:03:37 +03:00
Ella Rohm-Ensing
c5f4e85c63
update aircall icon ( #26124 )
2023-05-16 15:59:05 +00:00
Daryna Ishchenko
05990806a1
🐛 Source GitHub: added description for no repos case error ( #26075 )
...
* added description for no repos case error
* added AirbyteTracedException
* added changelog
* removed handling error in validation
* updated github.md
* added unit test test_streams_no_streams_available_error
* auto-bump connector version
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2023-05-16 18:07:20 +03:00
Serhii Chvaliuk
1cbd9252ba
Source: Amazon Ads - Improve error handling for attribution_report(s) streams ( #25885 )
...
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com >
2023-05-16 17:43:26 +03:00
Artem Inzhyyants
fc6165ee1c
Source File: Check if reader options is JSON object ( #26117 )
...
* Source File: check if reader options is JSON object
* Source File: bump version; update docs
* Source File: update error message
* Source File: format
* Source File: test fix
* auto-bump connector version
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2023-05-16 12:03:36 +00:00
Serhii Chvaliuk
08fe992c43
Source Google Ads: improve GAQL parser error messages ( #25947 )
...
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com >
2023-05-16 14:46:05 +03:00
Denys Davydov
d756940092
🐛 Source Pinterest, Source Strava, Source Sentry, Source Xero: fix builds ( #26112 )
...
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds
* Connector health: fix builds for sentry, strava, xero, pinterest
* connector health: upd changelog
* auto-bump connector version
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2023-05-16 11:39:45 +03:00
Ryan Fu
95dd113a5f
Revert "Splits bases and updates build.gradle files ( #25649 )" ( #26081 )
...
* Revert "Splits bases and updates build.gradle files (#25649 )"
This reverts commit c673b0a692
2023-05-15 21:56:40 +00:00
terencecho
780903ff80
🚨 🚨 e2e-test: Standardize e2e testing destination spec ( #25776 )
...
* Standardize e2e testing destination
* Change casing
* Fix implementation
* Update versions and docs
* Do major version bump
* Update acceptance tests
* use correct name
* Fix implementation
* Automated Change
* Revert "Automated Change"
This reverts commit 816b66229fterencecho@users.noreply.github.com >
2023-05-15 14:01:54 -07:00
Serhii Chvaliuk
eff127ee20
Source: Iterable - improve 500 handling for Events stream ( #26014 )
...
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com >
---------
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com >
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2023-05-15 20:30:17 +03:00
Artem Inzhyyants
93f3286a0d
🚨 🚨 Source S3: use platform-handled schema evolution ( #25127 )
...
* Source S3: Remove match_target_schema; use platform-handled schema evolution instead
* Source S3: Remove ab_additional_col
* Source S3: update docs; bump version
* Source S3: fix unit tests
* Source S3: fix expected_records
* Source S3: revert _match_target_schema
* Source S3: update expected records for parquet dataset
* Source S3: update metadata
* auto-bump connector version
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2023-05-15 17:14:26 +02:00
Aazam Thakur
53658ac7d7
Source Marketo: New Stream Segmentation ( #23956 )
...
* Added Segmentation Stream
* change endpoint to read all segments
* remove unused params
* add json schema header
* bump connector version and update doc
* remove f-string not used
* fix schema and correct segmentations base stream class
* remove incremental from int test segmenations config cat
* fix segmentations params
* add expected records
* Update marketo.md
* bump the metadata file
* auto-bump connector version
---------
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com >
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com >
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2023-05-12 17:58:09 -03:00
Denys Davydov
84fd8a5290
🐛 Source Close-Come, Source Hubspot, Source GitHub, Source TikTok-Marketing, Source SurveyMonkey, Source SmartSheets: fix builds ( #26024 )
...
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds
* fix builds
* resolve dependencies conflict, bump version
* tiktok: upd expected records
* connector health: revert GA4 changes
* auto-bump connector version
* connector health: upd source definitions manually
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2023-05-12 23:10:19 +03:00
Serhii Lazebnyi
1060415870
🎉 Categorized Config Errors Accurately for Google Analytics 4 (GA4) and Google Ads ( #25987 )
...
* Categorized Config Errors Accurately
* Update PR number
* Update error list for GAv4
* Updated version
* Updated formating
* auto-bump connector version
* Skip spec backward compatibility
* auto-bump connector version
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2023-05-12 21:39:10 +02:00
Edward Gao
fb152a9a0a
Normalization: Better handling for CDC transactional updates ( #25993 )
...
* try this?
* fix tests
* assert cdc values
* handle case where we have lsn but no updated_at
* readability improvements
* tweaks to test
* version bumps + changelogs
* Automated Change
---------
Co-authored-by: edgao <edgao@users.noreply.github.com >
2023-05-12 12:53:23 +00:00
