1
0
mirror of synced 2025-12-21 11:01:41 -05:00
Commit Graph

174 Commits

Author SHA1 Message Date
Marius Posta
f5c7c1c0b8 chore: get ./gradlew format to pass for the whole repo (same java style) (#29786) 2023-08-24 05:09:42 -05:00
Roman Yermilov [GL]
34e7144047 Source Intercom: migrate to latest cdk (0.50.2) (#29598) 2023-08-23 19:17:56 +04:00
Ben Church
40781313da Update Internal Fields: update ql levels to better resemble previous high strictness (#29450) 2023-08-15 18:03:10 -05:00
Augustin
00d9462216 cat/connectors-ci: replace docker runner with dagger runner in CAT (#28000) 2023-08-11 17:58:48 +02:00
Ben Church
2f7deaee02 [skip ci] Metadata: Remove leading underscore (#29024)
* DNC

* Add test models

* Add model test

* Remove underscore from metadata files

* Regenerate models

* Add test to check for key transformation

* Allow additional fields on metadata

* Delete transform
2023-08-03 10:56:13 -07:00
Ben Church
e9490e3fb6 Connector Levels: Add new internal metadata fields (#28904)
* Add airbyte internal

* Add tests

* First pass

* Set destinations to same levels as sources

* Best guess at missing statuses

* Best guess at _ql

* Add separate enum class

* Fix support level name

* Update templates

* Add one more test
2023-08-01 18:08:33 -05:00
Arsen Losenko
83faee7e4f Source Intercom: update expected records (#28196) 2023-07-12 14:52:44 +03:00
Arsen Losenko
715aec90b0 Source Intercom: update expected records (#28001) 2023-07-06 18:25:06 +03:00
Denys Davydov
0714656e77 🐛 Source Intercom: migrate to advancedAuth (#26571)
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26238 source intercom: migrate to advancedAuth

* source intercom: upd changelog

* source intercom: resolve conflicts

* revert leverhiring changes
2023-05-29 21:44:25 +03:00
Ben Church
1dabc6208e Metadata: add tags field (#26320)
* Add optional tags field

* Remove duplicate icons

* Add programming tags to all

* Update docs

* supportUrl -> documentationUrl

* Ensure one language tag is applied

* Add keyvalue check

* rebase and fix tests

* Format

* Add cache buster

* Improve test

* Automated Commit - Formatting Changes

* Update error

* Fix missing tags

* Fix scaffold

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
2023-05-26 16:13:09 -07:00
Ben Church
248bbf94c1 HACKDAY: Icon CDN (#26158)
* Move icons to connector folder

* Delete old icons

* Update upload logic

* Add icon url to definitions

* Update registry model

* Populate cdn url

* DNC butcher the pipeline

* Low hanging fruit fixes

* Fix bucket name

* Merge old and new approaches

* Fix metadata upload step

* Format

* Fix test
2023-05-24 17:25:41 -07:00
Augustin
7310494846 qa-checks: check metadata version matches dockerfile version (#25661) 2023-05-04 16:08:19 -07:00
Ben Church
5563179782 Dagster: rename catalog to registry (#25254)
* rename catalog to registry in metadata service

* rename catalog to registry in metadata files

* Run generate models

* Fix missed renames

* Add github personal access token

* Run black

* Automated Change

---------

Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
2023-04-18 22:15:11 +02:00
Augustin
ebc907cdf7 create metadata files for all connectors (#24964) 2023-04-13 07:45:04 +02:00
Baz
78828413a2 🎉 Source Intercom: migrate from Python CDK to Declarative YAML (Low Code) (#23013) 2023-04-04 18:24:19 +03:00
Arsen Losenko
c0f89ea570 Source Intercom: Mark datefields in spec as dates (#22980)
* Source Intercom: Mark datefields in spec as dates

* Update changelog

* Update Dockerfile

* Update Dockerfile

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-03 14:02:51 +03:00
Serhii Lazebnyi
03e1ec4cb8 Connector Health: Fixed SAT for close-com, facebook-marketing, freshsales, greenhouse, hubspot, intercom, jira, mixpanel, monday, pipedrive, recharge, sentry, slack, strava, stripe, trello, twitter, youtube-analytics, twillio, faker (#24361)
* Fix expected records for hubspot and intercom

* Fix typo for intercom

* Fix close com, fecebook marketing, freshsales, greenhouse expected records

* Fix intercom CAT

* Fix unittest for new pydentic version

* Fix facebook marketing unittests and jira CAT

* Fix formating for facebook marketing, jira and CAT for monday

* Fix pipedrive and recharge CAT

* Fix CAT for Slack, Strava, Stripe, Trello and Twitter

* Fix expected records for slack

* Fix CAT for Youtube and Sentry

* Fix unittests for mixpanel

* Added allowedHosts and fix facebook marketing CAT

* Fix CAT for Faker and Twillio

* Fix expected records for hubspot

* Fix expected records for Sentry

* Fix check status for GAv4
2023-03-28 20:31:41 +02:00
Ella Rohm-Ensing
9cfc647fa5 Ella/fail on extra fields (#23985)
* Pass argument along, add test that should pass and test that should fail

* Add tests with additionalProperties

* Set additionalproperties=false when not set|

* Parametrize test cases

* Make the behavior 'optional'

* Fix parametrization for all combinations

* Improve CI credentials README and rename param

* Update naming to be clearer about columns only

* record_has_unexpected_field > record_has_unexpected_column

* Automated Change

* Add bypass for beta + ga connectors that failed

* Update docs and TODOs

* Update changelog and dockerfile

* Update TODO

* Update a few neglected connectors

* Remove uploaded file

* Update dockerfile after merge conflict

---------

Co-authored-by: marcosmarxm <marcosmarxm@users.noreply.github.com>
2023-03-23 22:22:44 +00:00
John Aitchison
6bc96b514e Source Intercom: extend Contacts schema with opted_out_subscription_types (#22095)
* new contacts prop, opted_out_subscription_types

* bump intercom version

* update changelog

* fix typo in changelog

* update connectors.md

---------

Co-authored-by: sh4sh <6833405+sh4sh@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
2023-03-15 17:44:20 -03:00
Daryna Ishchenko
39c56c9cb1 Source Intercom: updated test_switch_to_standard_endpoint and test_companies_scroll (#23152)
* updated test_switch_to_standard_endpoint and test_companies_scroll

* added type transformer for stream companies, updated expected records

* added allowedHosts

* auto-bump connector version

* Automated Change

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: darynaishchenko <darynaishchenko@users.noreply.github.com>
2023-02-27 17:33:19 +02:00
Catherine Noll
7da6a3bb77 Run CATs with local CDK (#23084)
Scripts to 

* Run CATs against the local CDK for one connector

* Run CATs against the local CDK for multiple connectors

* Create a connecter image with the local CDK

---------

Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2023-02-24 16:13:42 -05:00
Cole Snodgrass
2e099acc52 update headers from 2022 -> 2023 (#22594)
* It's 2023!

* 2022 -> 2023

---------

Co-authored-by: evantahler <evan@airbyte.io>
2023-02-08 13:01:16 -08:00
Joe Reuter
6a10ae3e05 Rename source acceptance test to connector acceptance test (#21846)
Rename source acceptance test to connector acceptance test
2023-02-02 11:38:19 +01:00
Ella Rohm-Ensing
829fe63f6e Turn off default httpavailabilitystrategy for source-intercom (GA) (#22010)
* Turn off default for source-intercom (GA)

* Update source.py

* Update intercom.md

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-01-28 00:47:51 -05:00
Denys Davydov
4ae80b0350 #19050 Source Intercom: high test strictness level (#21859) 2023-01-25 20:51:59 +02:00
darynaishchenko
3d85faaeea stream conversations: fixed expected records (#21581) 2023-01-20 11:08:18 +02:00
Evan Tahler
e39e1898c5 Expected Records to .jsonl format (#20850)
* Expected Records to `.jsonl` format

* fix formatting template

* remove endline

* update templates

* Update docs/connector-development/testing-connectors/source-acceptance-tests-reference.md

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
2023-01-03 15:55:36 -08:00
Roman Yermilov [GL]
fda55bf1b2 Source Intercom: change airbyte-cdk version to 0.2 (#18681)
* Source Intercom: change airbyte-cdk version to 0.2

* Source Intercom: update chagelog

* Source Intercom: bump version and update chagelog

* Source Intercom: Fix PR id in chagelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-31 17:04:31 +04:00
Serhii Chvaliuk
672260a363 Source intercom: switch on airbyte-cdk=0.2.0 (#18216)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-10-20 19:17:03 +03:00
Pedro S. Lopez
938436bcc9 update connector specs and definitions with new .com documentation urls (#17585)
* update definitions with new .com docs urls

* update docs urls in specs

* update generators

* regenerate scaffold connectors

* remove unrelated changes

* update more urls

* update specs

* fix tests

* run `:airbyte-config:specs:generateSeedConnectorSpecs` to fix formatting

* revert docs changes to make pr more reviewable

* revert generator readme changes to make more reviewable

* fix mysql strict encrypt expected spec

* fix postgres expected spec
2022-10-11 11:04:23 -04:00
Augustin
0f618f3503 migrate GA source connectors to per-stream state (#17326) 2022-09-29 14:45:35 +02:00
Benoit Moriceau
a0b4044bef Fix intercom (#16540)
* Fix intercom

* PR comments

* test

* Restore bmusko version

* Bump version and update changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-12 09:19:54 -07:00
Ryan Fu
4572b75845 Moved getConnection into a try-with block and ran gradlew format (#15805) 2022-08-22 19:54:00 -07:00
Alex
94fcf0d3c6 🎉 Source Intercom: Update Intercom API to version 2.5 (#15681)
* upgrade intercom API to v2.5

* update conversations schema

* update expected records

* update change log

* fix doc formatting

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-18 15:06:04 -05:00
Augustin
13b59c0ab8 non-jdbc source connectors: Remove additional properties from beta/GA specs and schemas (#14924) 2022-07-22 12:20:08 +02:00
Baz
6bf7064c51 🐛 Source Intercom: added state_checkpoint_interval for all incremental streams (#14830) 2022-07-20 12:19:21 +03:00
Marcos Marx
8bbe9939f6 run gradlew format (#14721) 2022-07-14 15:17:12 -03:00
Baz
c13e35821c 🐛 Source Intercom: fix conversation_parts stream schema (#14554) 2022-07-11 22:37:35 +03:00
Baz
cae55cc1a5 🐛 Source Intercom: refactored slow streams to use /search endpoint (#14403) 2022-07-06 15:22:05 +03:00
Baz
9828246e12 🐛 Source Intercom: extend Contacts schema with new properties (#14099) 2022-06-27 12:50:06 +03:00
Marcos Marx
dca2256a7c Bump 2022 license version (#13233)
* Bump year in license short to 2022

* remove protocol from cdk
2022-05-26 15:00:42 -03:00
Pedro S. Lopez
d2aedc7aa2 🐛 Source Intercom: fix conversation_parts stream schema (#13204)
* fix conversation_parts schema

* bump version, update changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-25 18:44:21 -04:00
Andy
5aed8e2147 Update connector specs (#12482) 2022-05-04 22:44:44 -07:00
Luis Gomez
1642630461 🐛 Source Intercom: Fixed filtering of conversation_parts (#12374) 2022-04-29 15:55:26 +02:00
Brian Leonard
c302af45ff Upgrade to Python 3.9 (#11763)
* Dockerfile to 3.9

* Python version

* More python updates

* 3.9 on GitHub actions and lint updates

* Test out 3.9.11 on GitHub actions

* install python with an action

* formatting: newline

* Also has python code

* only check first level for changed modules
Previous example (source-google-search-console/credentials)

* Test failure: there is no logger.trace
2022-04-11 20:51:37 -07:00
Serhii Lazebnyi
3f50396989 🎉Source Intercom: increase unit test coverage at least 90% (#11405)
* Increased unit test coverage to 90

* Updated doc for OAuth

* Fix typo

* Updated doc to review

* Updated doc to review

* Update docs/integrations/sources/intercom.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Update docs/integrations/sources/intercom.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Update docs/integrations/sources/intercom.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Update docs/integrations/sources/intercom.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Fix unit test

* Fix to linter

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2022-03-28 13:54:31 +03:00
Luis Gomez
787daa9961 🎉 Source Intercom: Added conversation_id field to conversation_part records (#11206) 2022-03-25 19:09:34 +01:00
Christophe Duong
316180c186 format code (#11399) 2022-03-25 09:55:11 +01:00
Marcos Marx
893e5de9f2 Source Intercom: bump connector version (#11328) 2022-03-22 18:54:30 -03:00
Mohamad Hallak
7d9e9dd365 🐛 Fix Intercom stream base url in check connection (#11176)
* [Bug fix] Intercom stream base url

* Restore backslash and use urljoin
2022-03-22 18:52:56 -03:00