1
0
mirror of synced 2026-01-23 13:01:50 -05:00
Commit Graph

8013 Commits

Author SHA1 Message Date
github-actions[bot]
8b683088df Bump helm chart version reference to 0.40.27 (#18152)
Co-authored-by: xpuska513 <xpuska513@users.noreply.github.com>
Co-authored-by: Kyryl Skobylko <xpuska513@gmail.com>
2022-10-19 10:05:37 +03:00
github-actions[bot]
ac026ac752 Bump helm chart version reference to 0.40.26 (#18094)
Co-authored-by: xpuska513 <xpuska513@users.noreply.github.com>
Co-authored-by: Kyryl Skobylko <xpuska513@gmail.com>
2022-10-19 09:55:48 +03:00
Emilija
75c367b38f Update deployment.yaml (#18151)
Do not ignore service account is webpp
2022-10-19 09:54:57 +03:00
Ryan Fu
8c780bd3aa Publishes Postgres, MySQL, MSSQL source with changes from #18041 (#18086)
* Publishes Postgres, MySQL, MSSQL source with changes from #18041

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-18 21:53:30 -07:00
Michael Siega
b18f95021e Fix minor DBT Cloud Errors. (#18147)
Fixes URL formatting for dbt cloud integration. Note, without a trailing / the dbt Cloud API returns a 308.

Some other small fixes:
- Retries around the dbt Cloud invocation
- Updates the regex to handle the new URL format.
2022-10-18 19:52:47 -07:00
Akash Kulkarni
66e0055822 Sentry Integration : Stop reporting all non system-error error types. (#18133)
* Sentry Integration : Stop reporting all non system-error error types.
2022-10-18 16:54:40 -07:00
Delena Malan
3b12a585ec Docs: Fix backoff stategy docs (#18143)
* Fix backoff strategy docs

* Update config_component_schema.json
2022-10-18 16:28:38 -07:00
Zachary Heller
d9a48c9449 🐛 Destination GCS: Fix error logs to log 'Gcs' rather than 'AWS' (#17901)
* Fix error logs to log 'Gcs' rather than 'AWS'

* update connector version

* auto-bump connector version

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-18 20:21:37 -03:00
Lake Mossman
19a296cfc8 Add openAPI spec for Connector Builder Server (#17535)
* add openapi spec

* add 'a'

* rename stream test to stream read and add logs

* move logs

* group results by slice/page and add more request params

* address PR/zoom feedback

* move request and response into their own definitions

* add sliceDescriptor

* fix type of state prop and remove numPages

* change order
2022-10-18 15:42:04 -07:00
Michael Siega
11699d4fe1 Alex/mvp UI for dbt cloud integration (#18095)
* Add lightly-styled ui for dbt cloud settings

* Add CollapsablePanel component

* Add CollapsablePanel around url input, MVP styling

To get the styling to work, I needed to edit `LabeledInput` to accept
a `className` prop, so I could give it contextually-specific styling.

* Add new feature flag for dbt cloud integration

This feature isn't added to either OSS or cloud builds; it will be
dynamically toggled for specific targeted accounts via LaunchDarkly's
`featureService.overwrites` key.

* Put settings page dbt cloud ui behind feature flag

* Add feature-flagged CloudTransformationsCard

* Extract (and rename) DbtCloudTransformationsCard

* Extract EmptyTransformationList component

* List transformations if any, "no integration" UI

This still uses some hardcoded conditions instead of anything resembling
actual data

* Initial UI for cloud transform jobs

* Use formik-backed inputs for job list data fields

* Improve job list management with FieldArray et al

* WIP: build payload to save job data as operations

There's some key data missing and it's not currently wired up

* Start pulling dbt cloud business logic to its own module

* Renaming pass (s/transformation/job/g)

* Move more logic into dbt service module

* Renaming pass (s/project/account/)

* Improve useDbtIntegration hook

* Add skeleton of updateWorkspace fn

* Connect pages to actual backend (no new jobs tho)

* Add hacky initial add new job implementation

* Put the whole dbt cloud card inside FieldArray

This dramatically simplifies adding to the list of jobs.

* Fix button placement, loss of focus on input

Never use the input prop in your component key, kids.

* re-extract DbtJobsList component

* Add input labels for dbt cloud job list

* Validate dbt cloud jobs so bad data doesn't crash the party

* Fix typo

* Improve dirty form tracking for dbt jobs list

* Remove unused input, add loading state to dbt cloud settings view

* Handle no integration, dirty states in dbt jobs list

Co-authored-by: Alex Birdsall <ambirdsall@gmail.com>
2022-10-18 13:59:38 -07:00
midavadim
370feccb51 increased timeout for sat tests (#18128)
Source Harvest - increase timeout for sat tests
2022-10-18 22:45:04 +03:00
Benoit Moriceau
adf2c5ff8e Bmoric/remove dep connector worker (#17977)
* test [ci skip]

* Autogenerated files

* Add missing annotation

* Remove unused json2Schema block from worker

* Move tess

* Missing deps and format

* Fix test build

* TMP

* Add missing dependencies

* PR comments

* Tmp

* [ci skip] Tmp

* Fix acceptance test and add the seed dependency

* Fix build

* For diff

* tmp

* Build pass

* make the worker to be  on the platform only

* fix setting.yaml

* remove dependency

* Fix pmd

* Fix Cron

* Add chart

* Fix cron

* Fix server build.gradle

* Fix jar conflict

* PR comments

* Add cron micronaut environemnt

* Update required build path

* remove all dependencies on worker

* Typo

* Add gradle exclusions

* Add exclusion to avoid conflict

* more exclusion

* Move more class

* Exclude worker from the general build

* Fix connector build
2022-10-18 11:51:25 -07:00
Evan Tahler
d7fd7b6777 recordsRead should be a long (#18123) 2022-10-18 11:36:59 -07:00
Yowan Ramchoreeter
d016ef11c9 doc_update_oath_issue_gsc (#17967)
* doc_update_oath_issue_gsc

We are currently blocked on some GCS OAuth workflows and we are adding a note to inform our customers.

* Updated wording

* Fixed wording for this connector

Approved and good to go
2022-10-18 14:26:07 -04:00
Marcos Marx
70dd9a85cf 🎉 Source Zendesk Chat: engagements data fix infinity looping + gradlew format (#18121)
* fix infinity looping in chats

* added more meaninful to variable name

* bump docker version

* auto-bump connector version

* run format

Co-authored-by: Roberto Bonnet <robertojuarezwp@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-18 15:14:02 -03:00
RobertoBonnet
740bbcde16 🐛 Source Zendesk Chat: engagements data fix infinity looping (#17745)
* included engagements in chats schema

* fix infinity looping in chats

* added more meaninful to variable name
2022-10-18 14:58:59 -03:00
Jonathan Pearlin
b4c16bfdbb Custom APM Tracing (#17947)
* Add APM tracing to airbyte-workers

* Add custom traces to airbyte-cron

* Formatting

* Refactor tag constants

* Handle potential null object

* Handle null tag values
2022-10-18 13:14:29 -04:00
Yevhen Sukhomud
8c3162aeba 11679 BigQuery-Denormalized Destination: improve code coverage (#17827)
* 11679 BigQuery-Denormalized Destination improve code coverage
2022-10-18 23:36:32 +07:00
midavadim
510daa4b0d increased timeout for sat tests (#18114)
increase timeout for sat tests
2022-10-18 19:12:55 +03:00
JC (Jonathan Chen)
7cb01a76e6 docs: clarify language (#18090) 2022-10-18 12:08:43 -04:00
Augustin
4db2364a67 source-e2e-test: update changelog with 0.1.2 (#18108) 2022-10-18 17:40:39 +02:00
Tyler B
40896d00c0 Re-direct Postgres guide to active page, current link is 404'd (#18103)
The current  "Refer to this guide..." link goes to a 404 page on postgres. The new link i put in is the equivalent of the old site. It can be compared using the wayback machine: https://web.archive.org/web/20220121223117/https://jdbc.postgresql.org/documentation/head/connect.html
2022-10-18 10:47:39 -04:00
Denys Davydov
9d23d48a01 #17506 fix klaviyo & marketo expected_records (#18101) 2022-10-18 15:04:05 +03:00
Denys Davydov
475df69a66 Source facebook-marketing: remove pixel from custom conversions stream (#18045)
* #744 source facebook-marketing: rm pixel from custom conversions stream

* #744 source fb marketing: upd changelog

* #744 source facebook-marketing - add custom_conversions to the test catalog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-18 13:22:41 +03:00
Denys Davydov
7a3815a7cd SATs: allow new records in a sequential read for full refresh test (#17660)
* SATs: allow new records in a sequential read for full refresh test

* SATs: upd changelog

* SATs: change the output when failing full refresh test

* SATs: upd according to code review
2022-10-18 11:34:50 +03:00
github-actions[bot]
d4351ee3b4 Bump helm chart version reference to 0.40.24 (#18081)
* Bump helm chart version reference to 0.40.24

* Update .gitignore

Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
Co-authored-by: Kyryl Skobylko <xpuska513@gmail.com>
2022-10-18 10:35:14 +03:00
Alexander Marquardt
26b6317198 Added new "filters" python file, along with a "hash" filter. This can… (#18000)
* Added new "filters" python file, along with a "hash" filter. This can be extended to include other custom filters in the future.

* Added additional comments

* Moved usage of the hash_obj inside the conditional that confirms it exists

* Moved the hash function call inside a condition to ensure that it exists

* Fixed the application of the salt , so that it does not modify the hash unless it is actually passed in.

* Added unit tests to validate new jinja hash functionality

* Updated unit test to pass numeric value as a float instead of string

* Removed unreferenced import to pytest

* Updated version

* format

* format

* format

* format

* format

Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
2022-10-17 23:19:55 -07:00
github-actions[bot]
a4253b3d26 Bump helm chart version reference to 0.40.22 (#18077) 2022-10-18 09:15:47 +03:00
Michael Siega
71967885e4 Implement webhook operation in the sync workflow (#18022)
Implements the webhook operation as part of the sync workflow.

- Introduces the new activity implementation
- Updates the various interfaces that pass input to get the relevant configs to the sync workflow
- Hooks the new activity into the sync workflow
- Passes the webhook configs along into the sync workflow job
2022-10-17 18:36:53 -07:00
Michael Siega
70cbdd8e50 tolerate database nulls in webhook operation configs (#18084) 2022-10-18 00:38:05 +02:00
Brian Lai
4714a1c004 fix check for streams that do not use a stream slicer (#18080)
* fix check for streams that do not use a stream slicer

* increment version and changelog before publish
2022-10-17 17:11:11 -04:00
Artem Inzhyyants
fc8be13d33 🎉 Source Shopify: Add metafield streams (#17962)
* 🎉 Source Shopify: Add metafield streams

* Source Shopify: fix unittest

* Source Shopify: docs update

* Source Shopify: fix backward compatibility test

* Source Shopify: fix schemas

* Source Shopify: fix state filter

* Source Shopify: refactor & optimize

* Source Shopify: fix test privileges

* Source Shopify: fix stream filter

* Source Shopify: fix streams

* Source Shopify: update abnormal state

* Source Shopify: fix abnormal state streams

* Source Shopify: fix streams

* updated methods, formated code

* Source Shopify: typo fix

* auto-bump connector version

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-17 23:01:10 +02:00
Octavia Squidington III
a5a0409ad5 Bump Airbyte version from 0.40.14 to 0.40.15 (#17970)
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
2022-10-17 13:33:20 -07:00
Benoit Moriceau
260ab6bdea Move the port forward outside of the main docker-compose (#17864) 2022-10-17 12:59:28 -07:00
Amruta Ranade
8560f19022 Updated connector catalog page (#18076) 2022-10-17 15:41:50 -04:00
Benoit Moriceau
7a71c55c1f Bmoric/remove dep server worker (#17894)
* test [ci skip]

* Autogenerated files

* Add missing annotation

* Remove unused json2Schema block from worker

* Move tess

* Missing deps and format

* Fix test build

* TMP

* Add missing dependencies

* PR comments

* Tmp

* [ci skip] Tmp

* Fix acceptance test and add the seed dependency

* Fix build

* For diff

* tmp

* Build pass

* make the worker to be  on the platform only

* fix setting.yaml

* Fix pmd

* Fix Cron

* Add chart

* Fix cron

* Fix server build.gradle

* Fix jar conflict

* PR comments

* Add cron micronaut environemnt
2022-10-17 12:35:04 -07:00
Prasanth
211b4beb42 Helm Chart: Create service annotations for airbyte-server (#17932)
* Support annotations for airbyte-server as well, update version and update docs.

* Fix auto-indent.

Co-authored-by: Kyryl Skobylko <xpuska513@gmail.com>
2022-10-17 22:29:07 +03:00
github-actions[bot]
6ebfe6b0b7 Bump helm chart version reference to 0.40.20 (#18074)
* Bump helm chart version reference to 0.40.20

* remove binary

Co-authored-by: xpuska513 <xpuska513@users.noreply.github.com>
Co-authored-by: Kyryl Skobylko <xpuska513@gmail.com>
2022-10-17 22:04:53 +03:00
Yevhen Sukhomud
ee2e2b5b1f 16250 Destination Redis: Add SSH support (#17951)
* 16250 Destination Redis: Add SSH support

* 16250 Resolve port issue

* 11679 Bump version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-18 02:00:51 +07:00
Kyryl Skobylko
e40375b79d Update helm charts (#18073)
* add test

* fix chart.yaml
2022-10-17 21:33:17 +03:00
Kyryl Skobylko
e546ebd92d Update helm chart comments (#18072) 2022-10-17 21:24:06 +03:00
Alexandre Girard
0ffd503b21 🐛 [low-code] $options shouldn't overwrite values that are already defined (#18060)
* fix

* Add missing test

* remove prints

* extract to method

* rename

* Add missing test

* rename

* bump
2022-10-17 11:07:04 -07:00
Evan Tahler
792fa7cead Remove unused airbyte-cli (#18009) 2022-10-17 10:28:53 -07:00
Kyryl Skobylko
e4f8e75410 Update helm release workflow (#18048)
* Update workflow

* Update trigger rules

* fix: Update release workflow with abillity to add tags

* Update workflow
2022-10-17 20:28:06 +03:00
Jimmy Ma
5a80c765c2 Add Message Migration to Destination Connection Checks (#17954)
* Add Message Migration to Destination Connection Checks

* Fix test setup
2022-10-17 10:26:41 -07:00
Ryan Fu
ef3e84ce3a Checks for iterator hasNext element (#18041)
* Checks for iterator hasNext element

* Fix linter with newline
v0.40.18-helm
2022-10-17 10:08:07 -07:00
terencecho
e51756bb23 Skip psql stop in acceptance test for gke (#18023) 2022-10-17 09:48:55 -07:00
Pedro S. Lopez
19a7747e43 🧹remove YamlSeedConfigPersistence (#18018) 2022-10-17 10:53:21 -04:00
Vladimir
80128bea02 trim namespace custom format before submit (#17986) 2022-10-17 16:08:45 +03:00
Alexandre Girard
df72bbdf2c Low-code: Pass stream_slice to read_records when reading from CheckStream (#17804)
* Implement a test

* Implement fix

* rename

* extract method

* bump
2022-10-17 05:47:56 -07:00