Marcos Marx
c72012012f
Docs: add troubleshooting for mysql ( #11012 )
...
* add troubleshooting for mysql
* correct abhi comments
2022-03-10 15:14:34 -03:00
Augustin
acd56cd1d8
🐙 octavia-cli: create octavia env file ( #11005 )
2022-03-10 17:47:12 +01:00
midavadim
a1a4bbca1e
🎉 Source stripe - enhanced performance for streams which run substreams ( #10359 )
...
* enhanced performance for streams which run 1 requests for each main item.
* removed unused types
* moved common code to StripeSubStream
* updated docs, updated docker version
* updated connector version in source_specs.yaml
2022-03-10 18:14:32 +02:00
Serhii Chvaliuk
d19754c169
🐛 Source Github: Fix error handling for 404 streams ( #10878 )
...
* Fix, no error if "Projects" feature is disabled
* improve requests.codes.NOT_FOUND
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com >
2022-03-10 18:02:51 +02:00
Augustin
af1a503df5
🐛 octavia-cli: update readme ( #11002 )
...
* fix 2.b
* fix 2.b
2022-03-10 15:56:46 +01:00
Tim Roes
0854adac43
Only run slash commands on PRs ( #11017 )
2022-03-10 14:50:37 +01:00
Thibaud Chardonnens
921f4a13c6
add /tmp emptyDir volume to connector pods ( #10761 )
...
Some connectors (such as destination-s3) require to write some temporary data (generally to /tmp).
It is a good security practice to enforce read only root filesystem on Kubernetes pod, and, some productive Kubernetes clusters enforce that all pods run with read only root filesystem.
Therefore, in order to still allow connectors to write temporary data to /tmp with read only root fs, we must mount an emptyDir volume to /tmp.
The original PR was here: #9874 we decided to split it into 3 different PRs.
This limit for this will be done in https://github.com/airbytehq/airbyte/issues/11025 .
2022-03-10 21:01:09 +08:00
Serhii Lazebnyi
c6caf14724
🐛 Source Facebook Marketing: Add temporary OAuth error handling ( #10917 )
...
* Add temporary oauth error handling
* Updated PR number
* Update docs/integrations/sources/facebook-marketing.md
Co-authored-by: Sherif A. Nada <snadalive@gmail.com >
* Updated version and unittests
* Deleted typo
* Updated to linter
* Bumped version
Co-authored-by: Sherif A. Nada <snadalive@gmail.com >
2022-03-10 14:36:24 +02:00
Serhii Chvaliuk
1bf94704fc
🐛 Source Github: add new stream ProjectCards ( #10766 )
...
* add new stream `Deployments`
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com >
2022-03-10 11:01:51 +02:00
Octavia Squidington III
1861b32cb2
Bump Airbyte version from 0.35.48-alpha to 0.35.49-alpha ( #11014 )
...
Co-authored-by: pmossman <pmossman@users.noreply.github.com >
2022-03-09 20:25:25 -08:00
Edward Gao
e4be0df9a1
🐛 Correctly populate secrets inside nested non-combination objects ( #10926 )
2022-03-09 17:01:05 -08:00
Parker Mossman
d9ccc626f2
adjust gradle build so that buildDockerImage-bootloader and buildDockerImage-server can be up-to-date when nothing changed between builds ( #11001 )
2022-03-09 16:18:27 -08:00
Parker Mossman
a063fb2f75
Use ContainerRequestContext to pass requestBody between request and response filter ( #10875 )
...
* try using MDC for requestBody
* add test for request body race condition
* use a threadlocal for request body instead of MDC
* update comment
* move MDC.setContextMap call back to where it was originally
* use ContainerRequestContext to pass requestBody from request filter to response filter, update test to reflect this change
* javadoc and format
2022-03-09 15:35:46 -08:00
LiRen Tu
b166ba6d4f
🐞 Add ignore-empty flag to sentry release ( #11009 )
2022-03-09 15:24:11 -08:00
Octavia Squidington III
bf1320b714
Bump Airbyte version from 0.35.47-alpha to 0.35.48-alpha ( #11007 )
...
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com >
2022-03-09 15:16:10 -08:00
Augustin
8c3b5fc613
🐛 octavia-cli: do not use deepcopy ( #11000 )
2022-03-09 23:38:48 +01:00
LiRen Tu
d57408269b
📝 Add connector-name examples in java profiling doc ( #11006 )
2022-03-09 14:38:28 -08:00
LiRen Tu
f5748998c8
Fix unit test failures from env configs ( #10998 )
...
* Fix unit test failures from env configs
* Default null to empty string
* Format code
* Fix one more unit test
* Remove unused import
2022-03-09 14:24:54 -08:00
Augustin
5d4deb4a5c
read from /dev/tty ( #10997 )
2022-03-09 23:00:30 +01:00
Marcos Marx
44e8f6fcdf
Auto-upgrade connectors when they are in use only a patch version update ( #10515 )
...
* auto-upgrade connectors there are in use with patch version only
* update check version docstring
* remove try/catch from hasNewPatchVersion
* refactor write std defs function
* run format
* add unit test and change exception
* update airbyte version function name to be more clear
* correct unit test in migration tests
* run format
2022-03-09 18:43:48 -03:00
Augustin
ba4e86f146
🐙 octavia-cli: secret management ( #10885 )
2022-03-09 21:35:56 +01:00
Augustin
ad20f00442
🐙 octavia-cli: package and install script ( #10823 )
2022-03-09 17:54:24 +01:00
Artem Astapenko
1b85ff78ef
Fix incorrect path selection for oneOf cases in jsonschema ( #10883 )
...
* Fix incorrect path selection for oneOf cases in jsonschema
2022-03-09 19:13:02 +03:00
Augustin
56bf982cb9
🐙 octavia-cli: apply connections ( #10881 )
2022-03-09 17:08:46 +01:00
Marcos Marx
2c813e60b3
Fix airbyte protocol spelling in cdk ( #10984 )
...
* fix airbyte protocol in cdk
* regenerate protocol file
2022-03-09 13:02:45 -03:00
LiRen Tu
81417e6728
Add connector metadata as sentry tags ( #10475 )
...
* Pass worker metadata to connector
* Fix compilation
* Pass in job id and image from worker
* Remove application version
* Add default job environment variables
* Add back removed comment
* Rename env map to job metadata
* Fix env configs
* Read connector from application
* Use empty string
* Remove println
* Fix unit test
* Fix compilation error
* Introduce constants for worker env
* Add worker env to ENV_VARS_TO_TRANSFER
* Pass into getWorkerMetadata map to all constructions
* Format code
* Format octavia cli
* Fix test compilation
* Fix typos
2022-03-09 07:36:03 -08:00
Davin Chia
2eab2daca5
Correct metric type. ( #10987 )
...
This metric should be a DD distribution instead of a gauge since we want percentiles.
2022-03-09 23:20:48 +08:00
Tim Roes
656499603a
Send segment event with utm params ( #10879 )
...
* Send segment event with utm params
* Adjust event name and params
* Use useEffectOnce
2022-03-09 15:29:47 +01:00
LiRen Tu
80a2b642f9
📝 Document java connector memory profiling ( #10983 )
...
* Add doc for java connector memory profiling
* Add doc to summary
* Update doc
* Update doc
* Update doc
2022-03-09 05:58:33 -08:00
Baz
0c064f1fbe
🐛 Source Shopify: Improve SubStream state handling ( #10915 )
2022-03-09 15:24:21 +02:00
Marcos Marx
8f49e193f2
🐙 octavia-cli: add generate for connections ( #10809 )
...
* create connection cli command
* add connection.yaml template
* add template file
* remove unused vars and imports
* create group for generate command
* correct connection template
* implement suggestions
* implement suggestions
* fix existing tests
* test resources
* test renderer
* rename renderer module to renderers
* test generate command
* fix yaml style
* fix yaml style
* revert unrelated changes
* revert unrelated changes
* clean
* clean
* add required resource_name field to template
* undo snakecasing + delete jsonschema
* add source_id destination_id to yaml top
* fix
* add json schema in connection integration test
* make write_yaml a base method + implement _render
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com >
2022-03-09 10:06:39 -03:00
Christian Persson
124a3c6cb9
Fixes a typo in airbyte_protocol.yaml ( #10970 )
2022-03-09 09:12:38 -03:00
Benoit Moriceau
780c98c476
Add test that check that we continue a reset as a reset if it failed ( #10806 )
...
This is adding tests to make sure that a reset is continued as a reset after an attempt or as a job when the maximum amount of attempt is reach.
It also fixes the workflow to continue as a reset in a new job if it fails more than the maximum number of attempt.
Open question:
- Is it what we want for the job (continue as a reset if the job failed)?
- Do we need to respect the schedule if the reset failed more than the maximum attempts?
2022-03-08 17:36:39 -08:00
Benoit Moriceau
7fb09936a3
Stop docker acceptance instances ( #10961 )
...
* Stop docker acceptance instances
* Fix typo
2022-03-08 17:06:30 -08:00
gavnate
4880709132
🐛 Fix ExternalDB settings are not passed to temporal deployment ( #10923 )
...
* Fix for issue https://github.com/airbytehq/airbyte/issues/7067
* Basing external-db secret on conditional for postgresql in helm chart
2022-03-08 20:46:10 -03:00
Jasper C
4ece1adda0
Chart Update: add checksum annotation for deployment.yaml ( #10918 )
...
added checksum/config annotation to deployment
2022-03-08 20:44:24 -03:00
Octavia Squidington III
cdbe1c295b
Bump Airbyte version from 0.35.46-alpha to 0.35.47-alpha ( #10957 )
...
Co-authored-by: davinchia <davinchia@users.noreply.github.com >
2022-03-09 02:11:56 +08:00
Eugene Kulak
2932039a35
🎉 Source FB Marketing: add time_increment parameter to custom insight streams ( #10531 )
...
* added time_increment parameter
* fix custom insights
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com >
Co-authored-by: Sherif A. Nada <snadalive@gmail.com >
2022-03-08 15:31:41 +01:00
Mohamed Magdy
63af98e3b9
🎉 Recurly Schema Revamp ( #9866 )
...
* Cleanup Recurly connector schemas
* Add more Recurly schemas to the connector
- `billing_infos`
- `shipping_addresses`
- `shipping_methods`
- `subscription_changes`
* Add Recurly `add-on` resouce
* Add Recurly's account notes resource schema
* Add unique coupons to Recurly source
* Add credit payments to Recurly connector
* Add Recurly resources to integration tests configurations
* Bump Recurly source version to `0.4.0`
* Add `line_items` Recurly resource
* Add `line_items` to Recurly documentation
* Add missing `line_items` JSON schema
* Replace Subscription Change Recurly API call with Subscription `pending_changes` field
* Replace Recurly unique coupon codes API call with coupons `unique_coupon` field
To avoid the extra API call to import unique coupon calls
* Revert "Replace Recurly unique coupon codes API call with coupons `unique_coupon` field"
This reverts commit 1c4592d82d
2022-03-08 17:59:47 +05:30
Subodh Kant Chaturvedi
9dede53fd2
update list of tables with latest changes ( #10833 )
2022-03-08 16:35:17 +05:30
Augustin
a9ac813467
use yaml safe load ( #10882 )
2022-03-08 11:52:32 +01:00
Tim Roes
3df0619b84
Allow slash commands on PRs from forks ( #9742 )
...
This enables all slash commands to also work on PRs created from forks. This will not run CI on PRs coming from a fork. There are unfortunately some limitations around injecting secrets in pull_request actions, which I described in detail in this comment.
I've done most of the testing for this in https://github.com/timroes/github-actions-test to test out that the context are set the way I'd expect them.
There's one risk: if any of the actual build scripts called by one of the slash commands would use this repository hard-coded they might fail. I've tried to search through the whole code base and don't believe this is the case.
2022-03-08 18:15:18 +08:00
Davin Chia
f232bd5f26
Add num of active connection per workspace metric. ( #10916 )
...
Part of https://docs.google.com/document/d/11pEUsHyKUhh4CtV3aReau3SUG-ncEvy6ROJRVln6YB4/edit# .
Add number of active connection per workspace metric.
Refactor the test class to pull out nested classes that were accidentally nested in another nested class.
2022-03-08 12:56:12 +08:00
girarda
fd13ab1970
Fix CONNECTORS_BASE build for M1 ( #10925 )
...
* Pass in arm64
* default value
* fix
2022-03-07 17:30:41 -08:00
Greg Solovyev
baae71390b
Fix Sonar for non-python connectors ( #10928 )
...
This is a quick fix that moves cat ${REPORT_FOLDER}/*
inside if block for python-based connectors.
2022-03-07 16:41:19 -08:00
Malik Diarra
6ac3eb27c4
Add indices useful for listStandardSyncForWorkspace func ( #10922 )
2022-03-07 16:09:06 -08:00
Benoit Moriceau
fd1f9339ed
Disable flaky test ( #10927 )
2022-03-07 15:26:10 -08:00
Tim Roes
64828679ed
Revert "Change offer amount"
...
This reverts commit e1cb84c3ad
2022-03-07 23:16:14 +01:00
Sherif A. Nada
1dbaa1fdca
Remove reference to Github Secrets, update with GSM
2022-03-07 13:35:04 -08:00
davidbeckse
a62dbddeff
Doc: deploy use variable instead of hard coded value ( #10921 )
...
Replace "airbyte" with $INSTANCE_NAME
2022-03-07 16:25:22 -03:00
