1
0
mirror of synced 2026-01-22 00:06:56 -05:00
Commit Graph

752 Commits

Author SHA1 Message Date
Harshith Mullapudi
78d17bc1a4 Source Amazon Seller Partner: Error for max wait time reached when create report status is CANCELLED or FATAL (#4108)
* 1. Use pendulum - user friendly
2. Fix: Error for max wait time reached when create report status is CANCELLED or FATAL

* Write test cases and changelog
2021-06-16 11:59:40 -07:00
LiRen Tu
53b51c08d1 Bump S3 destination version (#4166) 2021-06-16 11:54:50 -07:00
Prashantha Patali
0884fa74a6 📚More clarity added for Windows based Docker Desktop environments (#4068)
* Additinal details about Windows specific long filename error during cloning

* Corrected the path

* Revert "Corrected the path"

This reverts commit bbd3b78fcb.

* Revert "Additinal details about Windows specific long filename error during cloning"

This reverts commit 0b695eea1a.

* Email is mandatory 'Specify your preferences', Link to docker inst guide

* Use relative paths while linking

* Typo in Destination section

* On Windows, fixing long filename error during cloning

* For Windows with WSL2 and Docker, clarify steps to locate destination local folder

* Link to locating local files on Windows

* Update docs/contributing-to-airbyte/updating-documentation.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/quickstart/set-up-a-connection.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/examples/postgres-replication.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/examples/postgres-replication.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/examples/postgres-replication.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/local-deployment.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/local-deployment.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

Co-authored-by: Patali, Prashanth <ppatali@hidglobal.com>
Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>
2021-06-16 14:14:25 -03:00
Marcos Marx
810fde9e21 Documentation correct summary normalization docs (#4158)
* correct summary

* run format master failing
2021-06-16 12:36:41 -03:00
Marcos Marx
3dd14e2c88 add section troubleshoot related issue btw kubectl/kustomize on k8s deploy (#3573)
* add problem btw kubectl/kustomize

* update comments
2021-06-15 20:54:06 -03:00
Charles
02c49c15cd update style docs on import styles (#4144) 2021-06-15 13:05:47 -07:00
Kirill Chernov
856abc3b8f 🎉 Google Analytics connector is failing (#3648)
* added filter of streams and deleted duplicated title in spec.json

* fixed discover returns empty streams

* pr changes

* chmod on files changed

* chmod on files changed

* chmod on files changed

* added acceptance tests

* added pre commit config

* fixed chmod on amazon and facebook files

* fixed chmod on amazon and facebook files

* version bump

* version bump

* build file fix

* removed unrelated files

* removed unrelated files

* removed unrelated files

* removed unrelated files

* removed unrelated files

* removed unrelated files
2021-06-15 20:41:35 +03:00
LiRen Tu
4e449e98a5 Bump jira version (#4126) 2021-06-15 03:34:47 -07:00
Harshith Mullapudi
5a37359389 🎉 Added getting started for google ads connector (#4125) 2021-06-15 17:52:19 +08:00
John Lafleur
01584a9eb2 Adding links to set up walkthrough in docs (#4120)
* Adding link to set up walkthrough in Home of Docs

* Adding walkthrough link in Getting started page
2021-06-15 14:50:18 +11:00
LiRen Tu
87552b25e4 🎉 Destination S3: parquet output (#3908)
* Add skeleton code for parquet writer

* Refactor s3 destination code

* Add parquet to spec

* Complete parquet writer

* Change testing data from int to double

* Add acceptance test for parquet writer

* Handle special schema field names

* Format code

* Add parquet config

* Add documentation

* Add unit tests

* Fix typo

* Update document

* Bump version

* Fix date format

* Fix credential filename

* Update doc

* Update test and publish commands

* Refactor s3 format config

* Append compression codec file extension

* Update doc

* Remove compression codec file extension

* Add comments

* Add README, CHANGELOG, and sample configs

* Move changelog

* Use switch statement

* Move filename helper method to base writer

* Rename converter

* Separate test cases

* Drop union type length restriction

* Support array with multiple types

* Move comments to connector doc

* Share config between acceptance tests

* Add doc about additional properties

* Move shared code out of if branch

* Add doc about adding a new format

* Format code

* Bump version to 0.1.4

* Fix default max padding size
2021-06-14 16:49:27 -07:00
Abhi Vaidyanatha
8f3bf60d96 Add community Code of Conduct. (#4116)
* Add community Code of Conduct.

* Clarify DMs

* Add to SUMMARY.md

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-06-14 15:59:58 -07:00
Abhi Vaidyanatha
656d69c5af Refactor tutorials section in docs to be more clear (#4052)
* Refactor tutorials section in docs to be more clear.

* Fix SUMMARY.md for transformations with Airbyte

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-06-14 15:53:02 -07:00
Marcos Marx
688ce0a1de Minor code style step (#4110)
* add oracle destionation to config files

* minor step applying code style
2021-06-14 18:24:59 -03:00
Marcos Marx
f97db4bff2 Add transform airbyte dbt to Summary and change links (#4106)
* add transform airbyte dbt and change links

* minor typo

* resolve comments

* convetion applied SQL and dbt all 3 tutorials
2021-06-14 18:19:17 -03:00
Marcos Marx
d31e245f92 Add oracle destination to config files (#4045)
* add oracle destionation to config files

* change to oracle alpha + add integration page

* minor typo
2021-06-14 17:22:51 -03:00
Christophe Duong
22b75c56ea Add docs on custom Operations (#3507)
* Add docs on custom Operations

Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>
2021-06-14 10:31:38 +02:00
John Lafleur
5cb6f5fe17 Job description for content writer (#4078)
* Job description for content writer

* Update SUMMARY.md

* Rename technical-content-writer to technical-content-writer.md
2021-06-14 13:11:47 +11:00
Fred Reimer
153310a86a Fix invalid JSON syntax (#4077)
Co-authored-by: Fred Reimer <freimer@presidio.com>
2021-06-13 16:16:53 -03:00
Duk Panhavad
d2f9643650 🎉 Destination S3: alternative S3 support (#4038)
Authored by @panhavad

* base from prev PR
* add s3 alternative destination connector feature
* fix testGetOutputFilename
* default using aws
* Update airbyte-integrations/connectors/destination-jdbc/src/main/java/io/airbyte/integrations/destination/jdbc/copy/s3/S3Config.java
2021-06-13 00:57:19 -07:00
Artem Astapenko
d06c9b735e Jamakase/add normalization and transformation block (#3921)
* Add normalization block

* Add transformation block

* Add operations resource

* Move transformation form to separate component

* Rename operations field on backend. Improve transformations usage

* Mock listOperations operation in unit test

* Make basic a default normalization

* Add errors for forms

* Select basic normalization by default

* Add support to optionally display normalization

* Add supportsDbt and supportsNormalization destination fields

* add useInitialValues hook

* Reinit form on change

Co-authored-by: Christophe Duong <christophe.duong@gmail.com>

* Fix onChange to onSelect renaming

Co-authored-by: Christophe Duong <christophe.duong@gmail.com>
2021-06-12 04:14:42 +07:00
Christophe Duong
7c26305865 Add supportsDBT and supportsNormalization to API objects (#4031)
* Add supportsDBT and supportsNormalization to API objects
2021-06-11 10:11:42 +02:00
Dmytro
d5d0c8b252 Replace npm install + generate -> ./generate.sh in docs (#4048) 2021-06-11 02:17:35 +03:00
Abhi Vaidyanatha
e26f813536 Remove Postgres references in OracleDB Destination Docs (#4043)
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-06-10 15:29:48 -06:00
irynakruk
446ec0407f 🎉 New Source: Snowflake DB (#3844) 2021-06-10 12:52:47 -07:00
Abhi Vaidyanatha
d7a8427d2d 06/10/2021 Changelog Updates (#4036)
* 06/10/2021 Changelog Updates

* Review changes

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-06-10 12:49:40 -06:00
Christophe Duong
9965abb905 Bump version: 0.24.8-alpha → 0.25.0-alpha (#4022) 2021-06-10 14:39:48 +02:00
Davin Chia
efdeb4fe9c Bump version: 0.24.7-alpha → 0.24.8-alpha (#4015) 2021-06-10 11:57:50 +08:00
John Lafleur
7e162032f7 Update SUMMARY.md 2021-06-10 14:30:15 +11:00
John Lafleur
5c235aa81a Rename upgrading.md to on-upgrading.md 2021-06-10 14:29:29 +11:00
John Lafleur
b9c983805e Update running-sync.md 2021-06-10 14:29:10 +11:00
John Lafleur
0206666aaa Update new-connection.md 2021-06-10 14:28:27 +11:00
John Lafleur
1fa6960e42 Update on-deploying.md 2021-06-10 14:25:19 +11:00
John Lafleur
2b5bafbd76 Update and rename on-deploy.md to on-deploying.md 2021-06-10 14:25:02 +11:00
Jared Rhizor
36488ef282 fix network boundary error / format (#4011) 2021-06-09 16:17:24 -07:00
Matheus Vinicius de Paula
e4335b1d17 Making single port 8000 default and update NetworkErrorBoundary (#3656)
* Making single port 8000 default and update NetworkErrorBoundary.tsx response code 502

* add .env files

* Updating instructions in docs/deploying-airbyte/*
2021-06-09 16:14:12 -07:00
Jared Rhizor
b3756b1daf docs: DRY titles for zoom activity dashboard example (#3213) 2021-06-09 13:45:08 -07:00
Marcos Marx
4881167460 Add issue about loading a lot of tables (#3975)
* add issue about loading a lot of tables

* change feedback
2021-06-09 17:17:57 -03:00
John Lafleur
749c74b0c5 Update README.md 2021-06-09 13:15:47 +11:00
vovavovavovavova
07b09a9a12 🎉 Posthog: New Source (#3768)
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
2021-06-08 16:55:05 -07:00
Marcos Marx
b414f694eb Add troubleshooting section and remove FAQ file (#3902)
* add troubleshooting section and remove FAQ file

* add windows new tutorial to summary

* remove change on normalization

* add eof

* transfer user handbook to docs

* review comments and made changes
2021-06-08 20:31:22 -03:00
etsybaev
eec3e03ddb 🎉 Added JDBC source connector bootstrap template (#3819)
* [3560] Added JDBC source connector bootstrap template
2021-06-08 21:04:10 +03:00
Oleksandr
01dc7bbde9 🎉 Add Airbyte-native shopify connector (replaces Singer-based) (#3787)
* first commit

* Delete source copy.py

File doesn't need

* IAdded Incremental Refresh + stream_slice for Refunds, Transactions

* small changes to source.py

* fixed Incremental Refresh

* Fixed acceptence-tests

* Edited no-refunds-catalog for acceptence-tests

* changed the state

* Commit for Review

* removed spaces

* added parameter to orders stream to read all the records by default

* added parameter to abandoned_checkouts stream to read all the records by default

* minor fix

* minor fix

* changed authentication method from basic http > header based auth, removed usage of api_key

* reformated source.py

* improved source.py, removed dependencies block from build.gradle

* removed unneeded dependencies + formated source.py

* changed Shopify in source_definitions.yaml from singer-based to cdk version, changed years in the documents

* added source_definition for source-shopify cdk json file

* Delete airbyte-config/init/bin/main/config/STANDARD_SOURCE_DEFINITION directory

* Add files via upload

* added secret credentials for source-shopify

* Delete 9da77001-af33-4bcd-be46-6252bf9342b9.json

* re-added source_definition file

* Delete airbyte-config/init/bin/main/config/STANDARD_SOURCE_DEFINITION directory

* re-added source definition

* Delete airbyte-config/init/bin/main/config/STANDARD_SOURCE_DEFINITION directory

* edit source definitions

* source definition change: removed icon block

* ...

* changed source_definition.json

* changed source_definition.json

* Added ability to specify the start_date of data replica.

* changed docker version to 0.1.1 - bumped version on image, aedited request_params for metafields

* changed docker version to 0.1.1 - bumped version on image, aedited request_params for metafields

* changed docker version to 0.1.1 - bumped version on image, aedited request_params for metafields

* changed collects to full_refresh by default

* changed collects to full_refresh by default

* Delete airbyte-config/.settings directory

* Delete .classpath

* Delete .project

* Delete .project

* Delete .classpath

* Delete airbyte-config/init/.settings directory

* Delete airbyte-config/init/bin directory

* Delete airbyte-config/models/.settings directory

* Delete airbyte-config/models/bin directory

* Delete .classpath

* Delete .project

* Delete airbyte-config/persistence/.settings directory

* Delete airbyte-config/persistence/bin directory

* Delete .classpath

* Delete .project

* changed python to python3 in README.md

* small changes to code source.py, bump the version, edited .gitignore

* edited spec.json with pattern for start_date

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
2021-06-08 12:46:35 +03:00
Dmytro
66d96967df 🎉 Containerize connector code generator (#3763) 2021-06-08 12:25:27 +03:00
Yevhenii
a90e5f0eca 🎉 New Source: Amplitude (#3664)
* New Amplitude Source: Full Refresh and Incremental Sync

* update api.py, add CHANGELOG.md file

* bump version

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
2021-06-08 10:36:31 +03:00
jacqueskpoty
8c9bf60bd8 updating integrations destinations local files doccs (#3910)
* updating integrations destinations local files doccs

* updating integrations destinations local files doccs

* Update docs/integrations/destinations/local-json.md

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>

* updating integrations destinations local files doccs

* updating integrations destinations local files doccs

* Update docs/integrations/destinations/local-csv.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/integrations/destinations/local-csv.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/integrations/destinations/local-csv.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/integrations/destinations/local-csv.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* updating integrations destinations local files doccs

Co-authored-by: jsewawilson <jwilson@pebblepost.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>
2021-06-07 21:34:35 -03:00
Sherif A. Nada
73c8dfa7e2 Add Harvest to summary.md 2021-06-07 09:16:11 -07:00
Christophe Duong
913c55df6b 🎉 Add dataset location to BigQuery connector (issue #3277) (#3889)
Authored-by: sabifranjo <sabifranjo@gmail.com>
Authored-by: Sabolc Franjo <sabolc.franjo@ev-box.com>
2021-06-07 15:33:47 +02:00
Vadym
e699f39740 🎉 New Source: Harvest (#3709)
* Add harvest source.
Add Clients, Contacts, Company, Invoices, InvoiceMessages, InvoicePayments streams full_refresh support.

* Add all Harvest source streams.
Add config and schema files for all the streams.

* Complete streams implementation.
Add config and schemas.

* Fix expenses stream calls.
Fix ExpensesBase request_params method.
Add source docs and definitions.

* Update harvest.md docs.

* Comment source_definitions.yaml harvest definition.

* Delete Harvest standard source definitions.

* Add Harvest creds to commands.

* Update Harvest build.gradle.

* Add extra report streams schemas.
Update config files.
Update incremental streams mixin.

* Fix HarvestStreamWithPaginationSliced stream_slices method for incremental stream support

* Remove source-acceptance-test test requirement

* * Fix schema.
* Update streams
* Update docs

* Update billable_rates and cost_rates to full_refresh only

* Fix HarvestStreamIncrementalMixin request_params method

* Fix BillableRates and CostRates streams initialization

* Refactor streams.py code common usages.
Update HarvestTokenAuthenticator class definition.

* Add streams docstring.
Fix sub streams slicing.
Update spec and schemas.
Update md docs.

* Update report streams to be support incremental sync.
Update report schemas.

* Removed Uninvoiced and ProjectBudget incremental sync support.
Fix configs and configured catalog.

* Fix streams cursor value.
Update IncrementalReportsBase request_params.
Update schemas and config.

* Add harvest source definitions.
2021-06-07 15:11:30 +03:00
John Lafleur
a7f8f76951 Update SUMMARY.md 2021-06-05 14:06:07 +11:00