jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-22 11:31:02 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,480 Commits 5,109 Branches 518 Tags
yarden/source-mongodb-support-dynamic-arrays
Commit Graph

31012 Commits

Author SHA1 Message Date
Sherif A. Nada
21116cad97 📚 add doc to describe how CDK handles schemas (#4537) 2021-07-06 15:58:27 -07:00
Abhi Vaidyanatha
3e3cf7b544 Fix broken link in Local CSV doc (#4578) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-07-06 11:24:26 -07:00
oleh.zorenko
84ba3e79b3 🎉 Native GitHub connector (#4174) 
* GitHub source initial version

All streams are in `full_refresh` mode only.

* Run format command

* Add handling for 404 error in Teams stream

* Update creds naming for github

* Update acceptance tests

* Update check_connection()

* Code review fixes

Remove `/integration_tests/catalog.json` file.
Use `Collaborators` class in `check_connection()` function.
Remove excessive data from GithubStream class.

* Remove unused import

* Implement requested changes

* Add incremental streams

* Remove `supports_incremental`

* Update docs

* Implement requested changes

* Implement requested changes

* Implement requested changes

* Bump connector version
 2021-07-06 17:06:34 +03:00
jaimefr
2efac85c1f add deprecation info for google adwords (#4561) 2021-07-06 09:27:04 -03:00
Yevhenii
94f1d217b8 🎉 Native Gitlab connector (#4027) 
* Create Airbyte-Native connector for Gitlab

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
 2021-07-06 15:25:01 +03:00
Davin Chia
dd41155cc2 Minor kube docs corrections. (#4563) 2021-07-06 17:52:08 +08:00
John Lafleur
a9bd334ed9 Update technical-content-writer.md 2021-07-06 10:03:00 +11:00
John Lafleur
de0593e32e Update senior-software-engineer.md 2021-07-06 10:02:49 +11:00
John Lafleur
541d33f724 Update recruiter.md 2021-07-06 10:02:35 +11:00
John Lafleur
310f4665f9 Update founding-developer-evangelist.md 2021-07-06 10:02:15 +11:00
John Lafleur
fb54cb491b Update README.md 2021-07-06 09:59:35 +11:00
Eugene Kulak
15c8f8a551 SAT: Add validation of data types in the output records #3253 (#4345) 
* validate that records match the schema from the catalog

Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
Co-authored-by: Vadym <vege1wgw@gmail.com>
 2021-07-05 17:45:39 -04:00
Mario Molina
5c7f886aa4 🎉 API: Add an endpoint to list workspaces (#4530) 2021-07-05 12:17:40 -07:00
Oleksandr
9517fae702 🎉 Source Shopify - change the default stream cursor_field to 'updated_at' where possible (#4472) 
#4472 - Source Shopify - change the default stream cursor_field to 'updated_at' where possible

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
 2021-07-05 15:42:35 +03:00
LiRen Tu
3d3988b1e3 Destination MySQL: bump version (#4531) 
* Bump mysql destination version to pick up normalization

* Also change the publish command to run on ec2-runners to try and avoid build errors with gradle unable to find the right volume.

Co-authored-by: Davin Chia <davinchia@gmail.com>
 2021-07-04 21:54:01 +08:00
LiRen Tu
2caf3904f0 🎉 MySQL destination: normalization (#4163) 
* Add mysql dbt package

* Add mysql normalization support in java

* Add mysql normalization support in python

* Fix unit tests

* Update readme

* Setup mysql container in integration test

* Add macros

* Depend on dbt-mysql from git repo

* Remove mysql limitation test

* Test normalization

* Revert protocol format change

* Fix mysel json macros

* Fix two more macros

* Fix table name length

* Fix array macro

* Fix equality test macro

* Update replace-identifiers

* Add more identifiers to replace

* Fix unnest macro

* Fix equality macro

* Check in mysql test output

* Update column limit test for mysql

* Escape parentheses

* Remove unnecessary mysql test

* Remove mysql output for easier code review

* Remove unnecessary mysql test

* Remove parentheses

* Update dependencies

* Skip mysql instead of manually write out types

* Bump version

* Check in unit test for mysql name transformer

* Fix type conversion

* Use json_value to extract scalar json fields

* Move dbt-mysql to Dockerfile (#4459)

* Format code

* Check in mysql dbt output

* Remove unnecessary quote

* Update mysql equality test to match 0.19.0

* Check in schema_test update

* Update readme

* Bump base normalization version

* Update document

Co-authored-by: Christophe Duong <christophe.duong@gmail.com>
 2021-07-03 20:30:59 -07:00
Vadym
9531c4d4ec 🎉 New source: airbyte-native twilio connector (#4070) 
* Add Twilio CDK source

* Implement all streams full refresh support.

* Complete all streams and configs.

* Apply code format

* Fix streams data response.
Update streams which should not be incremental.
Fix configs.

* Fix incremental streams.
Fix configs.

* Fix acceptance tests config.

* Fix stream schemas.

* Fix messages stream schema.

* Catalogs fixed

* Update setup requirements.

* Add standard CI creds

* Update build.gradle and sample config files to remove unused references

* Updated sample config files json format

* Update streams.py

* Update incremental streams cursor_field formatting

* Update streams and test config

* Add no_empty_streams_no_usage_records_catalog.json

* Update streams code style.
Add twilio.md docs.
Other PR style fixes.

* Update twilio.md docs.

* Odd docstring removed.

* Uncomment tests.

* Add Docker AIRBYTE_ENTRYPOINT
 2021-07-03 20:59:38 +03:00
Abhi Vaidyanatha
637d939d67 Update upgrading Airbyte with the new workflow and move it to Operator Guides (#4517) 
* Move Upgrading Airbyte to Operator Guides now that issues will be less common

* Formatting changes

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-07-02 17:12:09 -07:00
Abhi Vaidyanatha
6fb2bd3401 Move deploying section above Operator guides (#4511) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-07-02 16:18:52 -07:00
Abhi Vaidyanatha
8332f61715 Move reset guide to Operator guides (#4510) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-07-02 16:12:10 -07:00
Abhi Vaidyanatha
d725aa9fbe Add standalone getting started guides structure. (#4492) 
* Add standalone getting started guides.

* Add GitHub source

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-07-02 13:49:26 -07:00
Sherif A. Nada
9079cbdf78 Publish PR (#4121) (#4495) 
Co-authored-by: Rodrigo Parra <rodpar07@gmail.com>
 2021-07-02 13:34:57 -07:00
Rodrigo Parra
4b0c3494ae 🎉 Source Shopify: Add support for draft orders (#4121) 2021-07-02 13:33:47 -07:00
Abhi Vaidyanatha
3b2009723e Add note about collocating Redshift cluster and Airbyte server in the same security group (#4490) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-07-02 12:42:35 -07:00
Abhi Vaidyanatha
d985fe73f4 Add note about rate limits with the HubSpot API (#4491) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-07-01 23:04:35 -07:00
Abhi Vaidyanatha
5d56d00f1a Add 7-1-2021 Slack release summary (#4482) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-07-01 19:01:55 -07:00
Sherif A. Nada
9708e4c8de 🐛 bugfix Source Okta: Fix endless loop while syncing data from logs stream (#4464) 
Co-authored-by: sabifranjo <sabifranjo@gmail.com>
Co-authored-by: Sabolc Franjo <sabolc.franjo@ev-box.com>
 2021-07-01 17:39:51 -07:00
Abhi Vaidyanatha
885da9b27a Make experience required more vague for Tech Writer job. (#4480) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-07-01 15:44:01 -07:00
Abhi Vaidyanatha
0963c27578 Add changelog summaries for the last 3 updates on main changelog doc. (#4479) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-07-02 09:22:20 +11:00
Abhi Vaidyanatha
7f8e2c22a2 Add platform changelog for 0.27.0 (#4477) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-07-01 14:55:56 -07:00
Abhi Vaidyanatha
aa5066081c Add 7/1/2021 connector changelog (#4476) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-07-01 14:49:37 -07:00
Abhi Vaidyanatha
b94d2eb4c4 Fix pubsub description YAML frontmatter (#4475) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-07-01 14:32:02 -07:00
Eugene
4399656ec9 🎉 Source Cockroachdb: Added new source for Cockroachdb (#4382) 
* [1705] Added cockroachdb source connector
 2021-07-01 22:04:21 +03:00
Subodh Kant Chaturvedi
586eeb70c2 minor fix to upgrade airbyte doc (#4467) 2021-07-01 22:44:21 +05:30
Yevhenii
83ac92b212 Source Facebook Marketing: update cursor_field for Ads Insights Streams (#4437) 
* Big Fix: updated_time is an attribute of ad in FB ad insights call

Co-authored-by: harshithmullapudi <harshithmullapudi@gmail.com>
Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
 2021-07-01 17:50:29 +03:00
Subodh Kant Chaturvedi
097c9548c0 Doc for Automatic Upgrade of Airbyte (#4453) 
* Revert "manual airbyte upgrade doc (#4435)"

This reverts commit dedab30a93.

* update doc

* upgrade version
 2021-07-01 18:31:34 +05:30
Subodh Kant Chaturvedi
7de4bbf13c Bump version: 0.26.4-alpha → 0.27.0-alpha (#4458) 2021-07-01 18:06:51 +05:30
Christophe Duong
8b6093ce61 Configure kube pod resources for workers/syncs (#4381) 
* Configure kube pod resources for workers/syncs
 2021-07-01 12:25:14 +02:00
John Lafleur
f3acd45b44 Update SUMMARY.md 2021-07-01 13:38:23 +11:00
John Lafleur
681452a8d8 Update recruiter.md 2021-07-01 13:37:54 +11:00
John Lafleur
1aed32433e Update and rename code-of-conduct.md to slack-code-of-conduct.md (#4450) 
* Update and rename code-of-conduct.md to slack-code-of-conduct.md

* Update SUMMARY.md
 2021-07-01 13:32:30 +11:00
Abhi Vaidyanatha
da36e22272 Add missing Sources and Destinations to Catalog Table. (#4423) 
* Add missing Sources and Destinations to Catalog Table.

* Add Snowflake Source.

* Address review comments

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-06-30 13:27:26 -07:00
Charles
335f5edef8 copy seed configurations from config/init to server (#4417) 
Co-authored-by: subodh <subodh1810@gmail.com>
 2021-06-30 10:38:19 -07:00
Subodh Kant Chaturvedi
dedab30a93 manual airbyte upgrade doc (#4435) 2021-06-30 23:02:57 +05:30
Abhi Vaidyanatha
9138e58bf1 Add CentOS 8 setup guide. (#4421) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-06-29 20:48:44 -07:00
Davin Chia
52bd5c96f0 🎉 Add Minio support to Kube. (#4365) 
Implement logging to and reading from Minio. Use the same S3 client for this.

Configure Airbyte Kube Prod and Staging to use Minio by default, so Airbyte Kube is a standalone deployment.

Also update documentation to reflect this.
 2021-06-30 09:42:50 +08:00
Marcos Marx
398bf6674a Documentation: Slack issue template (#4337) 
* slack issue template docs

* abhi comments and add section items
 2021-06-29 19:47:55 -03:00
Abhi Vaidyanatha
60be058c11 Add note about repeated rows when attempting incremental append syncs with unchanged data (#4309) 
* Add incremental append note about syncs with unchanged data

* Update SQL statement to illustrate how incremental append could work.

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-06-29 15:32:29 -07:00
Abhi Vaidyanatha
33a80deb0a Fix broken links in docs. (#4419) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-06-29 14:51:46 -07:00
Sherif Nada
0a0a3b97fe fix gitbook formatting in tutorial 2021-06-29 14:49:00 -07:00