1
0
mirror of synced 2025-12-21 11:01:41 -05:00
Commit Graph

31012 Commits

Author SHA1 Message Date
Jared Rhizor
ecf73c941a add cancellation api endpoint (#2530)
* cancel api

* fix tests

* fix builder

* fix bug
2021-03-22 17:47:08 -07:00
Sherif A. Nada
04f2725564 remove gradle commands from python tutorial (#2555) 2021-03-22 13:24:56 -07:00
Sherif A. Nada
a004a85e03 Update connector health page (#2558) 2021-03-22 13:24:30 -07:00
Matt Broberg
451df3aedd Rename founding-developer-evangelist.md to developer-advocate.md (#2554)
I was about to share this posting with some DevRel friends when I saw the title of the page. To those doing the work, advocacy != evangelism. Evangelism (mostly led by MSFT) has shifted in focus on sales orgs, so I believe posting a job where the URL suggests it may have started in that category may lead to confusion in the expectations of an applicant.
2021-03-22 12:11:58 -07:00
Yevhenii
e3c9853b2e 🎉 New Source: Gitlab (#2518)
* #2305 Issue: Gitlab connector implement

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
2021-03-22 15:36:04 +02:00
Eugene K
0b9b038ca4 🎉 New source: Native Hubspot connector (#2215)
* #2150 Issue: created native connector with schema folder populated

* #2150 Issue: make format code

* first version

* fix few issues

* fix issues

* fix read issue

* format

* docs

* docker tags

* extend configured catalog for testing

* fix source definitions

* format

* fix call rate issue, add backoff for retry after

* add general backoff

* write secrets for new connector

* drop singer connector registration

* refactor streams, resolve properties in schemas at runtime

* replace deprecated endpoint for company contacts

* replace deprecated pipeline endpoint

* update comments

* update docs

* fix typo

* fix stream contact lists

* fix pagination and forms result fetching

* fix health_check

* format and update catalog

* revert changes

* drop singer based hubspot

* fix company contacts substream

* move deals to separate test

* fix deals tests

* remove dynamic fields from records

* move deals to catalog again

* extend CRMObjectStream with associations

* format

* update schemas with updated field, change engagement layout

* fix Campaign stream

* remove custom tests

* remove dependency

* remove oauth

* Source Hubspot: add incremental streams (#2425)

* add incremental

* add incremental

* polishing

* update docs

* fix docstring

* clean up

* fix incremental bookmark access

* fix incremental tests

* clean up

* add custom test for incremental, improve logging

* format

* Update airbyte-integrations/connectors/source-hubspot/source_hubspot/api.py

Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Source Hubspot: best practices (#2537)

* fix error reporting and add unit tests

* fix test and refactor cursor fields

* format

Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>

* restored configured_catalog.json

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-03-20 06:18:55 -03:00
Charles
a928e6e299 for synchronous jobs, remove dependency on scheduler and "job" infrastructure (#2385) 2021-03-18 14:08:18 -07:00
Davin Chia
b96911bfb6 Fix Postgres tutorial bug. (#2511)
* Fix command bug.

* Add hint to explain for destination table name.
2021-03-18 19:14:11 +08:00
Charles
9d2d4738b9 Bump version: 0.17.1-alpha → 0.17.2-alpha (#2504) 2021-03-17 12:53:09 -07:00
Sherif A. Nada
e3cb042f33 📖 Better document the generic language template 2021-03-17 12:47:57 -07:00
John Lafleur
6c8d110831 Update platform.md 2021-03-17 11:05:42 +11:00
John Lafleur
b88722955f Update connectors.md 2021-03-17 10:53:14 +11:00
Christophe Duong
f98cbfddbe Bump version: 0.17.0-alpha → 0.17.1-alpha (#2487) 2021-03-16 19:13:49 +01:00
Yevhenii
6477f31467 Source Twilo: update tap-twilio library, docs (#2458)
* update tap-twilio library, update docs and README.md, remove standardtest folder

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
2021-03-16 13:52:24 +02:00
Davin Chia
556d0a6239 Point API documentation link to nicer UI source. (#2455)
What:
Swagger UI has bad-UI and extensibility. It's not intuitive and often displays information badly (especially for more complicated structs), which leads to initial API confusion.

How:
Switch over to use Rapidoc. This is our new api docs!

Created the airbyte-public-api-docs bucket and uploaded our new html docs. Set up a CloudFront distribution to enable HTTPS.

A copy of our html docs is checked in in this PR. As you can see, this is a minimal file that relies on a React component published by Rapidoc. It is pointed to the api docs in our master branch and will automatically update itself; do not expect us to need to touch this api file unless we want to make display changes.

I consolidated all files involving api documentation into the docs/api folder for simplicity. I also moved the generated html file to the generated-api-html folder within the api folder to make it clear it was generated. Finally, added a README to document our set up.

Benefits:

UI is much cleaner.
We control the html source file, which means it'll be easier for us to make changes in the future.
2021-03-15 13:24:58 +08:00
John Lafleur
07a3b6a60f Update strategy.md (#2448) 2021-03-15 11:18:33 +11:00
John Lafleur
828f742546 Create operations-manager.md (#2450)
* Create operations-manager.md

* Update SUMMARY.md

* Update docs/career-and-open-positions/operations-manager.md

Co-authored-by: Davin Chia <davinchia@gmail.com>

* Update docs/career-and-open-positions/operations-manager.md

Co-authored-by: Davin Chia <davinchia@gmail.com>

* Update docs/career-and-open-positions/operations-manager.md

Co-authored-by: Jared Rhizor <jared@dataline.io>

Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: Jared Rhizor <jared@dataline.io>
2021-03-13 11:51:16 +11:00
Davin Chia
c086ff2c83 Slight UI fixes. (#2427)
Fix a broken link and some bad text. 
Remove out of date documentation.
2021-03-13 08:44:26 +08:00
Yevhenii
2b0f8d556f #1814 Issue: Implement Instagram connector (#2226)
* #2166 Issue: create Instagram connector and implement all relevant streams as full refresh

* #2166 Issue: add Insights streams

* #2273 Issue: add Incremental for streams

* #2273 Issue: code clean up

* update code after review

* add check on error for Story Insight

* add comments to code

* Source Instagram: adopt best practices, add docs, pull data from all IG business accounts (#2373)

* #2276 Issue: adopt best practices, add separate integration test for Insight's streams, create docs, update version of SDK library

* #2304 Issue: pull data from all IG business accounts

* add BASE_DIRECTORY to integration_test.py

* format configured_catalog(s)

* add credentials variables

* implement separated incremental states for different account_id, update docs

* Update instagram.md

* simplify state format

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* add sample_config.json file

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-03-12 15:49:16 -03:00
Christophe Duong
fd0ec92209 update docs (#2411) 2021-03-12 10:01:34 +01:00
Davin Chia
6abc1cf4ad Hotfix: Tutorial formatting. 2021-03-12 14:57:03 +08:00
Davin Chia
4fdad6c9fc Release Airbyte Tutorial. (#2433)
Take the change to alphabeticise the tutorials list.
2021-03-12 14:54:53 +08:00
Michel Tricot
99732a290b Fix Compare with Documentation (#2432) 2021-03-11 22:46:04 -08:00
Sherif A. Nada
ca2211a20c Improve Google Directory docs (#2428) 2021-03-11 22:17:50 -08:00
Marcos Marx
8f40fed71d Initial Airflow Airbyte tutorial (#2191)
original contributor: Marcos Marx
2021-03-12 09:11:33 +08:00
Sherif A. Nada
c8879a156b Add google directory docs to summary.md 2021-03-11 16:03:06 -08:00
Samuel Gordalina
73044ac290 Add create & delete workspaces to API (#2325) 2021-03-11 15:49:37 -08:00
vitaliizazmic
393e8fad25 New Source: Google Directory
* Google directory source #2110 - creating new source

* Google Directory #2110 - implementing new source

* Google directory #2110 - handling rate limit

* Google Directory #2110 - handling errors and rate limits

* Google Directory #2110 - reformat

* Google Directory #2110 - adding CI credentials

* Google Directory #2110 - adding to the source definition registry

* Google Directory #2110 - adding to the source definition registry(fix)

* Google Directory #2110 - injecting the config into the build environment

* Update google-directory.md

* Update google-directory.md

* Google directory #2110 - rename max_results to results_per_page and increase it to 100, fixing setup.py

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-03-12 00:59:45 +02:00
Jared Rhizor
010aae96b2 add docker daemon not running issue to faq (#2379) 2021-03-11 10:30:58 -08:00
Christophe Duong
b1e911e255 Back-end support destination sync modes #2370 (#2375)
* Add new fields for destination_sync_modes
2021-03-10 20:01:12 +01:00
Davin Chia
cb002141e2 Issue 1983: Expose latest connector version. (#2323)
Expose the latest connector version to users for better connector UX experience. The airbyte webapp currently displays the docker tag. Users can specify a custom tag to use within using the same cell. However, users do not know what the latest connector image tag is without manually checking the Airbyte github or change log. These changes will provide an endpoint for the webapp to retrieve the relevant information.

The main change is adding a list_latest endpoint to the SourceDefinition and DestinationDefinition resources. Some minor refactors here and there for code readability and maintenance. Note, we use Github as a source of truth for the latest master list.

See this google document to better understand the thought behind this: https://docs.google.com/document/d/1CeqSw9ooWDZP0yvVSmi28DgIHrlW97Tlbm9lIDSzipQ/edit
2021-03-10 11:06:42 +08:00
Sherif A. Nada
05698de749 Fix typo in developing-locally.md 2021-03-09 16:39:54 -08:00
Anthony Hillairet
b3fbc02746 Add troubleshooting in local development (#2344) 2021-03-09 16:39:23 -08:00
Davin Chia
53a5d97358 Minor Gradle Property Tweaks. (#2367)
Expose the workers.max property in gradle.properties. This allows a dev to set the number of processors Gradle uses per their needs. See this.

Also take the chance to turn on vfs.watch. This allows Gradle to watch the virtual file system it creates in memory. In theory, this makes it slightly faster for incremental builds. See this.
2021-03-10 07:18:04 +08:00
Davin Chia
80984d0634 Document command to only build core Airbyte systems. (#2351) 2021-03-09 08:39:20 +08:00
Sherif A. Nada
59f6c6d217 MongoDB touchups (#2363) 2021-03-08 14:44:05 -08:00
Yury Koleda
b1061e32d9 🎉 Add MongoDB Source
Signed-off-by: fut <fut.wrk@gmail.com>
2021-03-08 14:27:14 -08:00
Christophe Duong
e3cbb4e8ba Rename defaultNamespace to prefix and make it optional (#2350) 2021-03-08 20:08:34 +01:00
Christophe Duong
20dec48385 ☝🏼Add new namespaceDefault field in connection page to destination stream name (as a prefix to the table name) (#2298)
Introducing a new Mapper class to transform the stream name between source and destination 

Co-authored-by: Artem Astapenko <3767150+Jamakase@users.noreply.github.com>
Co-authored-by: Charles <giardina.charles@gmail.com>
2021-03-05 12:54:55 +01:00
John Lafleur
20ed2d2572 Update business-model.md 2021-03-05 17:51:21 +11:00
Jared Rhizor
558c034614 stop building and bumping kube until we have temporal (#2315)
* stop building kube until we have temporal on kube

* freeze kube version
2021-03-04 17:39:53 -08:00
John Lafleur
84eb4e3c83 Added Davin to the team (#2300)
* Added Davin to the team

* Update docs/company-handbook/team.md

Co-authored-by: Michel Tricot <michel@dataline.io>

Co-authored-by: Michel Tricot <michel@dataline.io>
2021-03-04 17:38:21 +11:00
John Lafleur
f4e3304409 Update build-a-slack-activity-dashboard.md 2021-03-04 06:42:42 +11:00
vitaliizazmic
9d0d560f73 🎉 Source Google Analytics: Support chunked syncs to avoid sampling (#2151)
* Installing singer tap from fork instead PyPi

* Bump version to 0.1.9

* Add Google Analytics quotas and limits to docs
2021-03-03 21:32:23 +02:00
Christophe Duong
f7ada7c811 Fix docs formatting (#2282) 2021-03-03 17:45:07 +01:00
Davin Chia
72a65f6d07 Correct tutorial bullet points wrongly edited by Gitbook. (#2275)
- List correct link to tutorial page.
- Correct bad Gitbook changes.

reviewer: Chris
2021-03-03 18:49:29 +08:00
Davin Chia
2ac9d36b26 Update Airbyte local preq documentation. Remove outdated Gitbook section. (#2274)
- Add some missing prerequisites for Airbyte local development.
- Remove the Gitbook section on updating documentation. Gitbook's editor does funky autoformatting.

reviewer: Chris
2021-03-03 18:23:20 +08:00
Michel Tricot
bb801c22eb Attempt to fix code checkout (#2272) 2021-03-02 20:43:13 -08:00
Michel Tricot
c8f433574a GitBook: [master] 6 pages modified 2021-03-03 04:35:05 +00:00
John Lafleur
cb91ab7771 Update build-a-slack-activity-dashboard.md 2021-03-03 12:24:30 +11:00