jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-01-06 06:04:16 -05:00
Code Issues Packages Projects Releases Wiki Activity

restore images

Browse Source
This commit is contained in:
Michel Tricot
2020-12-13 22:33:50 -08:00
parent 2be56158b9
commit 3c048aa14e
8 changed files with 50 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

12
docs/tutorials/airbyte-config-persistence.md
View File

@@ -151,8 +151,12 @@ docker cp airbyte-server:/data $TUTORIAL_DIR/my-setup
Head back to [http://localhost:8000/](http://localhost:8000/) and add more connectors. Here is an example of configuration from an API source:
![](../.gitbook/assets/airbyte_config_persistence_1.png)
and a local file destination:
![](../.gitbook/assets/airbyte_config_persistence_2.png)
## Run a Sync job
* once the source and destination are created
@@ -160,6 +164,8 @@ and a local file destination:
* then run the "Sync Now" button
* finally inspect logs in the UI
![](../.gitbook/assets/airbyte_config_persistence_3.png)
## Exploring Logs folders
We can read from the lines reported in the logs the working directory that is being used to run the synchronization process from.
@@ -356,10 +362,16 @@ Here are some examples of public API CSV:
https://storage.googleapis.com/covid19-open-data/v2/latest/epidemiology.csv
```
![](../.gitbook/assets/airbyte_config_persistence_4.png)
And a local Postgres Database:
![](../.gitbook/assets/airbyte_config_persistence_5.png)
After setting up the connectors, we can trigger the sync and study the logs:
![](../.gitbook/assets/airbyte_config_persistence_6.png)
Since we wiped the workspace volume and restarted the Airbyte Server, notice that the process ran in the `/tmp/workspace/5/0` as well but the logs for ExchangeRate are gone...
## Export and customize Normalization step with DBT

8
docs/tutorials/getting-started.md
View File

@@ -24,10 +24,14 @@ Once you see an Airbyte banner, the UI is ready to go at [http://localhost:8000/
You should see an onboarding page. Enter your email if you want updates about Airbyte and continue.
![](../.gitbook/assets/airbyte_get-started.png)
## 2. Set up your first connection
Now you will see a wizard that allows you choose the data you want to send through Airbyte.
![](../.gitbook/assets/02_set-up-sources.png)
As of our alpha launch, we have one database source \(Postgres\) and two API sources \(an exchange rate API and the Stripe API\). We're currently building an integration framework that makes it easy to create sources and destinations, so you should expect many more soon. Please reach out to us if you need a specific connector or would like to help build one.
For now, we will start out with a Postgres source and destination.
@@ -72,12 +76,16 @@ DB Name: postgres
After adding the destination, you can choose what tables and columns you want to sync.
![](../.gitbook/assets/03_set-up-connection.png)
For this demo, we recommend leaving the defaults and selecting "Every 5 Minutes" as the frequency. Click `Set Up Connection` to finish setting up the sync.
## 3. Check the logs of your first sync
You should now see a list of sources with the source you just added. Click on it to find more information about your connection. This is the page where you can update any settings about this source and how it syncs. There should be a `Completed` job under the history section. If you click on that run, it will show logs from that run.
![](../.gitbook/assets/04_source-details.png)
One of biggest problems we've seen in tools like Fivetran is the lack of visibility when debugging. In Airbyte, allowing full log access and the ability to debug and fix connector problems is one of our highest priorities. We'll be working hard to make these logs accessible and understandable.
## 4. Check if the syncing actually worked