Airflow Airbyte Plugin Demo Example
Running the Script
Simply run up.sh to bring up the Airbyte and Airflow containers. You don't need to worry about cleaning up the containers, as we run a docker-compose down -v before attempting to recreate them.
After Airbyte starts running, head over to http://localhost:8000 and set up a connection. The script will then prompt you for an Airbyte connection id. You can find this in the URL after clicking on your connection.
Simple enter that ID into your terminal and a connection will be set up in Airflow for you. Head over to http://localhost:8085 to access the Airflow UI. Enter airflow as your username and airflow as your password. You should see your DAG show up in the UI with no errors if your connection was configured correctly.
Trigger the DAG with the switch in the top right and you should be in business! If it doesn't automatically run, just hit the play button in the top right to kick off the sync.
Cleaning Up
Run down.sh to clean up the containers. Or run docker-compose down -v here and in the root directory, your call.