* authentication documentation
* some fixes
* fix broken link
* remove session token auth
* review comments
* first version of tutorial
* Revert "first version of tutorial"
This reverts commit bbdeb997f2.
* first version of tutorial
* review comments
* improvements
* partitioning documentation
* incremental sync
* review comments
* improvements
* record processing doc
* improvements
* error handler connector builder ui documentation
* add missing link
* overview page
* mention current limitation
---------
Co-authored-by: brianjlai <brian.lai@airbyte.io>
1.5 KiB
1.5 KiB
Connector Builder Backend
This is the backend for requests from the Connector Builder.
Local development
Locally running the Connector Builder backend
python main.py read --config path/to/config --catalog path/to/catalog
Note:
- Requires the keys
__injected_declarative_manifestand__commandin its config, where__injected_declarative_manifestis a JSON manifest and__commandis one of the commands handled by the ConnectorBuilderHandler (stream_read,list_streams, orresolve_manifest), i.e.
{
"config": <normal config>,
"__injected_declarative_manifest": {...},
"__command": <"resolve_manifest" | "list_streams" | "test_read">
}
*See ConnectionSpecification for details on the "config" key if needed.
- When the
__commandislist_streamsorresolve_manifest, the argument tocatalogshould be an empty string.
Locally running the docker image
Build
First, make sure you build the latest Docker image:
./gradlew airbyte-cdk:python:airbyteDocker
The docker image name and tag, respectively, are the values of the io.airbyte.name and io.airbyte.version LABELs in the Dockerfile.
Run
Then run any of the connector commands as follows:
docker run --rm -v $(pwd)/secrets:/secrets airbyte/source-declarative-manifest:dev read --config /secrets/config.json