b7113a2e5e
* handwritten low code manifest example components * add MinMaxDatetime to jsonschema * add a basic gradle command to generate manifest components * Add auth components to handwritten component schema - ApiKeyAuthenticator - BasicHttpAuthenticator - BearerAuthenticator - DeclarativeOauth2Authenticator - NoAuth * Respect optional properties in DeclarativeOauth2Authenticator * Fix `Dict[str, Any]` mapping in auth components * add default error handler composite error handler and http response filter components * [low code component schema] adding backoff strategies to schema * [low code component schema] fix float types * [low code component schema] add RecordFilter * Remove `config` from auth components * [low code component schema] add Interpolation (with pending question on 'type' not being defined) * Add CartesianProductStreamSlicer & DatetimeStreamSlicer * Add ListStreamSlicer, and fix nesting of DatetimeStreamSlicer * [low code component schema] add InterpolatedRequestOptionsProvider * Add slicer components, and fix a couple of components after reviewing output * [low code component schema] adding transformations and adding type to interpolators * adding spec and a few small tweaks * Add DefaultSchemaLoader * [low code component schema] attempt on custom class * Add descriptions for auth components * add RequestOption * remove interpolated objects from the schema in favor of strings only * a few schema fixes and adding some custom pagination and stream slicer * [low code component schema] fix CustomBackoffStrategy * Add CustomRecordExtractor * add some description and add additional properties * insert a transformer to hydrate default manifest components and perform validation against the handwritten schema * [low code component schema] validating existing schemas * [low code component schema] clean validation script * add manifest transformer tests and a few tweaks to the schema * Revert "[low code component schema] clean validation script" This reverts commit2408f41cf6. * Revert "[low code component schema] validating existing schemas" This reverts commit9d39977815. * [low code component schema] integrate validation script to gradle * [low code component schema] updating validation script permissions * remove a few model gen spike files and clean up comments * default types should take parent type into account and a few schema changes * add inline schema components and fix validation bugs * add types to every component's literal enum and more little schema fixes * missing component prefix * pr feedback, renaming the schema and updating various docs * fixing schema bugs from testing and new components * last few small tweaks and fixes and fix the script * bump the version before publsih * include the declarative_component_schema.yaml as package data so its included when package is published * roll the version to publish Co-authored-by: Catherine Noll <noll.catherine@gmail.com> Co-authored-by: maxi297 <maxime@airbyte.io>
33 lines
818 B
Bash
Executable File
33 lines
818 B
Bash
Executable File
#!/usr/bin/env bash
|
|
|
|
[ -z "$ROOT_DIR" ] && exit 1
|
|
|
|
CONNECTORS_DIR=$ROOT_DIR/airbyte-integrations/connectors
|
|
CDK_DIR=$ROOT_DIR/airbyte-cdk/python/
|
|
|
|
for directory in $CONNECTORS_DIR/source-* ; do
|
|
MANIFEST_DIRECTORY=$(basename $directory | tr - _)
|
|
SOURCE_NAME=${MANIFEST_DIRECTORY#source_}
|
|
if test -f "$directory/source_$SOURCE_NAME/$SOURCE_NAME.yaml"; then
|
|
cd $directory
|
|
|
|
rm -rf .venv
|
|
python -m venv .venv
|
|
source .venv/bin/activate
|
|
pip install -r requirements.txt > /dev/null 2>&1
|
|
pip install -e ".[tests]" > /dev/null 2>&1
|
|
pip install -e $CDK_DIR > /dev/null 2>&1
|
|
|
|
python main.py spec > /dev/null 2>&1
|
|
ret=$?
|
|
if [ $ret -ne 0 ]; then
|
|
echo "----Error for source $SOURCE_NAME"
|
|
else
|
|
echo "Source $SOURCE_NAME is fine"
|
|
fi
|
|
|
|
deactivate
|
|
cd ..
|
|
fi
|
|
done
|