52798f0dca
* chore: freshly generated source-kyve * chore: added source files * chore: added unit_tests * chore: added integration_tests * fix: fixed acceptance-tests * chore: add additional metadata * chore: add metadata.yaml * doc: update changelog in docs * fix: changelog and specs.yaml * fix: unit tests * doc: update README * fix unit tests v2 * update acceptance test script & skip discover and incremental tests * chore: Update in metadata the definitionId * fix: Address review issues - Fixed Dockefile and changelog version to 0.1.0 - Added order property on spec.yaml - AdditionalProperties to the proper objects in schema definitions and made all fields nullable * format * fix doc url * Add tags to metadata --------- Co-authored-by: fabianriewe <fabian@kyve.network> Co-authored-by: cgkournelos-rf <cgkournelos@rocketfueldev.com> Co-authored-by: Kostas Christopoulos <kostas@withplum.com> Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
1.5 KiB
Kyve Source
This page contains the setup guide and reference information for the KYVE source connector.
The KYVE Data Pipeline enables easy import of KYVE data into any data warehouse or destination
supported by Airbyte. With the ELT format, data analysts and engineers can now confidently source KYVE data without worrying about its validity or reliability.
For information about how to setup an end to end pipeline with this connector, see the documentation.
Source configuration setup
-
In order to create an ELT pipeline with KYVE source you should specify the
Pool-IDof Kyve storage pool from which you want to retrieve data. -
You can specify a specific
Bundle-Start-IDin case you want to narrow the records that will be retrieved from the pool. You can find the valid bundles of in the KYVE app (e.g. Moonbeam pool bundles).
Multiple pools
You can fetch with one source configuration more than one pool simultaneously. You just need to specify the Pool-IDs and the Bundle-Start-ID for the KYVE storage pool you want to archive separated with comma.
Changelog
| Version | Date | Pull Request | Subject |
|---|---|---|---|
| 0.1.0 | 25-05-29 | 26299 | Initial release of KYVE source connector |