e931c2add7
### TL;DR Make destination-snowflake pass all tests ### What changed? - Updated CDK version to 0.45.0 - Reduced JUnit method execution timeout to 20 minutes - Improved error handling in SnowflakeDestination's main function - Enhanced error message for invalid permissions in integration test - Implemented a more robust cleanup process for Airbyte internal tables and schemas - Removed unused Batch and LocalFileBatch classes - Not in the PR: I also deleted about 5k tables and 2k schemas, which were making our tests run slower than necessary. The cleanup logic will automate those cleanups. ### How to test? 1. Run integration tests for the Snowflake destination connector 2. Verify that the new error message is displayed when testing with invalid permissions 3. Check that the cleanup process removes old tables and schemas as expected 4. Ensure that all existing functionality remains intact ### Why make this change? These changes aim to improve the reliability and maintainability of the Snowflake destination connector. The updated CDK version and reduced test timeout should lead to faster and more efficient testing. The enhanced error handling and cleanup processes will help in identifying issues more quickly and keeping the test environment clean. Removing unused classes reduces code clutter and improves overall code quality.
import ConnectorRegistry from '@site/src/components/ConnectorRegistry';
Connector Catalog
Introduction to Connectors
Each source or destination is a connector. A source is an API, file, database, or data warehouse that you want to ingest data from. A destination is a data warehouse, data lake, database, or an analytics tool where you want to load your ingested data. Connectors, therefore, can either pull data from a source, or push data to a destination.
By browsing the catalog, you can see useful links to documentation, source code, and issues related to each connector. You'll also be able to see whether a connector is supported on our Open Source Software (OSS), our Cloud platform, or both.
As an open source project, Airbyte's catalog of connectors is continually growing thanks to community contributions as well as development by the Airbyte team. Airbyte enables you to build new connectors. We encourage you to consider contributing enhancements, bug fixes, or features to existing connectors or to submit entirely new connectors you've built for inclusion in the connector catalog. That said, you always have the option to publish connectors privately, to your own workspaces.
Learn more about contributing to Airbyte here.
Connector Support Levels
Airbyte uses a tiered system for connectors to help you understand what to expect from a connector. In short, there are three tiers: Airbyte Connectors, Marketplace Connectors, and Custom Connectors. Review the documentation on connector support levels for details on each tier.
View the connector registries in full