1
0
mirror of synced 2026-01-08 03:06:34 -05:00
Files
airbyte/docs/cloud/managing-airbyte-cloud/manage-schema-changes.md
Sophia Wiley 3ba5a3c644 Docs: streams table (#24326)
* Added updated text

* edits

* edits to text

* removed header

* edited links

* edited some text

* added new gifs to doc

* typo fixes

* Update docs/cloud/managing-airbyte-cloud/edit-stream-configuration.md

Co-authored-by: Andy Jih <andyjih@users.noreply.github.com>

* Update docs/cloud/managing-airbyte-cloud/edit-stream-configuration.md

Co-authored-by: Andy Jih <andyjih@users.noreply.github.com>

* Update edit-stream-configuration.md

* Update docs/cloud/managing-airbyte-cloud/edit-stream-configuration.md

Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

* Update edit-stream-configuration.md

edited based on Edmundo's suggestions

---------

Co-authored-by: Andy Jih <andyjih@users.noreply.github.com>
Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>
2023-03-28 18:35:14 +02:00

2.7 KiB
Raw Blame History

Manage schema changes

Once every 24 hours, Airbyte checks for changes in your source schema and allows you to review the changes and fix breaking changes. This process helps ensure accurate and efficient data syncs, minimizing errors and saving you time and effort in managing your data pipelines.

:::note

Schema changes are flagged in your connection but are not propagated to your destination.

:::

Review non-breaking schema changes

To review non-breaking schema changes:

  1. On the Airbyte Cloud dashboard, click Connections and select the connection with non-breaking changes (indicated by a yellow exclamation mark icon).

  2. Click Review changes.

  3. The Refreshed source schema dialog displays the changes.

  4. Review the changes and click OK to close the dialog.

  5. Scroll to the bottom of the page and click Save changes.

:::note

By default, Airbyte ignores non-breaking changes and continues syncing. You can configure how Airbyte handles syncs when it detects non-breaking changes by editing the stream configuration.

:::

Fix breaking schema changes

:::note

Breaking changes can only occur in the Cursor or Primary key fields.

:::

To review and fix breaking schema changes:

  1. On the Airbyte Cloud dashboard, click Connections and select the connection with breaking changes (indicated by a red exclamation mark icon).

  2. Click Review changes.

  3. The Refreshed source schema dialog displays the changes.

  4. Review the changes and click OK to close the dialog.

  5. In the streams table, the stream with a breaking change is highlighted.

  6. Fix the breaking change by selecting a new Cursor or Primary key.

  7. Scroll to the bottom of the page and click Save changes.

:::note

If a connections source schema has breaking changes, it will stop syncing. You must review and fix the changes before editing the connection or resuming syncs.

:::

Manually refresh the source schema

In addition to Airbyte Clouds automatic schema change detection, you can manually refresh the source schema to stay up to date with changes in your schema.

To manually refresh the source schema:

  1. On the Airbyte Cloud dashboard, click Connections and then click the connection you want to refresh.

  2. Click the Replication tab.

  3. In the Activate the streams you want to sync table, click Refresh source schema to fetch the schema of your data source.

  4. If there are changes to the schema, you can review them in the Refreshed source schema dialog.