mirror of synced 2026-01-08 03:06:34 -05:00

Files

Davin Chia 8a0d12fc80 Add migrations to support progress bar. (#19191 )

Follow up to #18953.

Implement all the DB migrations required for a progress bar.

The main change here is to support saving:

the estimated records/bytes at the sync level
the estimated records/bytes and emitted records/bytes at the stream level
After this, I'll put up a PR for the persistence layer changes, which will writing to and reading from these columns.

Finally, I'll wire this into the API changes, which are currently stubs.

- add the estimated_records and estimated_bytes columns to the SyncStats table.
- create a stream_stats table
  - estimated and emitted records/bytes column
  - contains attempt_id and stream_name columns. Unique constraints on these two columns.
  - foreign key to the attempt_id table.
  - this table hopefully sets us up for the parallel sync work.

2022-11-10 22:35:15 -08:00

src

Add migrations to support progress bar. (#19191 )

2022-11-10 22:35:15 -08:00

build.gradle

Update to latest Temporal SDK release (#18492 )

2022-10-26 12:54:00 -04:00

Dockerfile

Bump Airbyte version from 0.40.17 to 0.40.18 (#18827 )

2022-11-01 19:35:23 -07:00

gradle.properties

Remove shared getDockerBuildTask to enable parallel docker builds (#16384 )

2022-09-09 18:40:35 -07:00

readme.md

Add readmes to all modules (#8893 )

2022-03-13 14:45:36 -07:00

readme.md

airbyte-bootloader

This application runs at start up for Airbyte. It is responsible for making sure that the environment is upgraded and in a good state. e.g. It makes sure the database has been migrated to the correct version.

Entrypoint

BootloaderApp.java - has the main method for running the bootloader.