1
0
mirror of synced 2026-01-03 06:02:23 -05:00
Files
airbyte/airbyte-integrations/connectors/source-jdbc
Duy Nguyen f92d833d8d [Source-Postgres] Switch over to user-defined-cursor after CTID initial sync (#27809)
* Separated Standard vs Xmin categorization
Added StandardCtidUtilsTest
Added versions to StandardStatus

* WIP incremental read test

* Added PostgresStandardStateManager to write state_type key to stream state
Added sync to verify state messages and cursor records on running multiple syncs of the same streams

* Isolate tables used for ctid test and enable checkpointing records to 1 for just CTID test

* Moved ctid cursor test to its own file CtidEnabledPostgresSourceTest

* Gracefully handle case where there is no statetype
Update all "standard" to "cursorBased"
2023-07-11 19:30:40 -05:00
..
2020-10-30 10:47:43 -07:00
2020-10-30 10:47:43 -07:00

JDBC Source

We are not planning to expose this source in the UI yet. It serves as a base upon which we can build all of our other JDBC-compliant sources.

The reasons we are not exposing this source by itself are:

  1. It is not terribly user-friendly (jdbc urls are hard for a human to parse)
  2. Each JDBC-compliant db, we need to make sure the appropriate drivers are installed on the image. We don't want to frontload installing all possible drivers, and instead would like to be more methodical. Instead for each JDBC-compliant source, we will extend this one and then install only the necessary JDBC drivers on that source's image.