3 Commits

Author	SHA1	Message	Date
Maxime Carbonneau-Leclerc	91a56171a0	[ISSUE #26343] update close_slice to use the greater record (#27818) ... * [ISSUE #26343] update close_slice to use the greater record * Renaming parameter for close_slice * code review	2023-06-29 10:09:12 -04:00
Maxime Carbonneau-Leclerc	a013fad5a9	[ISSUE-26343] data feed (#27475) ... * [ISSUE #26581] per partition cursor * [ISSUE #26581] format * [ISSUE #26581] clean up state management * [ISSUE #26581] improving Hashabledict * [ISSUE #26581] format cdk * [ISSUE #26581] fix tests * [ISSUE #26581] code review from girarda * Retrigger pipeline * Decouple cursor and stream slicer and pushing state management as far up cursor as possible * Format cdk * Small fixes/comments * DatetimeBasedCursor should not update state based on slice (for now at least since it wasn't doing this before) * [ISSUE #26581] code review * Automated Commit - Formatting Changes * [ISSUE #26581] validation overlapping keys * [ISSUE #26581] add typing * [ISSUE #26581] code review * Remove SyncMode from stream_slices * Removing SyncMode from stream_slices up until SimpleRetriever and fixing typing * [ISSUE-26434] replacing Record primitive by class * [ISSUE-26434] update Cursor.update_state to use new record object * Issue 26343/data feed incremental sync solution 2 (#27481) * TMP [ISSUE-26434] first solution to enable stop condition on pagination * TMP [ISSUE-26434] second solution to enable stop condition on pagination * TMP [ISSUE-26434] second solution fix * [ISSUE #26343] fixing behavior and adding tests * [ISSUE #26343] only updating state once a slice to allow for data feed * [ISSUE #26343] removing freezing of cursor * format cdk * [ISSUE #26343] ensure data_feed doesn't have end_datetime * [ISSUE #26343] self review * [ISSUE #26343] code review * [ISSUE #26343] code review clean up * [ISSUE #26343] code review clean up * Code review * [ISSUE #26343] add warn log message in DatetimeBasedCursor * format * Format	2023-06-28 16:53:00 -04:00
Maxime Carbonneau-Leclerc	a45a1e3341	Maxi297/refactoring declarative state management (#27445) ... * [ISSUE #26581] per partition cursor * [ISSUE #26581] format * [ISSUE #26581] clean up state management * [ISSUE #26581] improving Hashabledict * [ISSUE #26581] format cdk * [ISSUE #26581] fix tests * [ISSUE #26581] code review from girarda * Retrigger pipeline * Decouple cursor and stream slicer and pushing state management as far up cursor as possible * Format cdk * Small fixes/comments * DatetimeBasedCursor should not update state based on slice (for now at least since it wasn't doing this before) * [ISSUE #26581] code review * Automated Commit - Formatting Changes * [ISSUE #26581] validation overlapping keys * [ISSUE #26581] add typing * [ISSUE #26581] code review * Remove SyncMode from stream_slices * Removing SyncMode from stream_slices up until SimpleRetriever and fixing typing * format cdk	2023-06-22 12:54:36 -04:00