Skip to content

Chore!: Optimize snapshot unpausing#5147

Merged
izeigerman merged 3 commits intomainfrom
chore-optimize-snapshpt-unpause
Aug 14, 2025
Merged

Chore!: Optimize snapshot unpausing#5147
izeigerman merged 3 commits intomainfrom
chore-optimize-snapshpt-unpause

Conversation

@izeigerman
Copy link
Collaborator

With introduction of the dev-only VDE mode, all snapshots that share the name also share the version. This means that fetching all snapshots with the same version may no longer be feasible, as it could result in retrieving the entire state in extreme cases.

This update optimizes the snapshot unpausing operation eliminating the need to fetch snapshots with shared versions. There were a few changes in the past that allow us to simplify the current implementation substantially:

  • Deprecation of the Airflow support means that we no longer need to align the unpaused timestamp by the interval unit
  • Interval compaction for garbage-collected snapshots means we no longer track intervals for individual snapshots, so there is no need to accurately reflect the effective-from timestamp in the state. Please note the effective-from timestamp is still considered when merging intervals for individual snapshots.

@izeigerman izeigerman requested a review from a team August 13, 2025 16:16
@izeigerman izeigerman force-pushed the chore-optimize-snapshpt-unpause branch from f902a1e to a1a285c Compare August 13, 2025 17:08
@izeigerman izeigerman merged commit ded6795 into main Aug 14, 2025
25 of 32 checks passed
@izeigerman izeigerman deleted the chore-optimize-snapshpt-unpause branch August 14, 2025 16:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants