Skip to content

feat: expose snapshot load metrics in order to detect if log truncation was applied or not#7

Draft
cdobre wants to merge 2 commits intomainfrom
log-size-limiter-metrics
Draft

feat: expose snapshot load metrics in order to detect if log truncation was applied or not#7
cdobre wants to merge 2 commits intomainfrom
log-size-limiter-metrics

Conversation

@cdobre
Copy link
Collaborator

@cdobre cdobre commented Feb 16, 2026

Description

There is no existing mechanism to detect if a table which was configured with a LogSizeLimiter policy has been actually truncated or not. The clients can see if the configuration contains LogSizeLimiter settings but not if the truncation actually happened.

This adds a new set of metrics on Snapshot structure which can be used by client to see if the truncation was applied and the effect of that truncation:

  • snapshot.load_metrics.log_size_limiter_applied - boolean flag indicating that the limiting was applied during load
  • snapshot.num_commits_discarded : usize - number of commits discarded during truncation
  • both the original size and the truncated size of the log

@github-actions
Copy link

ACTION NEEDED

delta-rs follows the Conventional Commits specification for release automation.

The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification.

@cdobre cdobre marked this pull request as draft February 16, 2026 22:53
@cdobre cdobre changed the title [DRAFT] feat: Expose snapshot load metrics in order to detect if log truncation was applied or not feat: Expose snapshot load metrics in order to detect if log truncation was applied or not Feb 16, 2026
@ccciudatu ccciudatu force-pushed the main branch 2 times, most recently from b238c0b to 2f04aab Compare February 18, 2026 00:08
@mihai-bleont
Copy link
Collaborator

I think this needs a rebase, it also contains Andrei's commit

@cdobre cdobre force-pushed the log-size-limiter-metrics branch from bc17a57 to ccadfd9 Compare February 19, 2026 19:27
@cdobre cdobre force-pushed the log-size-limiter-metrics branch from 24481ae to cc5585c Compare February 19, 2026 19:44
@cdobre cdobre changed the title feat: Expose snapshot load metrics in order to detect if log truncation was applied or not feat: expose snapshot load metrics in order to detect if log truncation was applied or not Feb 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Comments