Skip to content

Net 685 assignment#59

Open
toschoosqd wants to merge 4 commits into
masterfrom
net-685-assignment-id
Open

Net 685 assignment#59
toschoosqd wants to merge 4 commits into
masterfrom
net-685-assignment-id

Conversation

@toschoosqd

@toschoosqd toschoosqd commented Jun 25, 2026

Copy link
Copy Markdown
Contributor

Summary

Implements the worker-side part of NET-685 behind the mvcc-chunks feature flag.

Workers now track when the current assignment has been fully applied and include last_applied_assignment_id in heartbeats once all required chunks are available and pending removals/downloads are complete.

Notes

  • last_applied_assignment_id is an opaque String.
  • Worker does not parse, compare, or order assignment IDs.
  • Assignment ordering remains scheduler-owned under NET-686.
  • While running, workers apply assignments in arrival order. If more than 5 assignments are queued, queued intermediate assignments are skipped and the worker advances to the newest pending assignment; the assignment currently being applied is never interrupted.
  • The previously applied assignment intentionally remains reported while a newer assignment is still being applied.
  • Requires the sqd-network proto change that adds last_applied_assignment_id to Heartbeat.

Validation

@toschoosqd toschoosqd self-assigned this Jun 25, 2026
@toschoosqd toschoosqd requested a review from define-null June 25, 2026 11:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant