Skip to content

feat(pipeline) Redesign orchestrator pipeline#110

Merged
behinddwalls merged 3 commits into
mainfrom
manjari/queue-reset
Mar 3, 2026
Merged

feat(pipeline) Redesign orchestrator pipeline#110
behinddwalls merged 3 commits into
mainfrom
manjari/queue-reset

Conversation

@manjari25
Copy link
Copy Markdown
Contributor

@manjari25 manjari25 commented Mar 2, 2026

Summary

feat(pipeline) Redesign orchestrator pipeline

New orchestator pipeline set up in this PR as described in the table below -

Controller Subscribes From Publishes To Entity In Entity Out
request request validate Request Request
validate validate batch Request Request
batch batch score Request Batch
score score speculate Batch Batch
speculate speculate build, merge Batch Batch
build build buildsignal Batch Build
buildsignal buildsignal speculate Build Batch
merge merge conclude, speculate Batch Batch
conclude conclude Batch

What?

  • Redesign the orchestrator queue pipeline as described in the table above
  • Add 3 new pipeline stage controllers: validate (request validation and merge checks), score
    (batch scoring before speculation) and conclude (pipeline finalization)
  • Rename 2 controllers: mergesignal, and finalize
  • Update existing controllers (batch, build, merge, speculate, buildsignal) to operate on proper domain entities
    (e.g., build controller now consumes Batch and produces Build instead of passing Request through)
  • Move merge conflict check from request controller to validate controller
  • Add Build.ToBytes()/BuildFromBytes() serialization for queue transport of build entities
  • Rename topic keys in TopicRegistry to match the new stage names
  • Log message updates to indicate which exact pipeline a controller is publishing to
  • Register new controllers in orchestrator server

Why?

  • This scaffolds the orchestrator pipeline and sets up controllers needed to process a land request.

Test Plan

Unit tests added and updated.

Issues

@manjari25 manjari25 force-pushed the manjari/queue-reset branch from 98eba22 to ba0d8ee Compare March 2, 2026 21:56
@manjari25 manjari25 force-pushed the manjari/queue-reset branch from ba0d8ee to 13a87c4 Compare March 2, 2026 22:49
@manjari25 manjari25 marked this pull request as ready for review March 2, 2026 22:58
@manjari25 manjari25 requested review from a team, behinddwalls and sbalabanov as code owners March 2, 2026 22:58
@manjari25 manjari25 changed the title feat(pipeline) Orchestrator pipeline re-set up feat(pipeline) Redesign orchestrator pipeline Mar 2, 2026
Comment thread orchestrator/controller/poll/poll.go Outdated
@manjari25 manjari25 requested a review from behinddwalls March 3, 2026 00:49
@behinddwalls behinddwalls added this pull request to the merge queue Mar 3, 2026
Merged via the queue into main with commit cbfab8d Mar 3, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants