compute: columnar arrange input (C1)#37748
Draft
antiguru wants to merge 1 commit into
Draft
Conversation
Generalize `ensure_collections` and `arrange_collection` to accept a `CollectionEdge` instead of a `VecCollection`, so the arrange input path no longer decodes a columnar edge through `ColumnarToVec`. The columnar arm forms the arrangement key by iterating the borrowed column with `into_index_iter`, mirroring the proven `flat_map_datums` pattern, and never materializes an owned `Row`. The Vec arm is unchanged. The passthrough output preserves the input variant. Temporal bucketing (node C8) still consumes and produces a `Vec` edge, so the decode moves into that branch as a sanctioned leaf seam. Producers still emit `Vec`, so the columnar arm is dead in production and this change carries no runtime behavior change. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Remove these sections if your commit already has a good description!
Motivation
Why does this change exist? Link to a GitHub issue, design doc, Slack
thread, or explain the problem in a sentence or two. A reviewer who has
no context should understand why after reading this section.
If this implements or addresses an existing issue, it's enough to link to that:
Closes
Fixes
etc.
Description
What does this PR actually do? Focus on the approach and any non-obvious
decisions. The diff shows the code --- use this space to explain what the
diff can't tell a reviewer.
Verification
How do you know this change is correct? Describe new or existing automated
tests, or manual steps you took.