Skip to content

Conversation

@leekeiabstraction
Copy link
Contributor

Purpose

Linked issue: close #183

Wire up KvWriteBatch within Sender

Tested using example Kv table in: PR181

@leekeiabstraction leekeiabstraction changed the title Sender wiring KvWriteBatch wiring in Sender Jan 20, 2026
@leekeiabstraction
Copy link
Contributor Author

@luoyuxia @fresh-borzoni Would appreciate review here.

Found this gap when running the kv table example

Copy link
Contributor

@luoyuxia luoyuxia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@leekeiabstraction Thanks for the pr. LGTM overall. Could you please add IT for put kv so that the ci can cover it to avoid unexpected code breaks put kv.

@leekeiabstraction
Copy link
Contributor Author

@luoyuxia ack on integration test.

There's still one more bug I'm chasing down on lookup side before writing the integ test. Will raise the PRs when I'm done fixing that lookup bug

Copy link
Contributor

@fresh-borzoni fresh-borzoni left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@leekeiabstraction Thanks for PR!
Left comment, PTAL

@leekeiabstraction
Copy link
Contributor Author

@fresh-borzoni @luoyuxia Appreciate the review. Addressed your comments. PTAL

) -> Result<WriteRequest> {
let first_batch = &request_batches.first().unwrap().write_batch;

let request = match first_batch {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we symmetrically validate ArrowLog as well?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah, I see, It's a bit hidden invariant at work, I think we may assume that all the batches by table_id are of the same type, so first batch is fine here.

Copy link
Contributor

@fresh-borzoni fresh-borzoni left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@leekeiabstraction Thanks for addressing, looks solid.
Left comment about ArrowLog, but as I see Java does the same.

table_id,
table_buckets,
records_by_bucket,
response,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cool macro, but i wonder if this can become an async trait

@luoyuxia luoyuxia merged commit b4fad4b into apache:main Jan 21, 2026
13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

KvWriteBatch wiring in Sender

4 participants