Skip to content

feat/updates for sift stream flow descriptor in sift stream bindings#405

Closed
tsift wants to merge 3 commits into
mainfrom
dev/updates-for-sift-stream-flow-descriptor-in-sift-stream-bindings
Closed

feat/updates for sift stream flow descriptor in sift stream bindings#405
tsift wants to merge 3 commits into
mainfrom
dev/updates-for-sift-stream-flow-descriptor-in-sift-stream-bindings

Conversation

@tsift
Copy link
Copy Markdown
Contributor

@tsift tsift commented Nov 25, 2025

Updates sift-stream to internally use the FlowDescriptor instead of holding onto the FlowConfig after sending to Sift.

  • Since the mapping to update the vector in the IngestWithConfigDataStreamRequest is now persistent, performance for message_to_ingest_req actually improves a good amount, and even becoming more performant than message_to_ingest_req_direct at larger numbers of channels in the request.

Updates to the sift-stream bindings and related Python client code to support the following APIs in sift-stream:

  • The FlowDescriptor and related FlowBuilder to provide a more efficient method to generate ingestion requests.
  • The send_requests_nonblocking which removes async related overhead.

This also removes the "get_config_flows" APIs, instead preferring users to use the FlowDescriptorPy instead.

@tsift tsift requested a review from nathan-sift November 25, 2025 22:23
@tsift tsift force-pushed the dev/updates-for-sift-stream-flow-descriptor-in-sift-stream-bindings branch from 8983a32 to 2302f6d Compare November 25, 2025 23:09
@tsift tsift closed this Nov 26, 2025
@tsift tsift deleted the dev/updates-for-sift-stream-flow-descriptor-in-sift-stream-bindings branch November 26, 2025 13:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant