Skip to content

feat(ee): add Pipeline.get_streams for NATS stream names (ETL-1188)#71

Merged
PabloPardoGarcia merged 1 commit into
pablo/etl-1186-add-ee-client-to-sdkfrom
pablo/etl-1188-sdk-add-method-to-get-pipeline-stream-names
Jun 16, 2026
Merged

feat(ee): add Pipeline.get_streams for NATS stream names (ETL-1188)#71
PabloPardoGarcia merged 1 commit into
pablo/etl-1186-add-ee-client-to-sdkfrom
pablo/etl-1188-sdk-add-method-to-get-pipeline-stream-names

Conversation

@PabloPardoGarcia

Copy link
Copy Markdown
Member

What

Implements ETL-1188: a method to fetch a pipeline's NATS JetStream stream names.

Stacked on #68 (ETL-1186) — base is pablo/etl-1186-add-ee-client-to-sdk. Enterprise-only, so it lives on ee.Pipeline.

from glassflow.ee import Client

streams = client.get_pipeline("my-pipeline").get_streams()
# [{"stream_name": "gfm-0b2b90de-DLQ", "component": "dlq"}, ...]

Details

  • ee.Pipeline.get_streams() wraps GET /api/v1/pipeline/{id}/streams and returns the streams as [{"stream_name": ..., "component": ...}] (component is the data-plane stage the stream belongs to: ingestor/join/sink/dedup/dlq). Useful for diagnosing NATS-level issues (unblocks ETL-1101, NATS MCP diagnostics).
  • 404PipelineNotFoundError; 403FeatureNotLicensedError.

Testing

259 passed, ruff clean. Unit tests cover success, 204/empty, 404, and the 403 mapping.

Verified live against staging: client.get_pipeline(...).get_streams() returns the streams for otlp-logs-staging / otlp-metrics-staging, and a missing pipeline raises PipelineNotFoundError.

🤖 Generated with Claude Code

Add ee.Pipeline.get_streams(), wrapping GET /api/v1/pipeline/{id}/streams. It
returns the pipeline's NATS JetStream streams as [{stream_name, component}],
useful for diagnosing NATS-level issues. 404 maps to PipelineNotFoundError and
403 to FeatureNotLicensedError. Enterprise-only, so it lives on ee.Pipeline.

Verified live against staging pipelines.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@PabloPardoGarcia PabloPardoGarcia merged commit 0ecd447 into pablo/etl-1186-add-ee-client-to-sdk Jun 16, 2026
@PabloPardoGarcia PabloPardoGarcia deleted the pablo/etl-1188-sdk-add-method-to-get-pipeline-stream-names branch June 16, 2026 14:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant