Skip to content

Complementary tool: OTel-GenAI trace export + behavioral-regression gate for OM1 (Plumbline) #7

Description

@kaushikb11

Hi — I maintain Plumbline, a zero-touch record/replay + behavioral-CI layer for OM1, and OM1-telemetry looks like its natural neighbor: you own latency/observability; Plumbline adds the decision-level signal latency can't see.

Concretely, on a real OM1 episode, appending one governance sentence flipped every Cortex decision from move forwards to move back — while mean model latency was unchanged (644.6ms → 644.6ms). A latency/telemetry view stays green while the robot drives backwards. Write-up: docs/results-experiment-b-om1.md.

Plumbline's traces are OTel-GenAI-aligned (they load in Tempo/Phoenix/Langfuse), so there's a clean surface: export recorded seam spans into OM1-telemetry's pipeline, and/or surface a behavioral-drift panel next to the latency ones.

Would an integration like this be in scope? Happy to contribute an exporter or a small adapter. Broader context + feedback thread: OpenMind/OM1#2652

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions