refactor(rocq-pipeline): use span-based telemetry in `rocq-pipeline` to align with `pydantic-ai` by jhaag-skylabs-ai · Pull Request #283 · SkyLabsAI/rocq-agent-toolkit

jhaag-skylabs-ai · 2026-03-04T23:34:06Z

Background

Closing Conditions

Engineering

Testing

validate that TraceCursor spans+attributes:
- appear in Tempo
- are correctly interleaved w/pydantic-ai spans+attributes
~~(internal) validate backwards compatibility w/released docker image~~
- ==> deferred until later (cf. below)

Interleaving of `TracingCursor`+`pydantic-ai` spans

User Stories

~~devs can write a lightweight script that reads data from the backend and produces structured objects that reuse the TraceCursor schema type~~
- ==> deferred until later (cf. below)
devs can add new fields to schemas in a forwards compatible way & typechecking/runtime testing can validate forwards-compatibility w.r.t explicitly enumerate semantic version ranges

Scope/Triage Follow Up Work

Ensure GH issues track:

deferred work (cf. foldables for reasoning)
- (1a) update dashboard/backend to reuse (2) instead of reimplementing types
  ==> cf. [dashboard] incremental migration to span-based telemetry for RocqCursor #319
  reasons:
  - possible to tackle work in small/separable follow-up PRs
  - if we want to fully remove the codepaths that utilize structured logging for telemetry -- instead of maintaining backwards-compatibility logic -- we'll need to make atomic changes across multiple & align with a docker image re-release
- (1b) devs can write a lightweight script that reads data from the backend and produces structured objects that reuse the TraceCursor schema type
  ==> cf. this issue
  reasons:
  - blocked by (1a)
- (2; internal) validate backwards compatibility w/released docker image
  reasons:
  - current `rocq-remote-agent` code is broken on `everything@main` (cf. https://github.com/Validate the wire-protocol for the remote agent #313)
updates to planned work

jhaag-skylabs-ai · 2026-03-06T14:31:13Z

`pydantic`-Based Schemas

# Note: see if opentelemetry adds anything like this (or `OtelJsonValue`)
class OtelAttrs(BaseModel):
    # for now: generic (se)rialization, utils for otel spans, etc...
    # maybe later: `.ts` code autogen

    # repo-level protocol:
    # - register otel schema classes
    # - maintain `.schema/` folder that lives at the root of the repo in which the derived `class` appears
    # - CI task that fails if schema string changes at all, forcing user to run a task that:
    #   - bumps semantic version
    #   - serializes new schema file
    # - TESTING: use schemas to produce hypothesis values against which we test parsing behavior
    #   for "new" versions of the schema
    def json_schema(cls) -> str:
        """Versioned JSON schema string"""

    def __le__(self, other) -> bool:
        # "Am I schema-compliant with other.json_schema()?"
        # Note: we actually care to check whether the parsing logic works correctly, not only that
        # the schema is subsumed
       

# Codify forwards compatible interface
class TraceCursorSpanAttrs(OtelAttrs):
    ...

    # mappings from attr names to types
    # version info
    # helpers for accessing telemetry data
    # distinguish:
    # - optional fields
    # - early-error fields

Notes:

consider writing APIs in terms of Spans
we may be able to use pydantic/logfire here, but that will likely require some deeper changes to our observability module; if we remain aligned w/key logfire APIs then we retain flexibility to port the implementation later

Current telemetry from `TraceCursor._trace_log`

args (always): serialized method args
action (optional): Rocq command being run
- notes:
  - currently not used, trace methods implicitly embed the command as an argument (cf. above discussion)
  - Gregory: everything gets a before_id, but things only get after_id if they modify the document state
- proposal:
  - uniformly use this for any operation that results in a non-ghost "command" being added to the document
before (before exception): whole dict of locinfo containing:
- "goal" (verbose): goal string
- "id": checksum of goal string
results (before exception):
- error: whether or not we got an rdm_api.Err
- result: function return
- result_type: type of function return
- note: maybe this can be simplified/replaced with generic (de)serialization logic (cf. parent rat_utils PR)
after (before exception; optional): whole dict of locinfo containing:
- "goal" (verbose): goal string
- "id": checksum of goal string
delta: cursor index delta, but currently a dead code path ==> remove and ask Areeb if it's OK
exception: note opentelemetry spans have special handling for exceptions

(De)serialization <-> `opentelemetry`

Note: cf. pydantic/logfire

Ideas:

accumulate partial attrs into TraceCursorSpanAttrs during execution and then dump late (i.e. in a finally block)
use .-separate names to embed dictionaries as namespaced attrs; provide utils (in terms of jmespath) to deserialize, filter, etc...

# TODOs:
# - add as generic helper, e.g. `rocq-agent-toolkit-utils/.../opentelemetry.py`
# - Note: may need some special handling for:
#   - optional fields
#   - early return w/partial results (i.e. error span)
def opentelemetry_serialize_attrs(data) -> dict[str, OtelAttrValue]:
    # 1) model_dump
    # 2) for each k,v: if v not (sequence of) simple types, replace with `json.dumps(v)`

def opentelemetry_deserialize_attrs[TY: BaseModel](**attrs: OtelAttrValue) -> TY:
    pass

skylabs-ai-ci · 2026-03-11T19:23:01Z

CI summary (Details)

Active Repos

Repo	Job Branch	Job Commit	Base branch	Base commit	PR
fmdeps/rocq-agent-toolkit/	rocq-pipeline/TraceCursor/span_telemetry	094d0c6	main	25a72b9	#283

Passive Repos

Repo	Job Branch	Job Commit
./	main	512d576
fmdeps/BRiCk/	main	b79c734
fmdeps/auto/	main	bf28ddb
fmdeps/auto-docs/	main	9f57097
bluerock/NOVA/	skylabs-proof	996d600
bluerock/bhv/	skylabs-main	8d08b1c
fmdeps/brick-libcpp/	main	d30c178
fmdeps/ci/	main	4f94f40
vendored/elpi/	skylabs-master	aa4475f
fmdeps/fm-ci/	main	262fb04
fmdeps/fm-tools/	main	430933c
psi/protos/	main	8fe3e7c
psi/backend/	main	095ccb3
psi/ide/	main	6b596cf
psi/data/	main	8f526f2
vendored/rocq/	skylabs-master	2ede3c9
vendored/rocq-elpi/	skylabs-master	103a742
vendored/rocq-equations/	skylabs-main	a8c4832
vendored/rocq-ext-lib/	skylabs-master	94a6630
vendored/rocq-iris/	skylabs-master	3ad4ddd
vendored/rocq-lsp/	skylabs-main	a8b7272
vendored/rocq-stdlib/	skylabs-master	bc07423
vendored/rocq-stdpp/	skylabs-master	e01d802
fmdeps/skylabs-fm/	main	7d620c1
vendored/vsrocq/	skylabs-main	5b4527e

Performance

Relative	Master	MR	Change	Filename
+0.00%	122915.6	122915.6	+0.0	total
+0.00%	22632.7	22632.7	+0.0	├ translation units
+0.00%	100282.9	100282.9	+0.0	└ proofs and tests

Full Results

Relative	Master	MR	Change	Filename

+0.00%	122915.6	122915.6	+0.0	total
+0.00%	22632.7	22632.7	+0.0	├ translation units
+0.00%	100282.9	100282.9	+0.0	└ proofs and tests

skylabs-ai-ci · 2026-03-11T21:57:08Z

CI summary (Details)

Active Repos

Repo	Job Branch	Job Commit	Base branch	Base commit	PR
fmdeps/rocq-agent-toolkit/	rocq-pipeline/TraceCursor/span_telemetry	db35a19	main	3973c4b	#283

Passive Repos

Repo	Job Branch	Job Commit
./	main	5d7832c
fmdeps/BRiCk/	main	b79c734
fmdeps/auto/	main	bf28ddb
fmdeps/auto-docs/	main	9f57097
bluerock/NOVA/	skylabs-proof	996d600
bluerock/bhv/	skylabs-main	8d08b1c
fmdeps/brick-libcpp/	main	d30c178
fmdeps/ci/	main	4f94f40
vendored/elpi/	skylabs-master	aa4475f
fmdeps/fm-ci/	main	262fb04
fmdeps/fm-tools/	main	430933c
psi/protos/	main	8fe3e7c
psi/backend/	main	095ccb3
psi/ide/	main	6b596cf
psi/data/	main	8f526f2
vendored/rocq/	skylabs-master	2ede3c9
vendored/rocq-elpi/	skylabs-master	103a742
vendored/rocq-equations/	skylabs-main	a8c4832
vendored/rocq-ext-lib/	skylabs-master	94a6630
vendored/rocq-iris/	skylabs-master	3ad4ddd
vendored/rocq-lsp/	skylabs-main	a8b7272
vendored/rocq-stdlib/	skylabs-master	bc07423
vendored/rocq-stdpp/	skylabs-master	e01d802
fmdeps/skylabs-fm/	main	7d620c1
vendored/vsrocq/	skylabs-main	5b4527e

Performance

Relative	Master	MR	Change	Filename
+0.00%	122915.6	122915.6	+0.0	total
+0.00%	22632.7	22632.7	+0.0	├ translation units
+0.00%	100282.9	100282.9	+0.0	└ proofs and tests

Full Results

Relative	Master	MR	Change	Filename

+0.00%	122915.6	122915.6	+0.0	total
+0.00%	22632.7	22632.7	+0.0	├ translation units
+0.00%	100282.9	100282.9	+0.0	└ proofs and tests

skylabs-ai-ci · 2026-03-13T21:44:11Z

CI summary (Details)

Active Repos

Repo	Job Branch	Job Commit	Base branch	Base commit	PR
fmdeps/rocq-agent-toolkit/	rocq-pipeline/TraceCursor/span_telemetry	2bd9a5b	main	3319008	#283

Passive Repos

Repo	Job Branch	Job Commit
./	main	5d7832c
fmdeps/BRiCk/	main	b79c734
fmdeps/auto/	main	3d3296b
fmdeps/auto-docs/	main	9f57097
bluerock/NOVA/	skylabs-proof	996d600
bluerock/bhv/	skylabs-main	8d08b1c
fmdeps/brick-libcpp/	main	d30c178
fmdeps/ci/	main	50a318d
vendored/elpi/	skylabs-master	aa4475f
fmdeps/fm-ci/	main	262fb04
fmdeps/fm-tools/	main	e17f6db
psi/protos/	main	8fe3e7c
psi/backend/	main	8c98fb8
psi/ide/	main	6b596cf
psi/data/	main	1c11c15
vendored/rocq/	skylabs-master	2ede3c9
vendored/rocq-elpi/	skylabs-master	103a742
vendored/rocq-equations/	skylabs-main	a8c4832
vendored/rocq-ext-lib/	skylabs-master	94a6630
vendored/rocq-iris/	skylabs-master	3ad4ddd
vendored/rocq-lsp/	skylabs-main	a8b7272
vendored/rocq-stdlib/	skylabs-master	bc07423
vendored/rocq-stdpp/	skylabs-master	e01d802
fmdeps/skylabs-fm/	main	35a479c
vendored/vsrocq/	skylabs-main	5b4527e

Performance

Relative	Master	MR	Change	Filename
+0.00%	122925.1	122925.1	+0.0	total
+0.00%	22632.7	22632.7	+0.0	├ translation units
+0.00%	100292.4	100292.4	+0.0	└ proofs and tests

Full Results

Relative	Master	MR	Change	Filename

+0.00%	122925.1	122925.1	+0.0	total
+0.00%	22632.7	22632.7	+0.0	├ translation units
+0.00%	100292.4	100292.4	+0.0	└ proofs and tests

skylabs-ai-ci · 2026-03-15T19:10:12Z

CI summary (Details)

Active Repos

Repo	Job Branch	Job Commit	Base branch	Base commit	PR
fmdeps/rocq-agent-toolkit/	rocq-pipeline/TraceCursor/span_telemetry	d2daf4d	main	bb19f90	#283

Passive Repos

Repo	Job Branch	Job Commit
./	main	5d7832c
fmdeps/BRiCk/	main	b79c734
fmdeps/auto/	main	3d3296b
fmdeps/auto-docs/	main	9f57097
bluerock/NOVA/	skylabs-proof	996d600
bluerock/bhv/	skylabs-main	8d08b1c
fmdeps/brick-libcpp/	main	d30c178
fmdeps/ci/	main	50a318d
vendored/elpi/	skylabs-master	aa4475f
fmdeps/fm-ci/	main	262fb04
fmdeps/fm-tools/	main	e17f6db
psi/protos/	main	8fe3e7c
psi/backend/	main	8c98fb8
psi/ide/	main	6b596cf
psi/data/	main	1c11c15
vendored/rocq/	skylabs-master	2ede3c9
vendored/rocq-elpi/	skylabs-master	103a742
vendored/rocq-equations/	skylabs-main	a8c4832
vendored/rocq-ext-lib/	skylabs-master	94a6630
vendored/rocq-iris/	skylabs-master	3ad4ddd
vendored/rocq-lsp/	skylabs-main	a8b7272
vendored/rocq-stdlib/	skylabs-master	bc07423
vendored/rocq-stdpp/	skylabs-master	e01d802
fmdeps/skylabs-fm/	main	35a479c
vendored/vsrocq/	skylabs-main	5b4527e

Performance

Relative	Master	MR	Change	Filename
-0.00%	122925.1	122925.1	-0.0	total
-0.00%	22632.7	22632.7	-0.0	├ translation units
+0.00%	100292.4	100292.4	+0.0	└ proofs and tests

Full Results

Relative	Master	MR	Change	Filename

-0.00%	122925.1	122925.1	-0.0	total
-0.00%	22632.7	22632.7	-0.0	├ translation units
+0.00%	100292.4	100292.4	+0.0	└ proofs and tests

skylabs-ai-ci · 2026-03-17T22:23:34Z

CI summary (Details)

Active Repos

Repo	Job Branch	Job Commit	Base branch	Base commit	PR
fmdeps/rocq-agent-toolkit/	rocq-pipeline/TraceCursor/span_telemetry	96d0205	main	3df25fa	#283

Passive Repos

Repo	Job Branch	Job Commit
./	main	5d7832c
fmdeps/BRiCk/	main	9c981fb
fmdeps/auto/	main	df70339
fmdeps/auto-docs/	main	9f57097
bluerock/NOVA/	skylabs-proof	996d600
bluerock/bhv/	skylabs-main	8d08b1c
fmdeps/brick-libcpp/	main	d30c178
fmdeps/ci/	main	50a318d
vendored/elpi/	skylabs-master	aa4475f
fmdeps/fm-ci/	main	262fb04
fmdeps/fm-tools/	main	e17f6db
psi/protos/	main	8fe3e7c
psi/backend/	main	48b986b
psi/ide/	main	6b596cf
psi/data/	main	1c11c15
vendored/rocq/	skylabs-master	2ede3c9
vendored/rocq-elpi/	skylabs-master	103a742
vendored/rocq-equations/	skylabs-main	a8c4832
vendored/rocq-ext-lib/	skylabs-master	94a6630
vendored/rocq-iris/	skylabs-master	3ad4ddd
vendored/rocq-lsp/	skylabs-main	a8b7272
vendored/rocq-stdlib/	skylabs-master	bc07423
vendored/rocq-stdpp/	skylabs-master	e01d802
fmdeps/skylabs-fm/	main	35a479c
vendored/vsrocq/	skylabs-main	5b4527e

Performance

Relative	Master	MR	Change	Filename
-0.00%	122979.0	122978.9	-0.0	total
-0.00%	22626.8	22626.8	-0.0	├ translation units
+0.00%	100352.2	100352.2	+0.0	└ proofs and tests

Full Results

Relative	Master	MR	Change	Filename

-0.00%	122979.0	122978.9	-0.0	total
-0.00%	22626.8	22626.8	-0.0	├ translation units
+0.00%	100352.2	100352.2	+0.0	└ proofs and tests

skylabs-ai-ci · 2026-03-20T07:15:35Z

CI summary (Details)

Active Repos

Repo	Job Branch	Job Commit	Base branch	Base commit	PR
fmdeps/rocq-agent-toolkit/	rocq-pipeline/TraceCursor/span_telemetry	b9b7a0e	main	8d8785f	#283

Passive Repos

Repo	Job Branch	Job Commit
./	main	5d7832c
fmdeps/BRiCk/	main	9c981fb
fmdeps/auto/	main	e8d7396
fmdeps/auto-docs/	main	9f57097
bluerock/NOVA/	skylabs-proof	996d600
bluerock/bhv/	skylabs-main	8030a8f
fmdeps/brick-libcpp/	main	d30c178
fmdeps/ci/	main	50a318d
vendored/elpi/	skylabs-master	aa4475f
fmdeps/fm-ci/	main	262fb04
fmdeps/fm-tools/	main	e17f6db
psi/protos/	main	8fe3e7c
psi/backend/	main	48b986b
psi/ide/	main	6b596cf
psi/data/	main	1c11c15
vendored/rocq/	skylabs-master	2ede3c9
vendored/rocq-elpi/	skylabs-master	103a742
vendored/rocq-equations/	skylabs-main	a8c4832
vendored/rocq-ext-lib/	skylabs-master	94a6630
vendored/rocq-iris/	skylabs-master	3ad4ddd
vendored/rocq-lsp/	skylabs-main	a8b7272
vendored/rocq-stdlib/	skylabs-master	bc07423
vendored/rocq-stdpp/	skylabs-master	e01d802
fmdeps/skylabs-fm/	main	35a479c
vendored/vsrocq/	skylabs-main	5b4527e

Performance

Relative	Master	MR	Change	Filename
+0.00%	122981.3	122981.3	+0.0	total
+0.00%	22626.8	22626.8	+0.0	├ translation units
+0.00%	100354.5	100354.5	+0.0	└ proofs and tests

Full Results

Relative	Master	MR	Change	Filename

+0.00%	122981.3	122981.3	+0.0	total
+0.00%	22626.8	22626.8	+0.0	├ translation units
+0.00%	100354.5	100354.5	+0.0	└ proofs and tests

skylabs-ai-ci · 2026-03-23T16:25:19Z

CI summary (Details)

Active Repos

Repo	Job Branch	Job Commit	Base branch	Base commit	PR
fmdeps/rocq-agent-toolkit/	rocq-pipeline/TraceCursor/span_telemetry	086e1df	main	1f0635c	#283
./	rocq-pipeline/TraceCursor/span_telemetry	e3a058e	main	5d7832c	#137

Passive Repos

Repo	Job Branch	Job Commit
fmdeps/BRiCk/	main	9c981fb
fmdeps/auto/	main	fb544c4
fmdeps/auto-docs/	main	9f57097
bluerock/NOVA/	skylabs-proof	996d600
bluerock/bhv/	skylabs-main	8030a8f
fmdeps/brick-libcpp/	main	d30c178
fmdeps/ci/	main	2d41c88
vendored/elpi/	skylabs-master	aa4475f
fmdeps/fm-ci/	main	262fb04
fmdeps/fm-tools/	main	e17f6db
psi/protos/	main	8fe3e7c
psi/backend/	main	15f7e78
psi/ide/	main	6b596cf
psi/data/	main	1c11c15
vendored/rocq/	skylabs-master	2ede3c9
vendored/rocq-elpi/	skylabs-master	103a742
vendored/rocq-equations/	skylabs-main	a8c4832
vendored/rocq-ext-lib/	skylabs-master	94a6630
vendored/rocq-iris/	skylabs-master	3ad4ddd
vendored/rocq-lsp/	skylabs-main	a8b7272
vendored/rocq-stdlib/	skylabs-master	bc07423
vendored/rocq-stdpp/	skylabs-master	e01d802
fmdeps/skylabs-fm/	main	35a479c
vendored/vsrocq/	skylabs-main	5b4527e

Performance

Relative	Master	MR	Change	Filename
+0.00%	122990.8	122990.8	+0.0	total
+0.00%	22626.8	22626.8	+0.0	├ translation units
+0.00%	100364.0	100364.0	+0.0	└ proofs and tests

Full Results

Relative	Master	MR	Change	Filename

+0.00%	122990.8	122990.8	+0.0	total
+0.00%	22626.8	22626.8	+0.0	├ translation units
+0.00%	100364.0	100364.0	+0.0	└ proofs and tests

skylabs-ai-ci · 2026-03-23T19:34:42Z

CI summary (Details)

Active Repos

Repo	Job Branch	Job Commit	Base branch	Base commit	PR
fmdeps/rocq-agent-toolkit/	rocq-pipeline/TraceCursor/span_telemetry	ff5f4fd	main	1f0635c	#283
./	rocq-pipeline/TraceCursor/span_telemetry	e3a058e	main	5d7832c	#137

Passive Repos

Repo	Job Branch	Job Commit
fmdeps/BRiCk/	main	5158688
fmdeps/auto/	main	2193cc6
fmdeps/auto-docs/	main	9f57097
bluerock/NOVA/	skylabs-proof	996d600
bluerock/bhv/	skylabs-main	8030a8f
fmdeps/brick-libcpp/	main	d30c178
fmdeps/ci/	main	2d41c88
vendored/elpi/	skylabs-master	aa4475f
fmdeps/fm-ci/	main	262fb04
fmdeps/fm-tools/	main	e17f6db
psi/protos/	main	8fe3e7c
psi/backend/	main	15f7e78
psi/ide/	main	6b596cf
psi/data/	main	1c11c15
vendored/rocq/	skylabs-master	2ede3c9
vendored/rocq-elpi/	skylabs-master	103a742
vendored/rocq-equations/	skylabs-main	a8c4832
vendored/rocq-ext-lib/	skylabs-master	94a6630
vendored/rocq-iris/	skylabs-master	3ad4ddd
vendored/rocq-lsp/	skylabs-main	a8b7272
vendored/rocq-stdlib/	skylabs-master	bc07423
vendored/rocq-stdpp/	skylabs-master	e01d802
fmdeps/skylabs-fm/	main	35a479c
vendored/vsrocq/	skylabs-main	5b4527e

Performance

Relative	Master	MR	Change	Filename
+0.00%	123293.8	123293.8	+0.0	total
+0.00%	22626.8	22626.8	+0.0	├ translation units
+0.00%	100667.0	100667.0	+0.0	└ proofs and tests

Full Results

Relative	Master	MR	Change	Filename

+0.00%	123293.8	123293.8	+0.0	total
+0.00%	22626.8	22626.8	+0.0	├ translation units
+0.00%	100667.0	100667.0	+0.0	└ proofs and tests

skylabs-ai-ci · 2026-03-24T00:56:24Z

CI summary (Details)

Active Repos

Repo	Job Branch	Job Commit	Base branch	Base commit	PR
fmdeps/rocq-agent-toolkit/	rocq-pipeline/TraceCursor/span_telemetry	77722bb	main	cf688b1	#283
./	rocq-pipeline/TraceCursor/span_telemetry	e3a058e	main	5d7832c ( ⚠️ needs rebase)	#137

Passive Repos

Repo	Job Branch	Job Commit
fmdeps/BRiCk/	main	5158688
fmdeps/auto/	main	2193cc6
fmdeps/auto-docs/	main	9f57097
bluerock/NOVA/	skylabs-proof	996d600
bluerock/bhv/	skylabs-main	8030a8f
fmdeps/brick-libcpp/	main	d30c178
fmdeps/ci/	main	9ecdef9
vendored/elpi/	skylabs-master	aa4475f
fmdeps/fm-ci/	main	262fb04
fmdeps/fm-tools/	main	e17f6db
psi/protos/	main	8fe3e7c
psi/backend/	main	15f7e78
psi/ide/	main	6b596cf
psi/data/	main	1c11c15
vendored/rocq/	skylabs-master	2ede3c9
vendored/rocq-elpi/	skylabs-master	103a742
vendored/rocq-equations/	skylabs-main	a8c4832
vendored/rocq-ext-lib/	skylabs-master	94a6630
vendored/rocq-iris/	skylabs-master	3ad4ddd
vendored/rocq-lsp/	skylabs-main	a8b7272
vendored/rocq-stdlib/	skylabs-master	bc07423
vendored/rocq-stdpp/	skylabs-master	e01d802
fmdeps/skylabs-fm/	main	7c3aae7
vendored/vsrocq/	skylabs-main	5b4527e

Performance

Relative	Master	MR	Change	Filename
-0.00%	123293.8	123293.8	-0.0	total
-0.00%	22626.8	22626.8	-0.0	├ translation units
+0.00%	100667.0	100667.0	+0.0	└ proofs and tests

Full Results

Relative	Master	MR	Change	Filename

-0.00%	123293.8	123293.8	-0.0	total
-0.00%	22626.8	22626.8	-0.0	├ translation units
+0.00%	100667.0	100667.0	+0.0	└ proofs and tests

…trace_log

…and add to precommit

…c to use these centralized utils

…ngCursor

…e_cursor_attrs.py

…+logic & repair bugs

… before agent.run

…gs to improve clarity

…od name & raise ValueError if (nested) attribute keys contain period

…n.py + tests

…Attrs re. dashboard tactic graph

…r model dump in logger.info call

… structured logs

skylabs-ai-ci · 2026-03-24T12:15:37Z

CI summary (Details)

Active Repos

Repo	Job Branch	Job Commit	Base branch	Base commit	PR
fmdeps/rocq-agent-toolkit/	rocq-pipeline/TraceCursor/span_telemetry	c9ddb3f	main	492a9c1	#283
./	rocq-pipeline/TraceCursor/span_telemetry	15f9fe3	main	2b6c72b	#137

Passive Repos

Repo	Job Branch	Job Commit
fmdeps/BRiCk/	main	5158688
fmdeps/auto/	main	2193cc6
fmdeps/auto-docs/	main	9f57097
bluerock/NOVA/	skylabs-proof	996d600
bluerock/bhv/	skylabs-main	8030a8f
fmdeps/brick-libcpp/	main	d30c178
fmdeps/ci/	main	9ecdef9
vendored/elpi/	skylabs-master	aa4475f
fmdeps/fm-ci/	main	262fb04
fmdeps/fm-tools/	main	e17f6db
psi/protos/	main	8fe3e7c
psi/backend/	main	f4e5aba
psi/ide/	main	6b596cf
psi/data/	main	1c11c15
vendored/rocq/	skylabs-master	2ede3c9
vendored/rocq-elpi/	skylabs-master	103a742
vendored/rocq-equations/	skylabs-main	a8c4832
vendored/rocq-ext-lib/	skylabs-master	94a6630
vendored/rocq-iris/	skylabs-master	3ad4ddd
vendored/rocq-lsp/	skylabs-main	a8b7272
vendored/rocq-stdlib/	skylabs-master	bc07423
vendored/rocq-stdpp/	skylabs-master	e01d802
fmdeps/skylabs-fm/	main	7c3aae7
vendored/vsrocq/	skylabs-main	5b4527e

Performance

Relative	Master	MR	Change	Filename
-0.00%	123293.8	123293.8	-0.0	total
-0.00%	22626.8	22626.8	-0.0	├ translation units
+0.00%	100667.0	100667.0	+0.0	└ proofs and tests

Full Results

Relative	Master	MR	Change	Filename

-0.00%	123293.8	123293.8	-0.0	total
-0.00%	22626.8	22626.8	-0.0	├ translation units
+0.00%	100667.0	100667.0	+0.0	└ proofs and tests

skylabs-ai-ci · 2026-03-24T12:36:18Z

CI summary (Details)

Active Repos

Repo	Job Branch	Job Commit	Base branch	Base commit	PR
fmdeps/rocq-agent-toolkit/	rocq-pipeline/TraceCursor/span_telemetry	c9ddb3f	main	492a9c1	#283
./	rocq-pipeline/TraceCursor/span_telemetry	15f9fe3	main	2b6c72b	#137

Passive Repos

Repo	Job Branch	Job Commit
fmdeps/BRiCk/	main	5158688
fmdeps/auto/	main	2193cc6
fmdeps/auto-docs/	main	9f57097
bluerock/NOVA/	skylabs-proof	996d600
bluerock/bhv/	skylabs-main	8030a8f
fmdeps/brick-libcpp/	main	d30c178
fmdeps/ci/	main	9ecdef9
vendored/elpi/	skylabs-master	aa4475f
fmdeps/fm-ci/	main	262fb04
fmdeps/fm-tools/	main	e17f6db
psi/protos/	main	8fe3e7c
psi/backend/	main	f4e5aba
psi/ide/	main	6b596cf
psi/data/	main	1c11c15
vendored/rocq/	skylabs-master	2ede3c9
vendored/rocq-elpi/	skylabs-master	103a742
vendored/rocq-equations/	skylabs-main	a8c4832
vendored/rocq-ext-lib/	skylabs-master	94a6630
vendored/rocq-iris/	skylabs-master	3ad4ddd
vendored/rocq-lsp/	skylabs-main	a8b7272
vendored/rocq-stdlib/	skylabs-master	bc07423
vendored/rocq-stdpp/	skylabs-master	e01d802
fmdeps/skylabs-fm/	main	7c3aae7
vendored/vsrocq/	skylabs-main	5b4527e

Performance

Relative	Master	MR	Change	Filename
-0.00%	123293.8	123293.8	-0.0	total
-0.00%	22626.8	22626.8	-0.0	├ translation units
+0.00%	100667.0	100667.0	+0.0	└ proofs and tests

Full Results

Relative	Master	MR	Change	Filename

-0.00%	123293.8	123293.8	-0.0	total
-0.00%	22626.8	22626.8	-0.0	├ translation units
+0.00%	100667.0	100667.0	+0.0	└ proofs and tests

jhaag-skylabs-ai self-assigned this Mar 4, 2026

jhaag-skylabs-ai changed the base branch from main to refactor/rocq-agent-toolkit-utils March 4, 2026 23:34

jhaag-skylabs-ai marked this pull request as draft March 4, 2026 23:34

gmalecha-at-skylabs reviewed Mar 5, 2026

View reviewed changes

jhaag-skylabs-ai mentioned this pull request Mar 6, 2026

refactor(ocaml-jsonrpc-tp/python): use pydantic BaseModel for Err + Resp types #282

Open

9 tasks

jhaag-skylabs-ai force-pushed the refactor/rocq-agent-toolkit-utils branch 2 times, most recently from 637d0f3 to 7de09bc Compare March 11, 2026 17:26

jhaag-skylabs-ai changed the base branch from refactor/rocq-agent-toolkit-utils to main March 11, 2026 19:00

jhaag-skylabs-ai force-pushed the rocq-pipeline/TraceCursor/span_telemetry branch from dd2f7e4 to c3275d4 Compare March 11, 2026 19:04

jhaag-skylabs-ai force-pushed the rocq-pipeline/TraceCursor/span_telemetry branch from c3275d4 to 93796de Compare March 11, 2026 21:49

jhaag-skylabs-ai force-pushed the rocq-pipeline/TraceCursor/span_telemetry branch from 93796de to 0a7808a Compare March 13, 2026 21:36

jhaag-skylabs-ai added enhancement New feature or request proposal labels Mar 17, 2026

jhaag-skylabs-ai force-pushed the rocq-pipeline/TraceCursor/span_telemetry branch from 1c02803 to 97c9993 Compare March 17, 2026 22:15

jhaag-skylabs-ai requested a review from ehtesham-zahoor March 17, 2026 22:15

jhaag-skylabs-ai marked this pull request as ready for review March 17, 2026 22:15

ehtesham-zahoor approved these changes Mar 18, 2026

View reviewed changes

jhaag-skylabs-ai force-pushed the rocq-pipeline/TraceCursor/span_telemetry branch from 97c9993 to 8980771 Compare March 20, 2026 07:07

gmalecha-at-skylabs reviewed Mar 20, 2026

View reviewed changes

jhaag-skylabs-ai mentioned this pull request Mar 23, 2026

uv: update module deps in rocq-agent-toolkit SkyLabsAI/workspace#137

Merged

jhaag-skylabs-ai force-pushed the rocq-pipeline/TraceCursor/span_telemetry branch from 8980771 to e210cbf Compare March 23, 2026 16:15

jhaag-skylabs-ai added 22 commits March 24, 2026 08:04

refactor(rocq-pipeline/TraceCursor): sketch span-based telemetry in _…

43bacf5

…trace_log

pyproject(observability): use task test_ci instead of test_ocaml_ci, …

da77244

…and add to precommit

feat(observability): add tracing/otel_attributes.py & fixup span logi…

fcea9fb

…c to use these centralized utils

feat(rocq-pipeline): prefer span attributes in TraceCursor

b82155e

feat(ocaml-jsonrpc-tp/python): add to_json methods to Err+Resp types

38d20cc

fix(rocq-pipeline): relocate TraceCursorSpanAttrs schemas

4963e20

refactor(rocq-pipeline): config-driven trace instrumentation in Traci…

685a321

…ngCursor

fix(rocq-pipeline/tests): use latin-1 codec for arg keys in test_trac…

536b479

…e_cursor_attrs.py

fix(rocq-pipeline): drop RocqCursor values from TraceCursorSpanAttrs

3953804

style(ocaml-jsonrpc-tp/python): repair format_ci task

b486bac

reorg(rocq_pipeline/trace_cursor): prefer telemetry.py over attrs.py

2e14995

refactor(rocq_pipeline/trace_cursor): decouple instrumentation schema…

b23ace1

…+logic & repair bugs

refactor(rocq_pipeline/task_runner): trace more document interactions…

6bd434e

… before agent.run

refactor(rocq_pipeline): remove dep on rocq_agent_toolkit_utils for now

687f4d0

docs(rocq_pipeline/trace_cursor): reorganize code and refine docstrin…

97b2079

…gs to improve clarity

style+fix(observability/tracing/otel_attributes.py): fix type in meth…

dd182dc

…od name & raise ValueError if (nested) attribute keys contain period

fix(rocq-pipeline/trace_cursor): fix small mistakes in instrumentatio…

6f1030e

…n.py + tests

doc(rocq-pipeline/trace_cursor): add note in InstrumentRocqCursorSpan…

e5519d8

…Attrs re. dashboard tactic graph

fix(rocq-pipeline/trace_cursor): backwards compat: use mode 'json' fo…

e961941

…r model dump in logger.info call

pyproject(dashboard/backend): run task test_ci as part of task precommit

66e2373

feat(rocq_pipeline/trace_cursor): trace instrumented method-call depth

6b0a30a

fix(rocq_pipeline/trace_cursor): introduce backwards-compat logic for…

c51dc8f

… structured logs

jhaag-skylabs-ai force-pushed the rocq-pipeline/TraceCursor/span_telemetry branch from c9aa6f8 to c51dc8f Compare March 24, 2026 12:04

jhaag-skylabs-ai merged commit 2ccdf85 into main Mar 24, 2026
86 checks passed

jhaag-skylabs-ai deleted the rocq-pipeline/TraceCursor/span_telemetry branch March 24, 2026 15:22

This was referenced Mar 24, 2026

Add actions to edges in visualizer #110

Closed

[dashboard] incremental migration to span-based telemetry for RocqCursor #319

Open

Conversation

jhaag-skylabs-ai commented Mar 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Background

Closing Conditions

Engineering

Testing

User Stories

Scope/Triage Follow Up Work

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

jhaag-skylabs-ai commented Mar 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

pydantic-Based Schemas

Current telemetry from TraceCursor._trace_log

(De)serialization <-> opentelemetry

Uh oh!

skylabs-ai-ci Bot commented Mar 11, 2026

CI summary (Details)

Active Repos

Passive Repos

Performance

Uh oh!

skylabs-ai-ci Bot commented Mar 11, 2026

CI summary (Details)

Active Repos

Passive Repos

Performance

Uh oh!

skylabs-ai-ci Bot commented Mar 13, 2026

CI summary (Details)

Active Repos

Passive Repos

Performance

Uh oh!

skylabs-ai-ci Bot commented Mar 15, 2026

CI summary (Details)

Active Repos

Passive Repos

Performance

Uh oh!

skylabs-ai-ci Bot commented Mar 17, 2026

CI summary (Details)

Active Repos

Passive Repos

Performance

Uh oh!

skylabs-ai-ci Bot commented Mar 20, 2026

CI summary (Details)

Active Repos

Passive Repos

Performance

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

skylabs-ai-ci Bot commented Mar 23, 2026

CI summary (Details)

Active Repos

Passive Repos

Performance

Uh oh!

skylabs-ai-ci Bot commented Mar 23, 2026

CI summary (Details)

Active Repos

Passive Repos

Performance

Uh oh!

skylabs-ai-ci Bot commented Mar 24, 2026

CI summary (Details)

Active Repos

Passive Repos

Performance

jhaag-skylabs-ai commented Mar 4, 2026 •

edited

Loading

jhaag-skylabs-ai commented Mar 6, 2026 •

edited

Loading

`pydantic`-Based Schemas

Current telemetry from `TraceCursor._trace_log`

(De)serialization <-> `opentelemetry`