Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
65 commits
Select commit Hold shift + click to select a range
1087781
ci: route heavy Rust jobs through Incredibuild build runners
zozo123 May 11, 2026
0a78150
ci: create libpython symlink on IB runner so pyo3 deps link
zozo123 May 11, 2026
e8f70a3
ci: export LIBRARY_PATH so pyo3 links libpython on IB runner
zozo123 May 11, 2026
ea3f3bf
ci(test-rust): force UTF-8 locale so CPython-comparison tests pass
zozo123 May 11, 2026
df72f91
ci: route test-python and test-python-coverage through IB too
zozo123 May 11, 2026
8817b05
ci(test-python-coverage): don't wrap llvm-cov show-env through ib_con…
zozo123 May 11, 2026
909976e
ci(ib): enable ib_cache for rustc + diagnostic visibility
zozo123 May 11, 2026
ca7ebf9
ci: tighter scheduling — concurrency, matrix throttle, per-job timeout
zozo123 May 11, 2026
036d317
ci(ib): fix XML profile + migrate lint to IB for E2E coverage
zozo123 May 11, 2026
6a5c9ba
ci(ib): fix profile XML — add version='1' attribute and <processes> w…
zozo123 May 11, 2026
7d41dba
ci(ib): profile XML must declare <globals> before <processes>
zozo123 May 11, 2026
1b7884e
ci: yamlfmt cleanup (remove orphan comment + extra blank line)
zozo123 May 11, 2026
b594b3e
ci(ib): correct flag set + diagnostics inspect real cache path
zozo123 May 11, 2026
4476156
ci(ib): point diagnostic at the real ib_hm.log path
zozo123 May 11, 2026
cbdf175
ci(lint): rm .cargo/config.toml so prek's clippy doesn't need .venv
zozo123 May 11, 2026
32c3051
ci(lint): move CARGO_HOME outside workspace to avoid ruff on cargo gi…
zozo123 May 11, 2026
aaffbc3
ci(lint): use static /tmp/lint-cargo (runner.temp not allowed at job …
zozo123 May 11, 2026
4b727ee
ci: stop Swatinem cache save on IB jobs + drop matrix to max-parallel:2
zozo123 May 11, 2026
214549c
ci: yamlfmt — single space before inline # comment on save-if
zozo123 May 11, 2026
101a3f3
ci: serialize heavy IB jobs (max-parallel:1 + needs chain) for reliab…
zozo123 May 11, 2026
978ab74
ci: refactor IB job boilerplate into scripts/ib-prep.sh + ib-stats.sh
zozo123 May 11, 2026
2d24f1b
ci: literal save-if + reorder ib-prep to run after python is set up
zozo123 May 11, 2026
abcf113
ci: test-rust needs:[bench-test, lint, test-python-coverage]
zozo123 May 11, 2026
4ee67dc
ci: empty trigger to free stuck queued run
zozo123 May 11, 2026
1dd23d0
ci(lint): pin UV_PROJECT_ENVIRONMENT so uv run uses the workspace venv
zozo123 May 11, 2026
739b62e
ci: revert lint to ubuntu-latest (10-min cap kills prek mid-run)
zozo123 May 11, 2026
37b626a
ci: yamlfmt — drop two blank lines after lint-revert refactor
zozo123 May 11, 2026
3fa40a6
ci: empty trigger to re-wake stuck queue (run #26 hung on IB runner)
zozo123 May 11, 2026
007cd8d
ci(test-python): disable LTO for matrix to fit IB runner cap
zozo123 May 11, 2026
253d465
ci: revert test-python matrix to ubuntu-latest (12-min cap unfixable …
zozo123 May 11, 2026
e4585fc
ci: nudge to dispatch stuck test-rust queue
zozo123 May 11, 2026
53662a4
exp-B: bypass scripts/ib-profile.xml (default IB profile, no rustc ca…
zozo123 May 11, 2026
83b6e52
ci: simplify IB wrapper, add A/B/C/D bench workflow, cap-mitigation f…
zozo123 May 11, 2026
7451b92
ci(ib-bench): also trigger on push when bench infra changes
zozo123 May 11, 2026
9b047fd
ci(ib-bench): switch to cargo test --no-run; verbose diagnostics; dro…
zozo123 May 11, 2026
16160b1
ci(ib-bench): install GNU /usr/bin/time; date-based fallback in script
zozo123 May 11, 2026
b850d6b
ci(ib-bench): correct workload description in summarizer table
zozo123 May 11, 2026
4c68706
fix(ib-profile): remove double-hyphen inside XML comment
zozo123 May 11, 2026
b3d33e2
docs(ib-bench): finish-line writeup with A/B numbers and Sam handoff
zozo123 May 11, 2026
0a6d5cb
docs(ib): nail down the python+ib_console rule (cargo only, never pyt…
zozo123 May 11, 2026
cebae8d
fix(docs): drop trailing blank line in IB_BENCH_RESULTS.md (end-of-fi…
zozo123 May 11, 2026
826cffc
feat(ib-bench): final results - 8.36x on warm-cache, 1.55x hardware-only
zozo123 May 11, 2026
e21c866
fix(ib-bench): unbreak basedpyright on summarizer (set type inference)
zozo123 May 11, 2026
c666436
ci(fuzz): revert to ubuntu-latest (12:01 IB wall-clock cap)
zozo123 May 11, 2026
0da0082
docs(ib): recalibrate value claims against real-CI logs
zozo123 May 11, 2026
58f577d
feat(ib-bench): add cells E and F (real test-rust workload)
zozo123 May 12, 2026
9af8378
docs(ib): cell E result + distribution gap + sccache structural cmp
zozo123 May 12, 2026
4f238eb
ci(ib-probe): add push trigger so the probe runs from feature branch
zozo123 May 12, 2026
99a6145
docs(ib): final measured numbers from run 25706688862
zozo123 May 12, 2026
67d7903
feat(ib): cross-repo strategy — Layer F wirings + validation cells G/…
zozo123 May 12, 2026
918bd1d
fix(ib): revert codspeed to ubuntu-latest (valgrind+personality block…
zozo123 May 12, 2026
110878f
ci(ib-bench): add cell-H manylinux container; record Layer-B GREEN
zozo123 May 12, 2026
ede41a4
chore(ib): probe Phase-4 deploy detection + cleanup spec + bench clea…
zozo123 May 12, 2026
75f675a
docs(ib): record measured Cell H = 1.76x speedup (Phase 8 GREEN)
zozo123 May 12, 2026
9c91db2
style(ib): format bench summarizer
zozo123 May 12, 2026
214cdc3
chore(ib): retire cargo-ib wrapper after runner cargo SHIM deploy
zozo123 May 12, 2026
449eabb
fix(ib): preserve cargo shim cap flags
zozo123 May 12, 2026
f74c5ef
fix(ib): bridge cargo extension workloads
zozo123 May 12, 2026
36b6c9a
fix(ib): prevent nested cargo shim wrapping
zozo123 May 12, 2026
181c637
fix(ib-bench): cap synthetic IB cells
zozo123 May 12, 2026
0d7d046
fix(ib-bench): keep automatic runs cap-safe
zozo123 May 12, 2026
e0d5efe
chore(ib): finalize runner closure guardrails
zozo123 May 12, 2026
3cbf512
chore(ib): note upstream cargo extension shim PR
zozo123 May 13, 2026
293145d
chore(ib): retire cargo bridge after runner shim deploy
zozo123 May 13, 2026
f2de6c4
fix(ib-bench): match test-rust runner caps
zozo123 May 13, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
317 changes: 296 additions & 21 deletions .github/workflows/ci.yml

Large diffs are not rendered by default.

27 changes: 25 additions & 2 deletions .github/workflows/codspeed.yml
Original file line number Diff line number Diff line change
Expand Up @@ -14,10 +14,33 @@ permissions:
jobs:
benchmarks:
name: Run benchmarks
# Reverted from incredibuild-runner to ubuntu-latest after CI run
# 25722680967 reproducibly failed with:
# setarch: failed to set personality to x86_64: Operation not permitted
# ##[error]failed to execute valgrind
# The CodSpeedHQ action's `cargo codspeed run` step shells out to
# valgrind, which calls setarch to set ADDR_NO_RANDOMIZE personality.
# The IB self-hosted runner image runs under restricted Linux
# capabilities (no SYS_ADMIN, user-namespace remap), so the
# personality syscall is blocked. github-hosted runners allow it.
#
# Decision: keep the production CodSpeed workflow on ubuntu-latest.
# A hybrid "build on IB, run on ubuntu" flow would need fragile
# target-dir/artifact pinning across cargo-codspeed's instrumented
# outputs. The clean fix is runner-image support for setarch /
# personality(2); until then, CodSpeed stays on the runner that can
# execute Valgrind. The monty-side measurement of the IB-build value
# remains local in this repo via:
# ib-bench.yml::cell-I-ib-codspeed (which only does `cargo codspeed
# build`, no valgrind run, so it works on IB).
#
# If this workflow fails on ubuntu-latest with "Failed to retrieve
# upload data: 401 Unauthorized", that is CodSpeed auth / repository
# permissions, not an IB runner issue.
runs-on: ubuntu-latest

steps:
- uses: actions/checkout@de0fac2e4500dabe0009e67214ff5f5447ce83dd # v6.0.2
- uses: actions/checkout@de0fac2e4500dabe0009e67214ff5f5447ce83dd # v6.0.2
with:
persist-credentials: false

Expand Down Expand Up @@ -45,7 +68,7 @@ jobs:
run: cargo codspeed build -p monty-bench --bench main

- name: Run benchmarks
uses: CodSpeedHQ/action@d872884a306dd4853acf0f584f4b706cf0cc72a2 # v4.13.0
uses: CodSpeedHQ/action@d872884a306dd4853acf0f584f4b706cf0cc72a2 # v4.13.0
with:
mode: simulation
run: cargo codspeed run -p monty-bench --bench main
Loading
Loading