Skip to content

feat: add auditable workflow adapters.#11

Merged
pjgao merged 15 commits into
mainfrom
feat/workflow-adapters
Jul 12, 2026
Merged

feat: add auditable workflow adapters.#11
pjgao merged 15 commits into
mainfrom
feat/workflow-adapters

Conversation

@pjgao

@pjgao pjgao commented Jul 11, 2026

Copy link
Copy Markdown
Collaborator

变更概述

  • 增加确定性的构建、服务生命周期、运行证据、基准公平性和 Big-Rock 性能优化门禁。
  • 增加统一的 xllm-flow 实验生命周期,覆盖工作区预检、run 创建、attempt ledger、checkpoint、finalize 和 archive。
  • manifest.json 作为身份信息的单一事实源,自动生成运行证据和公平性候选;gate all 会阻断身份投影漂移。
  • 增加可回放的环境快照,以及框架和硬件 backend 的适配器边界。

主要能力

  • 统一 workspace-tasks.jsonexperiment.yaml、preflight、run 生命周期、checkpoint、fingerprint 和 ledger。
  • 汇总 build、service、evidence、fairness、Big-Rock 门禁,输出统一 verdict。
  • 对性能优化增加 Big-Rock 决策门禁,优先验证收益最大的优化方向,避免过早进入局部细节。
  • 保存源码、构建产物、服务 attempt、workload、设备顺序和实验结论之间的可审计关联。

适配器支持范围

  • xLLM 仍是主要且完整建模的构建门禁路径,包括 CMake、TileLang 和 xllm_ops 检查。
  • vLLM-Ascend 和 SGLang 当前提供实验性的 build-gate adapter,支持通用构建命令、源码指纹和 binary provenance。
  • 当前不能据此宣称已经完整支持 vLLM-Ascend/SGLang 的服务启动、测评和性能分析全链路。
  • Ascend NPU 和 NVIDIA GPU 快照 backend 会归一化到同一套公平性证据 schema。

解决的问题

此前 manifest、运行证据、公平性输入和各个独立 CLI 会重复维护身份字段,容易出现 commit、framework、设备顺序或 workload 漂移。同时,性能优化流程可能在没有证明最大瓶颈的情况下过早进入细节。

本 PR 将身份信息集中到 manifest,通过派生证据和统一门禁阻止漂移,并通过 Big-Rock 门禁要求先量化主要性能预算,再进入实现。

验证结果

  • pytest -q:138 项测试全部通过。
  • git diff --check:通过。
  • 覆盖 xLLM 兼容路径、vLLM-Ascend/SGLang 构建适配器、Ascend/NVIDIA 快照回放、身份漂移和门禁聚合测试。

后续验证

在将 vLLM-Ascend 或 SGLang 从“实验性适配器”升级为“正式支持”之前,还需要分别完成真实仓库的构建、服务启动、benchmark、证据导出和 gate all 端到端运行,并归档对应 artifacts。

pjgao added 14 commits July 11, 2026 13:09
- select reconfigure, incremental, or targeted TileLang plans from repository and cache identity\n- emit deterministic environment, source, build, binary, and verdict artifacts\n- block unsafe benchmark inputs and cover lifecycle decisions with offline tests
Validate build, binary, service, workload, and artifact identities.

Preserve artifact indexes and downgrade incomplete or overwritten runs.

Keep smoke and quick results within their declared claim scope.
Record immutable launch, readiness, smoke, and cleanup artifacts per service attempt.

Preserve process identities and require explicit NPU quiescence before formal claims.

Keep legacy explicit log and PID paths compatible without treating them as formal evidence.
Validate formal run evidence, candidate identity, and normalized environment snapshots.

Require campaign-defined thresholds instead of embedding machine-specific assumptions.

Remove incident-specific values from the generic NPU precheck contract.
Capture normalized NPU health, utilization, process ownership, load, and swap facts.

Preserve raw command outputs and block comparisons when collection evidence is incomplete.

Support replay fixtures so parser behavior remains testable without live NPU access.
Block submodule commit mismatches and require complete binary provenance.

Bind service cleanup to machine-collected NPU evidence and launched devices.

Require model identity before readiness can pass.
Separate campaign and execution identities across repeatable optimization attempts.

Enforce preflight, candidate comparison, retention, checksum, and archive gates.

Generate resumable checkpoints and hash-chained run ledgers.
Require coarse loss budgets and executable Big-Rock gating before implementation.

Connect the SOTA skill to the unified lifecycle and preserve validated replay lessons.
- derive evidence and fairness identities from the run manifest
- aggregate build, service, evidence, fairness, and Big-Rock gates
- add experimental vLLM-Ascend, SGLang, and NVIDIA adapters
@pjgao pjgao changed the title feat: add auditable workflow lifecycle and portable adapters. feat: 增加可审计工作流与可扩展适配器 Jul 11, 2026
@pjgao pjgao changed the title feat: 增加可审计工作流与可扩展适配器 feat: add auditable workflow adapters. Jul 11, 2026
Only declare environment artifacts and the active evidence type by default, so performance runs do not require accuracy and profiling outputs.
@pjgao pjgao marked this pull request as ready for review July 12, 2026 06:04
@pjgao pjgao merged commit 8e0a37e into main Jul 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant