From 8361fcc53ab4cf2293de6674b6685d9f05f8218e Mon Sep 17 00:00:00 2001 From: Ayai Date: Mon, 9 Mar 2026 02:06:00 +0000 Subject: [PATCH 1/3] Apply suggested fix to docs/pipelines/HPC_CICD_ARCHITECTURE.md from Copilot Autofix Co-authored-by: Copilot Autofix powered by AI <223894421+github-code-quality[bot]@users.noreply.github.com> Signed-off-by: Ayai --- docs/pipelines/HPC_CICD_ARCHITECTURE.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/pipelines/HPC_CICD_ARCHITECTURE.md b/docs/pipelines/HPC_CICD_ARCHITECTURE.md index d42fc6b..ffbc1cf 100644 --- a/docs/pipelines/HPC_CICD_ARCHITECTURE.md +++ b/docs/pipelines/HPC_CICD_ARCHITECTURE.md @@ -187,7 +187,7 @@ Alternative cloud-backed runner pools: Recommended minimum gate: ```bash -pytest --cov=kernels --cov=implementations --cov-fail-under=85 +pytest --cov=kernels --cov-fail-under=85 ``` Raise the threshold for critical packages over time as flaky suites are removed. From 750e8f7e33a502e797711470367e54959ec19715 Mon Sep 17 00:00:00 2001 From: Ayai Date: Mon, 9 Mar 2026 02:06:00 +0000 Subject: [PATCH 2/3] Apply suggested fix to docs/pipelines/HPC_CICD_ARCHITECTURE.md from Copilot Autofix Co-authored-by: Copilot Autofix powered by AI <223894421+github-code-quality[bot]@users.noreply.github.com> Signed-off-by: Ayai --- docs/pipelines/HPC_CICD_ARCHITECTURE.md | 12 ++++++++++++ 1 file changed, 12 insertions(+) diff --git a/docs/pipelines/HPC_CICD_ARCHITECTURE.md b/docs/pipelines/HPC_CICD_ARCHITECTURE.md index ffbc1cf..18c8f44 100644 --- a/docs/pipelines/HPC_CICD_ARCHITECTURE.md +++ b/docs/pipelines/HPC_CICD_ARCHITECTURE.md @@ -154,6 +154,18 @@ Use artifact-backed baseline comparison: 3. Compare with a fixed threshold (default: 5% slowdown). 4. Fail PR when threshold is exceeded. +The 5% slowdown value is intended as a conservative default that works well for many +numerical and GPU/CPU kernel workloads where benchmark noise is typically low but +non-zero. Projects SHOULD tune this threshold based on: + +- The inherent variance of each benchmark (e.g., noisy integration tests may need a higher tolerance). +- The business and latency criticality of the kernel (e.g., low-latency paths may warrant a stricter threshold). +- The stability of the underlying hardware and environment (e.g., shared/cloud GPUs vs. dedicated machines). + +In practice, configure the threshold as a parameter in your CI (per-suite or per-benchmark) +rather than hard-coding 5% globally, and document the chosen values and rationale in +the repository (e.g., in `CONTRIBUTING.md` or a benchmarking README). + ## 6) Hardware Validation Strategy Recommended dedicated GPU runner pools: From a6b8a4ffd1699a16c0eced14cf744aa444c660bc Mon Sep 17 00:00:00 2001 From: Ayai Date: Mon, 9 Mar 2026 02:06:00 +0000 Subject: [PATCH 3/3] Apply suggested fix to docs/pipelines/HPC_CICD_ARCHITECTURE.md from Copilot Autofix Co-authored-by: Copilot Autofix powered by AI <223894421+github-code-quality[bot]@users.noreply.github.com> Signed-off-by: Ayai --- docs/pipelines/HPC_CICD_ARCHITECTURE.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/pipelines/HPC_CICD_ARCHITECTURE.md b/docs/pipelines/HPC_CICD_ARCHITECTURE.md index 18c8f44..34f0bf3 100644 --- a/docs/pipelines/HPC_CICD_ARCHITECTURE.md +++ b/docs/pipelines/HPC_CICD_ARCHITECTURE.md @@ -90,7 +90,7 @@ Developer 37. latency-analysis 38. memory-bandwidth-tests -**Primary tools:** pytest-benchmark, nvprof/nsight, Airspeed Velocity. +**Primary tools:** pytest-benchmark, nvprof, Nsight Systems, Nsight Compute, Airspeed Velocity. ### Layer 8 — Security