Skip to content

Raise benchmark regression threshold from 120% to 150% for shared CI … #61

Raise benchmark regression threshold from 120% to 150% for shared CI …

Raise benchmark regression threshold from 120% to 150% for shared CI … #61

Triggered via push March 11, 2026 03:49
Status Cancelled
Total duration 48m 14s
Artifacts 1

ci.yml

on: push
ASan + UBSan (Ubuntu)
47m 53s
ASan + UBSan (Ubuntu)
TSan (Ubuntu)
47m 52s
TSan (Ubuntu)
UBSan (Ubuntu)
47m 53s
UBSan (Ubuntu)
Build & Test (Windows / MSVC)
4m 28s
Build & Test (Windows / MSVC)
Server Codecs (Ubuntu)
47m 52s
Server Codecs (Ubuntu)
Full Suite 394/394 (Ubuntu)
47m 52s
Full Suite 394/394 (Ubuntu)
Post-Quantum PQ (Ubuntu)
47m 52s
Post-Quantum PQ (Ubuntu)
Fuzz (Ubuntu, Clang-18)
30m 49s
Fuzz (Ubuntu, Clang-18)
Coverage (Ubuntu, Clang-18)
47m 52s
Coverage (Ubuntu, Clang-18)
Benchmarks (Ubuntu)
2m 22s
Benchmarks (Ubuntu)
Secrets Scan (gitleaks)
5s
Secrets Scan (gitleaks)
Python SAST (bandit)
9s
Python SAST (bandit)
License Compliance
1m 37s
License Compliance
Mutation Testing Baseline (Ubuntu)
1m 59s
Mutation Testing Baseline (Ubuntu)
Matrix: build-test
Fit to window
Zoom out
Zoom in

Annotations

21 errors and 4 warnings
Benchmarks (Ubuntu)
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1.50`. | Benchmark suite | Current: 49251effcd7a5577972172582f3a560c5f306bd0 | Previous: 1deb2d728f3019d5c719aa76516a78bd19896794 | Ratio | |-|-|-|-| | `write` | `3623.32` us (`± 35292.4`) | `767.324` us (`± 22.883`) | `4.72` | | `write` | `12684.699999999999` us (`± 208708`) | `767.324` us (`± 22.883`) | `16.53` | This comment was automatically generated by [workflow](https://github.com/SIGNETSTACK/SIGNET_FORGE/actions?query=workflow%3ACI) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). Comment was generated at https://github.com/SIGNETSTACK/SIGNET_FORGE/commit/49251effcd7a5577972172582f3a560c5f306bd0#commitcomment-179241580
Build & Test (Windows / MSVC)
Process completed with exit code 1.
Coverage (Ubuntu, Clang-18)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
Coverage (Ubuntu, Clang-18)
The operation was canceled.
Full Suite 394/394 (Ubuntu)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
Full Suite 394/394 (Ubuntu)
The operation was canceled.
Build & Test (ubuntu-24.04)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
Build & Test (ubuntu-24.04)
The operation was canceled.
Post-Quantum PQ (Ubuntu)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
Build & Test (macos-14)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
Post-Quantum PQ (Ubuntu)
The operation was canceled.
Build & Test (macos-14)
The operation was canceled.
Server Codecs (Ubuntu)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
Server Codecs (Ubuntu)
The operation was canceled.
TSan (Ubuntu)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
TSan (Ubuntu)
The operation was canceled.
UBSan (Ubuntu)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
UBSan (Ubuntu)
The operation was canceled.
CI
Canceling since a higher priority waiting request for CI-refs/heads/main exists
ASan + UBSan (Ubuntu)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
ASan + UBSan (Ubuntu)
The operation was canceled.
Benchmarks (Ubuntu)
Performance alert! Previous value was 767.324 and current value is 12684.699999999999. It is 16.531087259097852x worse than previous exceeding a ratio threshold 1.5
Benchmarks (Ubuntu)
Performance alert! Previous value was 767.324 and current value is 3623.32. It is 4.722020945519755x worse than previous exceeding a ratio threshold 1.5
Fuzz (Ubuntu, Clang-18)
Fuzz timeouts detected (non-fatal — expected with short budgets):
Build & Test (macos-14)
ninja 1.13.2 is already installed and up-to-date. To reinstall 1.13.2, run: brew reinstall ninja

Artifacts

Produced during runtime
Name Size Digest
fuzz-crash-artifacts Expired
248 Bytes
sha256:77ca9513ece8a2795a4bc1c5831034ab8e4a8fea7914b5be3dd4cd9689a5b3c7