Raise benchmark regression threshold from 120% to 150% for shared CI … #61
ci.yml
on: push
ASan + UBSan (Ubuntu)
47m 53s
TSan (Ubuntu)
47m 52s
UBSan (Ubuntu)
47m 53s
Build & Test (Windows / MSVC)
4m 28s
Server Codecs (Ubuntu)
47m 52s
Full Suite 394/394 (Ubuntu)
47m 52s
Post-Quantum PQ (Ubuntu)
47m 52s
Fuzz (Ubuntu, Clang-18)
30m 49s
Coverage (Ubuntu, Clang-18)
47m 52s
Benchmarks (Ubuntu)
2m 22s
Secrets Scan (gitleaks)
5s
Python SAST (bandit)
9s
License Compliance
1m 37s
Mutation Testing Baseline (Ubuntu)
1m 59s
Matrix: build-test
Annotations
21 errors and 4 warnings
|
Benchmarks (Ubuntu)
# :warning: **Performance Alert** :warning:
Possible performance regression was detected for benchmark.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1.50`.
| Benchmark suite | Current: 49251effcd7a5577972172582f3a560c5f306bd0 | Previous: 1deb2d728f3019d5c719aa76516a78bd19896794 | Ratio |
|-|-|-|-|
| `write` | `3623.32` us (`± 35292.4`) | `767.324` us (`± 22.883`) | `4.72` |
| `write` | `12684.699999999999` us (`± 208708`) | `767.324` us (`± 22.883`) | `16.53` |
This comment was automatically generated by [workflow](https://github.com/SIGNETSTACK/SIGNET_FORGE/actions?query=workflow%3ACI) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark).
Comment was generated at https://github.com/SIGNETSTACK/SIGNET_FORGE/commit/49251effcd7a5577972172582f3a560c5f306bd0#commitcomment-179241580
|
|
Build & Test (Windows / MSVC)
Process completed with exit code 1.
|
|
Coverage (Ubuntu, Clang-18)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
Coverage (Ubuntu, Clang-18)
The operation was canceled.
|
|
Full Suite 394/394 (Ubuntu)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
Full Suite 394/394 (Ubuntu)
The operation was canceled.
|
|
Build & Test (ubuntu-24.04)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
Build & Test (ubuntu-24.04)
The operation was canceled.
|
|
Post-Quantum PQ (Ubuntu)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
Build & Test (macos-14)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
Post-Quantum PQ (Ubuntu)
The operation was canceled.
|
|
Build & Test (macos-14)
The operation was canceled.
|
|
Server Codecs (Ubuntu)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
Server Codecs (Ubuntu)
The operation was canceled.
|
|
TSan (Ubuntu)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
TSan (Ubuntu)
The operation was canceled.
|
|
UBSan (Ubuntu)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
UBSan (Ubuntu)
The operation was canceled.
|
|
CI
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
ASan + UBSan (Ubuntu)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
ASan + UBSan (Ubuntu)
The operation was canceled.
|
|
Benchmarks (Ubuntu)
Performance alert! Previous value was 767.324 and current value is 12684.699999999999. It is 16.531087259097852x worse than previous exceeding a ratio threshold 1.5
|
|
Benchmarks (Ubuntu)
Performance alert! Previous value was 767.324 and current value is 3623.32. It is 4.722020945519755x worse than previous exceeding a ratio threshold 1.5
|
|
Fuzz (Ubuntu, Clang-18)
Fuzz timeouts detected (non-fatal — expected with short budgets):
|
|
Build & Test (macos-14)
ninja 1.13.2 is already installed and up-to-date.
To reinstall 1.13.2, run:
brew reinstall ninja
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
fuzz-crash-artifacts
Expired
|
248 Bytes |
sha256:77ca9513ece8a2795a4bc1c5831034ab8e4a8fea7914b5be3dd4cd9689a5b3c7
|
|