Add dynamic testing: resilience, concurrency stress, property-based, … #59
Johnson-Ogundejici.yml
on: push
ASan + UBSan (Ubuntu)
20m 40s
TSan (Ubuntu)
20m 42s
UBSan (Ubuntu)
20m 41s
Build & Test (Windows / MSVC)
3m 58s
Server Codecs (Ubuntu)
20m 40s
Full Suite 394/394 (Ubuntu)
20m 40s
Post-Quantum PQ (Ubuntu)
20m 40s
Fuzz (Ubuntu, Clang-18)
20m 41s
Coverage (Ubuntu, Clang-18)
20m 40s
Benchmarks (Ubuntu)
2m 22s
Secrets Scan (gitleaks)
6s
Python SAST (bandit)
10s
License Compliance
1m 29s
Mutation Testing Baseline (Ubuntu)
2m 6s
Matrix: build-test
Annotations
23 errors and 7 warnings
|
Benchmarks (Ubuntu)
# :warning: **Performance Alert** :warning:
Possible performance regression was detected for benchmark.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1.20`.
| Benchmark suite | Current: 9e9415d1d11719615f59df3fa85bf74147c52201 | Previous: 80bfc32283c94584b5ad9c1c65e3b1c86ab050c0 | Ratio |
|-|-|-|-|
| `write` | `3086.52` us (`± 48775.5`) | `767.915` us (`± 21.5253`) | `4.02` |
| `write` | `11965.7` us (`± 173344`) | `767.915` us (`± 21.5253`) | `15.58` |
| `open + num_rows` | `263.401` us (`± 52.6983`) | `192.057` us (`± 47.4656`) | `1.37` |
| `push+pop` | `14.0612` ns (`± 0.966939`) | `7.03298` ns (`± 0.353895`) | `2.00` |
| `4P4C 4000 items` | `976.129` us (`± 68.1303`) | `376.949` us (`± 84.237`) | `2.59` |
| `publish+pop 1000` | `63.4012` us (`± 3.66597`) | `34.0239` us (`± 3.26334`) | `1.86` |
This comment was automatically generated by [workflow](https://github.com/SIGNETSTACK/SIGNET_FORGE/actions?query=workflow%3ACI) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark).
Comment was generated at https://github.com/SIGNETSTACK/SIGNET_FORGE/commit/9e9415d1d11719615f59df3fa85bf74147c52201#commitcomment-179237470
|
|
Build & Test (Windows / MSVC)
Process completed with exit code 1.
|
|
Server Codecs (Ubuntu)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
Server Codecs (Ubuntu)
The operation was canceled.
|
|
Post-Quantum PQ (Ubuntu)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
Post-Quantum PQ (Ubuntu)
The operation was canceled.
|
|
ASan + UBSan (Ubuntu)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
ASan + UBSan (Ubuntu)
The operation was canceled.
|
|
Full Suite 394/394 (Ubuntu)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
Full Suite 394/394 (Ubuntu)
The operation was canceled.
|
|
Coverage (Ubuntu, Clang-18)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
Coverage (Ubuntu, Clang-18)
The operation was canceled.
|
|
Build & Test (macos-14)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
Build & Test (macos-14)
The operation was canceled.
|
|
Build & Test (ubuntu-24.04)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
Build & Test (ubuntu-24.04)
The operation was canceled.
|
|
TSan (Ubuntu)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
TSan (Ubuntu)
The operation was canceled.
|
|
UBSan (Ubuntu)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
UBSan (Ubuntu)
The operation was canceled.
|
|
Fuzz (Ubuntu, Clang-18)
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
Fuzz (Ubuntu, Clang-18)
The operation was canceled.
|
|
CI
Canceling since a higher priority waiting request for CI-refs/heads/main exists
|
|
Benchmarks (Ubuntu)
Performance alert! Previous value was 34.0239 and current value is 63.4012. It is 1.8634312938845932x worse than previous exceeding a ratio threshold 1.2
|
|
Benchmarks (Ubuntu)
Performance alert! Previous value was 376.949 and current value is 976.129. It is 2.589551902246723x worse than previous exceeding a ratio threshold 1.2
|
|
Benchmarks (Ubuntu)
Performance alert! Previous value was 7.03298 and current value is 14.0612. It is 1.9993231887478706x worse than previous exceeding a ratio threshold 1.2
|
|
Benchmarks (Ubuntu)
Performance alert! Previous value was 192.057 and current value is 263.401. It is 1.3714730522709406x worse than previous exceeding a ratio threshold 1.2
|
|
Benchmarks (Ubuntu)
Performance alert! Previous value was 767.915 and current value is 11965.7. It is 15.58206311896499x worse than previous exceeding a ratio threshold 1.2
|
|
Benchmarks (Ubuntu)
Performance alert! Previous value was 767.915 and current value is 3086.52. It is 4.019351100056647x worse than previous exceeding a ratio threshold 1.2
|
|
Build & Test (macos-14)
ninja 1.13.2 is already installed and up-to-date.
To reinstall 1.13.2, run:
brew reinstall ninja
|