Skip to content

Docker run retry#8447

Open
NachoEchevarria wants to merge 1 commit intomasterfrom
nacho/DockerRunRetry
Open

Docker run retry#8447
NachoEchevarria wants to merge 1 commit intomasterfrom
nacho/DockerRunRetry

Conversation

@NachoEchevarria
Copy link
Copy Markdown
Collaborator

@NachoEchevarria NachoEchevarria commented Apr 13, 2026

Summary of changes

Add a targeted retry wrapper around docker run in run-in-docker.yml to handle transient Docker daemon errors without blanket-retrying the entire CI step.

Reason for change

After merging #8358 (Docker daemon readiness checks), we still observed transient failures where the daemon was confirmed ready but docker run failed with D-Bus/cgroup errors like:

unable to start unit "docker-....scope": Message recipient disconnected from message bus without replying

The daemon is healthy (passes docker info), but systemd's D-Bus has a momentary hiccup during container cgroup creation. This is a transient infrastructure issue, not a test failure.

Implementation details

  • Adds a docker_run_with_retry shell function that wraps the docker run invocation
  • Only retries on exit code 125 (Docker daemon error — container creation failure), up to 3 attempts with 10s delay
  • Does not retry on any other exit code (test/build failures inside the container pass through immediately)
  • Always logs the exit code on failure (##[warning]), so we can observe actual exit codes for future Docker errors regardless of whether they trigger a retry

Test coverage

CI pipeline change — no unit tests. Validated by reviewing Docker's exit code conventions (125 = daemon error).

Other details

Follow-up to #8358.

@github-actions github-actions bot added the area:builds project files, build scripts, pipelines, versioning, releases, packages label Apr 13, 2026
Copy link
Copy Markdown
Member

@andrewlock andrewlock left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@NachoEchevarria NachoEchevarria marked this pull request as ready for review April 13, 2026 16:01
@NachoEchevarria NachoEchevarria requested a review from a team as a code owner April 13, 2026 16:01
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Apr 13, 2026

Benchmarks

Benchmark execution time: 2026-04-13 16:44:34

Comparing candidate commit 38f6271 in PR branch nacho/DockerRunRetry with baseline commit 58f22e8 in branch master.

Found 1 performance improvements and 1 performance regressions! Performance is the same for 25 metrics, 0 unstable metrics, 87 known flaky benchmarks.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

  • 🟩 = significantly better candidate vs. baseline
  • 🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

scenario:Benchmarks.Trace.HttpClientBenchmark.SendAsync net472

  • 🟥 throughput [-6642.742op/s; -6148.647op/s] or [-7.583%; -7.019%]

scenario:Benchmarks.Trace.HttpClientBenchmark.SendAsync net6.0

  • 🟩 throughput [+7487.635op/s; +8356.276op/s] or [+5.086%; +5.677%]

Known flaky benchmarks

These benchmarks are marked as flaky and will not trigger a failure. Modify FLAKY_BENCHMARKS_REGEX to control which benchmarks are marked as flaky.

scenario:Benchmarks.Trace.ActivityBenchmark.StartStopWithChild net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.008%; +0.005%]
  • ignore execution_time [-912.408µs; +58.697µs] or [-0.453%; +0.029%]
  • ignore throughput [+96.135op/s; +566.538op/s] or [+0.114%; +0.672%]

scenario:Benchmarks.Trace.ActivityBenchmark.StartStopWithChild net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.007%]
  • ignore execution_time [-2040.649µs; +1463.998µs] or [-1.018%; +0.730%]
  • 🟩 throughput [+8359.276op/s; +10669.047op/s] or [+7.026%; +8.968%]

scenario:Benchmarks.Trace.ActivityBenchmark.StartStopWithChild netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.003%; +0.007%]
  • ignore execution_time [-16.678ms; -3.103ms] or [-8.388%; -1.561%]
  • ignore throughput [-2158.698op/s; -870.017op/s] or [-2.195%; -0.885%]

scenario:Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces net472

  • ignore allocated_mem [-20 bytes; -19 bytes] or [-0.613%; -0.600%]
  • 🟥 execution_time [+311.661ms; +314.696ms] or [+154.657%; +156.163%]
  • ignore throughput [+1.556op/s; +6.150op/s] or [+0.280%; +1.107%]

scenario:Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.009%; +0.002%]
  • 🟥 execution_time [+377.725ms; +381.134ms] or [+298.426%; +301.120%]
  • ignore throughput [+5.058op/s; +8.572op/s] or [+0.667%; +1.130%]

scenario:Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.009%; +0.002%]
  • 🟥 execution_time [+396.996ms; +400.084ms] or [+351.326%; +354.059%]
  • ignore throughput [-2.741op/s; +0.457op/s] or [-0.387%; +0.065%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleMoreComplexBody net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.005%]
  • ignore execution_time [-87.522µs; +490.616µs] or [-0.044%; +0.245%]
  • ignore throughput [+1940.818op/s; +2434.612op/s] or [+1.510%; +1.894%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleMoreComplexBody net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.005%]
  • 🟩 execution_time [-16.570ms; -12.385ms] or [-7.739%; -5.784%]
  • 🟩 throughput [+10097.142op/s; +12902.829op/s] or [+7.370%; +9.418%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleMoreComplexBody netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.002%]
  • ignore execution_time [-11.794ms; -7.680ms] or [-5.616%; -3.657%]
  • ignore throughput [+4876.696op/s; +7145.782op/s] or [+4.409%; +6.461%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleSimpleBody net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.002%; +0.008%]
  • ignore execution_time [-1.775ms; -0.945ms] or [-0.884%; -0.471%]
  • ignore throughput [+4277.740op/s; +11267.125op/s] or [+0.437%; +1.150%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleSimpleBody net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.002%; +0.005%]
  • 🟩 execution_time [-26.138ms; -21.280ms] or [-11.656%; -9.490%]
  • 🟩 throughput [+91890.365op/s; +114747.371op/s] or [+9.817%; +12.259%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleSimpleBody netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.004%]
  • ignore execution_time [-1772.162µs; +2538.186µs] or [-0.885%; +1.267%]
  • 🟩 throughput [+78949.411op/s; +95288.980op/s] or [+11.344%; +13.691%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorMoreComplexBody net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.007%; +0.003%]
  • ignore execution_time [-1283.399µs; -197.939µs] or [-0.640%; -0.099%]
  • ignore throughput [+600.987op/s; +1395.369op/s] or [+0.404%; +0.939%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorMoreComplexBody net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.003%]
  • ignore execution_time [+0.018ms; +3.504ms] or [+0.009%; +1.768%]
  • 🟩 throughput [+10024.893op/s; +12951.976op/s] or [+6.379%; +8.241%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorMoreComplexBody netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.007%; +0.003%]
  • ignore execution_time [+3.623ms; +7.681ms] or [+1.847%; +3.916%]
  • ignore throughput [+5398.528op/s; +8032.547op/s] or [+4.301%; +6.399%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorSimpleBody net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.008%; +0.004%]
  • ignore execution_time [-289.707µs; -88.507µs] or [-0.145%; -0.044%]
  • ignore throughput [+28607.591op/s; +39572.195op/s] or [+0.870%; +1.204%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorSimpleBody net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.008%]
  • ignore execution_time [-1.860ms; -1.043ms] or [-0.919%; -0.515%]
  • 🟩 throughput [+491926.708op/s; +510817.688op/s] or [+16.403%; +17.033%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorSimpleBody netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.004%]
  • 🟩 execution_time [-19.386ms; -15.035ms] or [-8.936%; -6.931%]
  • 🟩 throughput [+201271.107op/s; +254777.351op/s] or [+7.989%; +10.113%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeArgs net472

  • ignore allocated_mem [+0 bytes; +2 bytes] or [-0.001%; +0.007%]
  • 🟥 execution_time [+300.200ms; +300.805ms] or [+150.000%; +150.302%]
  • ignore throughput [+40.682op/s; +80.989op/s] or [+0.449%; +0.895%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeArgs net6.0

  • ignore allocated_mem [-1 bytes; +2 bytes] or [-0.004%; +0.008%]
  • 🟥 execution_time [+300.500ms; +305.071ms] or [+151.543%; +153.848%]
  • ignore throughput [+72.459op/s; +303.192op/s] or [+0.554%; +2.319%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeArgs netcoreapp3.1

  • ignore allocated_mem [-1 bytes; +2 bytes] or [-0.004%; +0.008%]
  • 🟥 execution_time [+299.631ms; +302.212ms] or [+150.931%; +152.231%]
  • ignore throughput [+98.127op/s; +227.709op/s] or [+0.947%; +2.198%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeLegacyArgs net472

  • ignore allocated_mem [+3 bytes; +4 bytes] or [+0.186%; +0.199%]
  • 🟥 execution_time [+295.830ms; +296.887ms] or [+145.300%; +145.819%]
  • ignore throughput [-16.392op/s; -0.788op/s] or [-0.435%; -0.021%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeLegacyArgs net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.009%]
  • 🟥 execution_time [+293.120ms; +294.702ms] or [+143.295%; +144.069%]
  • ignore throughput [-16.955op/s; +8.587op/s] or [-0.246%; +0.125%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeLegacyArgs netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.009%]
  • 🟥 execution_time [+302.529ms; +303.823ms] or [+151.203%; +151.851%]
  • ignore throughput [+21.005op/s; +39.019op/s] or [+0.417%; +0.774%]

scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmark net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • ignore execution_time [+4.727µs; +8.233µs] or [+0.971%; +1.690%]
  • ignore throughput [-34.031op/s; -19.552op/s] or [-1.657%; -0.952%]

scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmark net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.000%; +0.010%]
  • 🟥 execution_time [+42.308µs; +69.983µs] or [+9.703%; +16.051%]
  • 🟥 throughput [-326.762op/s; -203.159op/s] or [-14.206%; -8.833%]

scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmark netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.003%; +0.003%]
  • ignore execution_time [+10.919µs; +32.879µs] or [+2.339%; +7.044%]
  • ignore throughput [-159.944op/s; -79.204op/s] or [-7.383%; -3.656%]

scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmarkWithAttack net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • ignore execution_time [-3.341µs; +1.039µs] or [-0.902%; +0.281%]
  • ignore throughput [-6.437op/s; +24.922op/s] or [-0.238%; +0.923%]

scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmarkWithAttack net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.003%; +0.007%]
  • 🟥 execution_time [+27.369µs; +51.023µs] or [+8.737%; +16.289%]
  • 🟥 throughput [-468.995op/s; -270.045op/s] or [-14.620%; -8.418%]

scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmarkWithAttack netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.003%; +0.003%]
  • ignore execution_time [-12.248µs; +10.116µs] or [-3.351%; +2.767%]
  • ignore throughput [-109.362op/s; +24.057op/s] or [-3.925%; +0.863%]

scenario:Benchmarks.Trace.AspNetCoreBenchmark.SendRequest net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • 🟥 execution_time [+299.642ms; +300.273ms] or [+149.552%; +149.867%]
  • ignore throughput [-1261993.694op/s; -698801.155op/s] or [-0.632%; -0.350%]

scenario:Benchmarks.Trace.AspNetCoreBenchmark.SendRequest net6.0

  • ignore allocated_mem [+88 bytes; +90 bytes] or [+0.491%; +0.502%]
  • unstable execution_time [+364.628ms; +401.514ms] or [+396.183%; +436.262%]
  • 🟩 throughput [+957.012op/s; +1091.133op/s] or [+7.864%; +8.966%]

scenario:Benchmarks.Trace.AspNetCoreBenchmark.SendRequest netcoreapp3.1

  • ignore allocated_mem [+77 bytes; +79 bytes] or [+0.371%; +0.383%]
  • unstable execution_time [+324.019ms; +359.390ms] or [+246.024%; +272.881%]
  • 🟩 throughput [+682.385op/s; +880.597op/s] or [+6.606%; +8.525%]

scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces net472

  • ignore allocated_mem [+2.742KB; +2.747KB] or [+4.872%; +4.881%]
  • unstable execution_time [+304.628ms; +362.993ms] or [+140.065%; +166.901%]
  • 🟥 throughput [-461.001op/s; -413.482op/s] or [-41.771%; -37.465%]

scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces net6.0

  • ignore allocated_mem [-1.270KB; -1.268KB] or [-2.995%; -2.990%]
  • unstable execution_time [+202.215ms; +335.426ms] or [+86.175%; +142.944%]
  • 🟥 throughput [-746.403op/s; -662.941op/s] or [-49.785%; -44.218%]

scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces netcoreapp3.1

  • ignore allocated_mem [+1.148KB; +1.151KB] or [+2.710%; +2.717%]
  • 🟥 execution_time [+333.073ms; +341.204ms] or [+199.216%; +204.080%]
  • 🟥 throughput [-406.014op/s; -370.087op/s] or [-28.270%; -25.769%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • ignore execution_time [-59.191µs; -43.358µs] or [-2.979%; -2.182%]
  • ignore throughput [+11.479op/s; +15.586op/s] or [+2.281%; +3.097%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • ignore execution_time [+22.005µs; +42.321µs] or [+1.512%; +2.907%]
  • ignore throughput [-18.732op/s; -9.446op/s] or [-2.727%; -1.375%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • ignore execution_time [+116.577µs; +252.439µs] or [+4.056%; +8.782%]
  • ignore throughput [-26.339op/s; -1.417op/s] or [-7.571%; -0.407%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSliceWithPool net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • ignore execution_time [+5.403µs; +25.452µs] or [+0.467%; +2.198%]
  • ignore throughput [-16.846op/s; -2.881op/s] or [-1.950%; -0.334%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSliceWithPool net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • ignore execution_time [-75.961µs; -44.272µs] or [-7.045%; -4.106%]
  • ignore throughput [+43.682op/s; +80.147op/s] or [+4.710%; +8.642%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSliceWithPool netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • ignore execution_time [+17.157µs; +32.376µs] or [+0.919%; +1.735%]
  • ignore throughput [-8.961op/s; -4.738op/s] or [-1.673%; -0.884%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OriginalCharSlice net472

  • ignore allocated_mem [-43 bytes; +21 bytes] or [-0.007%; +0.003%]
  • ignore execution_time [+69.752µs; +93.331µs] or [+2.725%; +3.646%]
  • ignore throughput [-13.546op/s; -10.190op/s] or [-3.468%; -2.609%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OriginalCharSlice net6.0

  • ignore allocated_mem [-38 bytes; +46 bytes] or [-0.006%; +0.007%]
  • 🟩 execution_time [-174.548µs; -140.342µs] or [-8.842%; -7.109%]
  • 🟩 throughput [+40.425op/s; +49.579op/s] or [+7.980%; +9.787%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OriginalCharSlice netcoreapp3.1

  • ignore allocated_mem [-42 bytes; +23 bytes] or [-0.007%; +0.004%]
  • ignore execution_time [-148.044µs; -108.544µs] or [-3.754%; -2.753%]
  • ignore throughput [+7.447op/s; +9.937op/s] or [+2.936%; +3.919%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.001%; +0.008%]
  • 🟥 execution_time [+298.427ms; +299.926ms] or [+150.282%; +151.037%]
  • ignore throughput [-3707.754op/s; -875.653op/s] or [-1.193%; -0.282%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.004%]
  • 🟥 execution_time [+301.154ms; +302.810ms] or [+150.909%; +151.739%]
  • 🟩 throughput [+45079.934op/s; +48773.407op/s] or [+7.107%; +7.690%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.004%]
  • 🟥 execution_time [+300.162ms; +303.518ms] or [+150.789%; +152.474%]
  • ignore throughput [+12322.086op/s; +19529.358op/s] or [+2.596%; +4.114%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.008%; +0.004%]
  • 🟥 execution_time [+302.780ms; +304.043ms] or [+152.046%; +152.680%]
  • ignore throughput [+10446.915op/s; +12085.069op/s] or [+3.500%; +4.049%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.007%; +0.006%]
  • 🟥 execution_time [+299.445ms; +300.973ms] or [+148.062%; +148.818%]
  • 🟩 throughput [+33380.269op/s; +38030.634op/s] or [+5.378%; +6.127%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.004%]
  • 🟥 execution_time [+302.896ms; +306.426ms] or [+153.521%; +155.310%]
  • ignore throughput [+3714.848op/s; +11962.386op/s] or [+0.802%; +2.583%]

scenario:Benchmarks.Trace.GraphQLBenchmark.ExecuteAsync net472

  • ignore allocated_mem [+0 bytes; +1 bytes] or [+0.108%; +0.119%]
  • 🟥 execution_time [+302.356ms; +304.179ms] or [+151.755%; +152.670%]
  • ignore throughput [+4528.428op/s; +6682.628op/s] or [+1.175%; +1.734%]

scenario:Benchmarks.Trace.GraphQLBenchmark.ExecuteAsync net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.006%]
  • 🟥 execution_time [+299.425ms; +302.020ms] or [+149.236%; +150.529%]
  • 🟩 throughput [+58120.291op/s; +63188.585op/s] or [+11.541%; +12.547%]

scenario:Benchmarks.Trace.GraphQLBenchmark.ExecuteAsync netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.006%]
  • 🟥 execution_time [+300.317ms; +302.773ms] or [+149.405%; +150.627%]
  • ignore throughput [-3440.238op/s; +1600.485op/s] or [-0.814%; +0.379%]

scenario:Benchmarks.Trace.ILoggerBenchmark.EnrichedLog net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.003%; +0.006%]
  • ignore execution_time [-1244.379µs; -316.027µs] or [-0.619%; -0.157%]
  • ignore throughput [+2727.985op/s; +4327.437op/s] or [+1.097%; +1.740%]

scenario:Benchmarks.Trace.ILoggerBenchmark.EnrichedLog net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.003%]
  • 🟩 execution_time [-15.720ms; -12.060ms] or [-7.310%; -5.608%]
  • 🟩 throughput [+26422.369op/s; +33055.302op/s] or [+7.248%; +9.068%]

scenario:Benchmarks.Trace.ILoggerBenchmark.EnrichedLog netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.008%]
  • ignore execution_time [-0.610ms; +3.339ms] or [-0.306%; +1.675%]
  • ignore throughput [+5621.529op/s; +11386.852op/s] or [+2.052%; +4.157%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark net472

  • ignore allocated_mem [-4.459KB; -4.431KB] or [-1.623%; -1.613%]
  • unstable execution_time [+4.711µs; +45.579µs] or [+1.164%; +11.258%]
  • ignore throughput [-236.452op/s; -31.232op/s] or [-9.515%; -1.257%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark net6.0

  • 🟩 allocated_mem [-19.494KB; -19.473KB] or [-7.111%; -7.103%]
  • unstable execution_time [-41.190µs; +10.766µs] or [-8.141%; +2.128%]
  • ignore throughput [-34.196op/s; +146.523op/s] or [-1.706%; +7.312%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark netcoreapp3.1

  • 🟩 allocated_mem [-18.754KB; -18.738KB] or [-6.837%; -6.831%]
  • ignore execution_time [-61.003µs; -5.104µs] or [-10.571%; -0.885%]
  • ignore throughput [+28.880op/s; +181.182op/s] or [+1.650%; +10.351%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark net472

  • ignore allocated_mem [-2 bytes; +2 bytes] or [-0.005%; +0.006%]
  • ignore execution_time [-19.683ns; +1596.350ns] or [-0.034%; +2.765%]
  • ignore throughput [-431.121op/s; +18.906op/s] or [-2.488%; +0.109%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark net6.0

  • ignore allocated_mem [-4 bytes; +0 bytes] or [-0.010%; -0.001%]
  • unstable execution_time [+6.044µs; +10.457µs] or [+14.286%; +24.717%]
  • 🟥 throughput [-4612.592op/s; -2827.846op/s] or [-19.418%; -11.904%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark netcoreapp3.1

  • ignore allocated_mem [-1 bytes; +1 bytes] or [-0.002%; +0.002%]
  • unstable execution_time [-13.277µs; -5.807µs] or [-20.599%; -9.009%]
  • 🟩 throughput [+1526.725op/s; +3106.862op/s] or [+9.367%; +19.062%]

scenario:Benchmarks.Trace.Log4netBenchmark.EnrichedLog net472

  • ignore allocated_mem [+1 bytes; +2 bytes] or [+0.039%; +0.050%]
  • 🟥 execution_time [+302.447ms; +303.505ms] or [+152.874%; +153.408%]
  • ignore throughput [-62.354op/s; -41.338op/s] or [-1.042%; -0.691%]

scenario:Benchmarks.Trace.Log4netBenchmark.EnrichedLog net6.0

  • ignore allocated_mem [-1 bytes; +0 bytes] or [-0.027%; -0.017%]
  • 🟥 execution_time [+302.214ms; +304.592ms] or [+153.826%; +155.036%]
  • ignore throughput [-107.680op/s; -29.184op/s] or [-1.335%; -0.362%]

scenario:Benchmarks.Trace.Log4netBenchmark.EnrichedLog netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.005%]
  • 🟥 execution_time [+300.634ms; +303.988ms] or [+150.504%; +152.184%]
  • ignore throughput [-207.237op/s; -124.263op/s] or [-2.640%; -1.583%]

scenario:Benchmarks.Trace.RedisBenchmark.SendReceive net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.005%]
  • ignore execution_time [-385.567µs; +198.990µs] or [-0.192%; +0.099%]
  • ignore throughput [-17937.795op/s; -16277.009op/s] or [-4.966%; -4.506%]

scenario:Benchmarks.Trace.RedisBenchmark.SendReceive net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.007%]
  • ignore execution_time [-0.971ms; +4.384ms] or [-0.485%; +2.191%]
  • 🟩 throughput [+45003.320op/s; +55287.248op/s] or [+8.518%; +10.465%]

scenario:Benchmarks.Trace.RedisBenchmark.SendReceive netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.006%]
  • ignore execution_time [+2.040ms; +5.703ms] or [+1.034%; +2.891%]
  • ignore throughput [-900.055op/s; +7357.951op/s] or [-0.213%; +1.741%]

scenario:Benchmarks.Trace.SerilogBenchmark.EnrichedLog net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.006%]
  • 🟥 execution_time [+299.683ms; +301.451ms] or [+149.365%; +150.246%]
  • ignore throughput [-6299.740op/s; -4739.937op/s] or [-4.160%; -3.130%]

scenario:Benchmarks.Trace.SerilogBenchmark.EnrichedLog net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+0.000%; +0.009%]
  • 🟥 execution_time [+301.574ms; +302.619ms] or [+151.436%; +151.961%]
  • ignore throughput [+4056.948op/s; +5607.987op/s] or [+1.764%; +2.439%]

scenario:Benchmarks.Trace.SerilogBenchmark.EnrichedLog netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.003%]
  • 🟥 execution_time [+305.061ms; +307.938ms] or [+154.707%; +156.166%]
  • ignore throughput [-61.081op/s; +1895.917op/s] or [-0.034%; +1.068%]

scenario:Benchmarks.Trace.SingleSpanAspNetCoreBenchmark.SingleSpanAspNetCore net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • 🟥 execution_time [+299.752ms; +300.364ms] or [+149.518%; +149.823%]
  • 🟩 throughput [+51733058.810op/s; +58879807.640op/s] or [+37.675%; +42.880%]

scenario:Benchmarks.Trace.SingleSpanAspNetCoreBenchmark.SingleSpanAspNetCore net6.0

  • ignore allocated_mem [+62 bytes; +64 bytes] or [+0.366%; +0.376%]
  • unstable execution_time [+377.302ms; +413.918ms] or [+469.242%; +514.780%]
  • 🟩 throughput [+1036.901op/s; +1209.256op/s] or [+8.016%; +9.348%]

scenario:Benchmarks.Trace.SingleSpanAspNetCoreBenchmark.SingleSpanAspNetCore netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • 🟥 execution_time [+299.525ms; +300.435ms] or [+149.396%; +149.850%]
  • ignore throughput [+1739448.350op/s; +2676586.081op/s] or [+0.770%; +1.186%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishScope net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.006%]
  • ignore execution_time [+184.160µs; +606.561µs] or [+0.092%; +0.303%]
  • ignore throughput [-36332.196op/s; -33458.129op/s] or [-4.055%; -3.734%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishScope net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.007%]
  • ignore execution_time [-4.497ms; -3.353ms] or [-2.203%; -1.642%]
  • 🟩 throughput [+98686.067op/s; +107933.848op/s] or [+9.214%; +10.077%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishScope netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.003%; +0.006%]
  • ignore execution_time [+1.958ms; +6.110ms] or [+0.991%; +3.092%]
  • ignore throughput [+28729.681op/s; +48722.243op/s] or [+3.325%; +5.639%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishSpan net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.000%; +0.009%]
  • ignore execution_time [+336.530µs; +759.591µs] or [+0.168%; +0.380%]
  • ignore throughput [+2952.583op/s; +6244.853op/s] or [+0.270%; +0.572%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishSpan net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.004%]
  • ignore execution_time [+6.361ms; +10.459ms] or [+3.314%; +5.449%]
  • 🟩 throughput [+86990.008op/s; +117062.934op/s] or [+6.733%; +9.061%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishSpan netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.001%; +0.008%]
  • ignore execution_time [-4.403ms; -3.007ms] or [-2.163%; -1.477%]
  • 🟩 throughput [+74678.124op/s; +84282.760op/s] or [+7.417%; +8.371%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishTwoScopes net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.008%; +0.002%]
  • ignore execution_time [-2.111ms; -0.795ms] or [-1.051%; -0.396%]
  • ignore throughput [+2498.820op/s; +5661.370op/s] or [+0.557%; +1.261%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishTwoScopes net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.009%]
  • ignore execution_time [-780.731µs; +673.889µs] or [-0.390%; +0.337%]
  • 🟩 throughput [+57884.112op/s; +62410.344op/s] or [+10.511%; +11.333%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishTwoScopes netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.004%]
  • ignore execution_time [-1.031ms; +3.067ms] or [-0.518%; +1.541%]
  • ignore throughput [+20396.496op/s; +30027.246op/s] or [+4.565%; +6.721%]

scenario:Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.006%]
  • ignore execution_time [-252.103µs; +787.420µs] or [-0.126%; +0.392%]
  • ignore throughput [-26044.972op/s; -21624.539op/s] or [-3.812%; -3.165%]

scenario:Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.007%]
  • ignore execution_time [-1500.593µs; +2008.155µs] or [-0.751%; +1.004%]
  • 🟩 throughput [+57587.824op/s; +76187.238op/s] or [+6.434%; +8.512%]

scenario:Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.005%]
  • ignore execution_time [+1.444ms; +5.347ms] or [+0.733%; +2.716%]
  • ignore throughput [+22002.269op/s; +36507.050op/s] or [+3.072%; +5.097%]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:builds project files, build scripts, pipelines, versioning, releases, packages

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants