Test DSM benchmark flakiness fixes by igoragoli · Pull Request #8470 · DataDog/dd-trace-dotnet

igoragoli · 2026-04-16T14:51:53Z

Summary of changes

Reason for change

Implementation details

Test coverage

Other details

pr-commenter · 2026-04-16T16:15:51Z

Benchmarks

Benchmark execution time: 2026-04-16 16:15:48

Comparing candidate commit ac3f80a in PR branch augusto/dd-trace-dotnet-dsm-flakiness with baseline commit 5f3c2a8 in branch master.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 27 metrics, 0 unstable metrics, 87 known flaky benchmarks.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

🟩 = significantly better candidate vs. baseline
🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

Known flaky benchmarks

These benchmarks are marked as flaky and will not trigger a failure. Modify FLAKY_BENCHMARKS_REGEX to control which benchmarks are marked as flaky.

scenario:Benchmarks.Trace.ActivityBenchmark.StartStopWithChild net472

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.008%; +0.005%]
ignore execution_time [-945.137µs; +42.613µs] or [-0.470%; +0.021%]
ignore throughput [-1215.155op/s; -759.420op/s] or [-1.441%; -0.900%]

scenario:Benchmarks.Trace.ActivityBenchmark.StartStopWithChild net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.007%]
ignore execution_time [-1811.808µs; +1686.001µs] or [-0.904%; +0.841%]
🟩 throughput [+7774.499op/s; +10018.890op/s] or [+6.535%; +8.421%]

scenario:Benchmarks.Trace.ActivityBenchmark.StartStopWithChild netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.003%; +0.007%]
ignore execution_time [+0.382ms; +2.598ms] or [+0.192%; +1.307%]
ignore throughput [-517.940op/s; +653.839op/s] or [-0.527%; +0.665%]

scenario:Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces net472

ignore allocated_mem [-20 bytes; -19 bytes] or [-0.613%; -0.600%]
🟥 execution_time [+299.732ms; +303.212ms] or [+148.738%; +150.464%]
ignore throughput [+18.078op/s; +21.851op/s] or [+3.253%; +3.931%]

scenario:Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.009%; +0.002%]
🟥 execution_time [+379.728ms; +383.253ms] or [+300.009%; +302.793%]
ignore throughput [+8.123op/s; +11.817op/s] or [+1.071%; +1.558%]

scenario:Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.009%; +0.002%]
🟥 execution_time [+395.170ms; +397.195ms] or [+349.711%; +351.502%]
ignore throughput [-9.744op/s; -4.767op/s] or [-1.376%; -0.673%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleMoreComplexBody net472

🟥 allocated_mem [+1.308KB; +1.308KB] or [+27.529%; +27.541%]
ignore execution_time [-558.221µs; +143.859µs] or [-0.279%; +0.072%]
ignore throughput [-4767.631op/s; -4355.864op/s] or [-3.709%; -3.389%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleMoreComplexBody net6.0

🟥 allocated_mem [+471 bytes; +472 bytes] or [+9.977%; +9.987%]
🟩 execution_time [-15.899ms; -11.728ms] or [-7.425%; -5.477%]
ignore throughput [+4968.973op/s; +7775.717op/s] or [+3.627%; +5.676%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleMoreComplexBody netcoreapp3.1

🟥 allocated_mem [+1.272KB; +1.272KB] or [+27.502%; +27.510%]
ignore execution_time [-10.020ms; -5.889ms] or [-4.771%; -2.804%]
ignore throughput [-2129.092op/s; +138.965op/s] or [-1.925%; +0.126%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleSimpleBody net472

🟥 allocated_mem [+1.307KB; +1.307KB] or [+105.746%; +105.759%]
ignore execution_time [-446.269µs; +243.667µs] or [-0.222%; +0.121%]
🟥 throughput [-231232.184op/s; -227693.976op/s] or [-23.610%; -23.249%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleSimpleBody net6.0

🟥 allocated_mem [+471 bytes; +472 bytes] or [+38.558%; +38.566%]
🟩 execution_time [-27.084ms; -22.220ms] or [-12.079%; -9.909%]
ignore throughput [-58753.111op/s; -35803.445op/s] or [-6.277%; -3.825%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleSimpleBody netcoreapp3.1

🟥 allocated_mem [+1.272KB; +1.272KB] or [+105.292%; +105.304%]
ignore execution_time [-1233.497µs; +3053.695µs] or [-0.616%; +1.524%]
🟥 throughput [-162832.174op/s; -146836.424op/s] or [-23.396%; -21.098%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorMoreComplexBody net472

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.007%; +0.003%]
ignore execution_time [-1044.713µs; -12.546µs] or [-0.521%; -0.006%]
ignore throughput [-1422.492op/s; -628.585op/s] or [-0.957%; -0.423%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorMoreComplexBody net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.003%]
ignore execution_time [-0.110ms; +3.388ms] or [-0.055%; +1.710%]
🟩 throughput [+10794.035op/s; +13757.674op/s] or [+6.868%; +8.754%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorMoreComplexBody netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.007%; +0.003%]
ignore execution_time [+2.079ms; +6.093ms] or [+1.060%; +3.107%]
🟩 throughput [+8778.844op/s; +11420.719op/s] or [+6.993%; +9.098%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorSimpleBody net472

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.008%; +0.004%]
ignore execution_time [-307.473µs; -110.176µs] or [-0.153%; -0.055%]
ignore throughput [+77810.767op/s; +96564.355op/s] or [+2.367%; +2.938%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorSimpleBody net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.008%]
ignore execution_time [-1.647ms; -0.858ms] or [-0.815%; -0.424%]
🟩 throughput [+483107.870op/s; +500828.106op/s] or [+16.109%; +16.700%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorSimpleBody netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.004%]
🟩 execution_time [-18.570ms; -14.180ms] or [-8.560%; -6.536%]
🟩 throughput [+199540.114op/s; +253909.152op/s] or [+7.920%; +10.078%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeArgs net472

ignore allocated_mem [+1 bytes; +4 bytes] or [+0.004%; +0.012%]
🟥 execution_time [+299.979ms; +300.569ms] or [+149.889%; +150.184%]
ignore throughput [+105.742op/s; +133.107op/s] or [+1.168%; +1.470%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeArgs net6.0

ignore allocated_mem [-1 bytes; +2 bytes] or [-0.004%; +0.008%]
🟥 execution_time [+301.101ms; +304.463ms] or [+151.846%; +153.541%]
ignore throughput [+172.536op/s; +387.375op/s] or [+1.320%; +2.963%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeArgs netcoreapp3.1

ignore allocated_mem [-1 bytes; +2 bytes] or [-0.004%; +0.008%]
🟥 execution_time [+299.788ms; +302.280ms] or [+151.010%; +152.265%]
ignore throughput [+93.861op/s; +220.511op/s] or [+0.906%; +2.129%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeLegacyArgs net472

ignore allocated_mem [+3 bytes; +4 bytes] or [+0.186%; +0.199%]
🟥 execution_time [+297.063ms; +297.699ms] or [+145.906%; +146.218%]
ignore throughput [+10.053op/s; +14.880op/s] or [+0.267%; +0.394%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeLegacyArgs net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.009%]
🟥 execution_time [+293.436ms; +295.508ms] or [+143.450%; +144.463%]
ignore throughput [+176.656op/s; +210.365op/s] or [+2.566%; +3.056%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeLegacyArgs netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.009%]
🟥 execution_time [+301.564ms; +303.148ms] or [+150.721%; +151.513%]
ignore throughput [+22.066op/s; +41.597op/s] or [+0.438%; +0.826%]

scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmark net472

ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
ignore execution_time [+4.095µs; +7.975µs] or [+0.841%; +1.637%]
ignore throughput [-32.790op/s; -16.846op/s] or [-1.597%; -0.820%]

scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmark net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.000%; +0.010%]
ignore execution_time [+11.986µs; +38.581µs] or [+2.749%; +8.849%]
ignore throughput [-191.947op/s; -72.268op/s] or [-8.345%; -3.142%]

scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmark netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.003%; +0.003%]
ignore execution_time [+8.156µs; +30.144µs] or [+1.747%; +6.459%]
ignore throughput [-148.365op/s; -67.477op/s] or [-6.849%; -3.115%]

scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmarkWithAttack net472

ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
ignore execution_time [-3.927µs; +0.181µs] or [-1.060%; +0.049%]
ignore throughput [-0.452op/s; +28.977op/s] or [-0.017%; +1.073%]

scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmarkWithAttack net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.003%; +0.007%]
🟥 execution_time [+24.630µs; +49.490µs] or [+7.863%; +15.800%]
🟥 throughput [-447.889op/s; -243.847op/s] or [-13.962%; -7.601%]

scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmarkWithAttack netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.003%; +0.003%]
ignore execution_time [-14.975µs; +7.371µs] or [-4.096%; +2.016%]
ignore throughput [-88.635op/s; +44.616op/s] or [-3.181%; +1.601%]

scenario:Benchmarks.Trace.AspNetCoreBenchmark.SendRequest net472

ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
🟥 execution_time [+299.725ms; +300.452ms] or [+149.593%; +149.957%]
ignore throughput [-1524257.118op/s; -955169.415op/s] or [-0.764%; -0.478%]

scenario:Benchmarks.Trace.AspNetCoreBenchmark.SendRequest net6.0

ignore allocated_mem [+117 bytes; +119 bytes] or [+0.654%; +0.665%]
🟥 execution_time [+408.330ms; +412.180ms] or [+443.667%; +447.850%]
🟩 throughput [+1223.793op/s; +1338.702op/s] or [+10.056%; +11.000%]

scenario:Benchmarks.Trace.AspNetCoreBenchmark.SendRequest netcoreapp3.1

ignore allocated_mem [+20 bytes; +22 bytes] or [+0.099%; +0.110%]
🟥 execution_time [+369.404ms; +373.203ms] or [+280.485%; +283.370%]
🟩 throughput [+651.159op/s; +849.515op/s] or [+6.304%; +8.224%]

scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces net472

ignore allocated_mem [+2.635KB; +2.639KB] or [+4.681%; +4.689%]
unstable execution_time [+314.406ms; +386.787ms] or [+144.561%; +177.841%]
🟥 throughput [-503.193op/s; -445.251op/s] or [-45.594%; -40.344%]

scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces net6.0

ignore allocated_mem [-1.273KB; -1.270KB] or [-3.001%; -2.996%]
unstable execution_time [+198.815ms; +332.036ms] or [+84.727%; +141.500%]
🟥 throughput [-744.247op/s; -660.827op/s] or [-49.642%; -44.077%]

scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces netcoreapp3.1

🟥 allocated_mem [+2.233KB; +2.236KB] or [+5.273%; +5.280%]
🟥 execution_time [+346.904ms; +355.747ms] or [+207.489%; +212.778%]
🟥 throughput [-428.956op/s; -392.535op/s] or [-29.868%; -27.332%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice net472

ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
ignore execution_time [-61.687µs; -43.886µs] or [-3.104%; -2.209%]
ignore throughput [+11.650op/s; +16.347op/s] or [+2.315%; +3.248%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
ignore execution_time [-5340.538ns; +4051.871ns] or [-0.367%; +0.278%]
ignore throughput [-1.793op/s; +2.660op/s] or [-0.261%; +0.387%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
ignore execution_time [-130.306µs; -103.524µs] or [-4.533%; -3.601%]
ignore throughput [+13.064op/s; +16.905op/s] or [+3.755%; +4.859%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSliceWithPool net472

ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
ignore execution_time [-9.976µs; -4.511µs] or [-0.862%; -0.390%]
ignore throughput [+3.466op/s; +7.571op/s] or [+0.401%; +0.877%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSliceWithPool net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
ignore execution_time [-53.240µs; -40.965µs] or [-4.938%; -3.799%]
ignore throughput [+37.502op/s; +48.700op/s] or [+4.044%; +5.251%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSliceWithPool netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
ignore execution_time [+4.148µs; +14.463µs] or [+0.222%; +0.775%]
ignore throughput [-4.075op/s; -1.139op/s] or [-0.761%; -0.213%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OriginalCharSlice net472

ignore allocated_mem [-43 bytes; +21 bytes] or [-0.007%; +0.003%]
ignore execution_time [+24.357µs; +42.392µs] or [+0.951%; +1.656%]
ignore throughput [-6.249op/s; -3.572op/s] or [-1.600%; -0.914%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OriginalCharSlice net6.0

ignore allocated_mem [-38 bytes; +46 bytes] or [-0.006%; +0.007%]
🟩 execution_time [-176.158µs; -140.158µs] or [-8.924%; -7.100%]
🟩 throughput [+40.456op/s; +50.267op/s] or [+7.986%; +9.923%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OriginalCharSlice netcoreapp3.1

ignore allocated_mem [-42 bytes; +23 bytes] or [-0.007%; +0.004%]
ignore execution_time [-135.889µs; -94.401µs] or [-3.446%; -2.394%]
ignore throughput [+6.491op/s; +9.128op/s] or [+2.559%; +3.600%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch net472

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.001%; +0.008%]
🟥 execution_time [+304.314ms; +305.759ms] or [+153.247%; +153.975%]
ignore throughput [-75.666op/s; +1881.553op/s] or [-0.024%; +0.605%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.004%]
🟥 execution_time [+299.393ms; +306.788ms] or [+150.026%; +153.732%]
ignore throughput [+25598.652op/s; +33153.222op/s] or [+4.036%; +5.227%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.004%]
🟥 execution_time [+301.076ms; +304.495ms] or [+151.248%; +152.965%]
ignore throughput [+20937.643op/s; +28679.021op/s] or [+4.411%; +6.041%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync net472

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.008%; +0.004%]
🟥 execution_time [+301.886ms; +303.777ms] or [+151.597%; +152.547%]
ignore throughput [+8126.205op/s; +10084.762op/s] or [+2.722%; +3.379%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.007%; +0.006%]
🟥 execution_time [+298.981ms; +305.435ms] or [+147.833%; +151.024%]
ignore throughput [+5798.664op/s; +14983.690op/s] or [+0.934%; +2.414%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.004%]
🟥 execution_time [+302.018ms; +305.531ms] or [+153.076%; +154.856%]
ignore throughput [+6252.161op/s; +14956.977op/s] or [+1.350%; +3.230%]

scenario:Benchmarks.Trace.GraphQLBenchmark.ExecuteAsync net472

ignore allocated_mem [+0 bytes; +1 bytes] or [+0.108%; +0.119%]
🟥 execution_time [+303.193ms; +305.009ms] or [+152.175%; +153.087%]
ignore throughput [-22325.118op/s; -18374.681op/s] or [-5.792%; -4.767%]

scenario:Benchmarks.Trace.GraphQLBenchmark.ExecuteAsync net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.006%]
🟥 execution_time [+300.769ms; +303.265ms] or [+149.906%; +151.150%]
🟩 throughput [+54511.325op/s; +59775.950op/s] or [+10.824%; +11.870%]

scenario:Benchmarks.Trace.GraphQLBenchmark.ExecuteAsync netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.006%]
🟥 execution_time [+300.282ms; +303.442ms] or [+149.388%; +150.960%]
ignore throughput [-9108.738op/s; -4051.164op/s] or [-2.156%; -0.959%]

scenario:Benchmarks.Trace.ILoggerBenchmark.EnrichedLog net472

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.003%; +0.006%]
ignore execution_time [-1.776ms; -0.950ms] or [-0.883%; -0.473%]
ignore throughput [-10410.560op/s; -9041.317op/s] or [-4.186%; -3.636%]

scenario:Benchmarks.Trace.ILoggerBenchmark.EnrichedLog net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.003%]
ignore execution_time [-14.501ms; -10.690ms] or [-6.743%; -4.971%]
🟩 throughput [+23279.780op/s; +30187.318op/s] or [+6.386%; +8.281%]

scenario:Benchmarks.Trace.ILoggerBenchmark.EnrichedLog netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.008%]
ignore execution_time [-0.593ms; +3.356ms] or [-0.297%; +1.684%]
ignore throughput [+3522.322op/s; +9175.678op/s] or [+1.286%; +3.349%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark net472

ignore allocated_mem [-4.459KB; -4.431KB] or [-1.623%; -1.613%]
unstable execution_time [+10.476µs; +51.095µs] or [+2.588%; +12.621%]
ignore throughput [-267.805op/s; -63.833op/s] or [-10.777%; -2.569%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark net6.0

🟩 allocated_mem [-20.317KB; -20.297KB] or [-7.411%; -7.404%]
unstable execution_time [-50.160µs; +1.517µs] or [-9.914%; +0.300%]
ignore throughput [+4.039op/s; +184.774op/s] or [+0.202%; +9.220%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark netcoreapp3.1

ignore allocated_mem [+1.487KB; +1.504KB] or [+0.542%; +0.548%]
ignore execution_time [-41.055µs; +15.736µs] or [-7.114%; +2.727%]
ignore throughput [-36.316op/s; +117.186op/s] or [-2.075%; +6.695%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark net472

ignore allocated_mem [-2 bytes; +2 bytes] or [-0.005%; +0.006%]
ignore execution_time [-96.207ns; +1366.873ns] or [-0.167%; +2.368%]
ignore throughput [-380.980op/s; +31.357op/s] or [-2.198%; +0.181%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark net6.0

ignore allocated_mem [-4 bytes; +0 bytes] or [-0.010%; -0.001%]
🟥 execution_time [+5.787µs; +9.652µs] or [+13.679%; +22.814%]
🟥 throughput [-4488.363op/s; -2752.695op/s] or [-18.895%; -11.588%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark netcoreapp3.1

ignore allocated_mem [-1 bytes; +1 bytes] or [-0.002%; +0.002%]
unstable execution_time [-13.983µs; -6.751µs] or [-21.694%; -10.474%]
🟩 throughput [+1743.168op/s; +3254.275op/s] or [+10.695%; +19.966%]

scenario:Benchmarks.Trace.Log4netBenchmark.EnrichedLog net472

ignore allocated_mem [+1 bytes; +2 bytes] or [+0.039%; +0.050%]
🟥 execution_time [+301.648ms; +303.179ms] or [+152.469%; +153.243%]
ignore throughput [-108.815op/s; -86.208op/s] or [-1.818%; -1.440%]

scenario:Benchmarks.Trace.Log4netBenchmark.EnrichedLog net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.005%]
🟥 execution_time [+302.758ms; +304.808ms] or [+154.103%; +155.146%]
ignore throughput [-118.279op/s; -43.936op/s] or [-1.467%; -0.545%]

scenario:Benchmarks.Trace.Log4netBenchmark.EnrichedLog netcoreapp3.1

ignore allocated_mem [-1 bytes; +0 bytes] or [-0.027%; -0.017%]
🟥 execution_time [+300.504ms; +302.317ms] or [+150.440%; +151.347%]
ignore throughput [-119.778op/s; -56.016op/s] or [-1.526%; -0.714%]

scenario:Benchmarks.Trace.RedisBenchmark.SendReceive net472

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.005%]
ignore execution_time [-1099.572µs; -639.009µs] or [-0.548%; -0.319%]
ignore throughput [-12341.173op/s; -10317.651op/s] or [-3.416%; -2.856%]

scenario:Benchmarks.Trace.RedisBenchmark.SendReceive net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.007%]
ignore execution_time [+571.234µs; +1211.530µs] or [+0.286%; +0.606%]
🟩 throughput [+49586.004op/s; +52574.552op/s] or [+9.386%; +9.951%]

scenario:Benchmarks.Trace.RedisBenchmark.SendReceive netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.006%]
ignore execution_time [+1.085ms; +4.743ms] or [+0.550%; +2.404%]
ignore throughput [+6401.682op/s; +14512.401op/s] or [+1.515%; +3.435%]

scenario:Benchmarks.Trace.SerilogBenchmark.EnrichedLog net472

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.006%]
🟥 execution_time [+300.818ms; +302.529ms] or [+149.931%; +150.783%]
ignore throughput [-1668.999op/s; -647.508op/s] or [-1.102%; -0.428%]

scenario:Benchmarks.Trace.SerilogBenchmark.EnrichedLog net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [+0.000%; +0.009%]
🟥 execution_time [+301.628ms; +302.656ms] or [+151.463%; +151.980%]
ignore throughput [+1467.534op/s; +3077.222op/s] or [+0.638%; +1.338%]

scenario:Benchmarks.Trace.SerilogBenchmark.EnrichedLog netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.003%]
🟥 execution_time [+303.063ms; +305.516ms] or [+153.694%; +154.938%]
ignore throughput [+312.351op/s; +2408.882op/s] or [+0.176%; +1.357%]

scenario:Benchmarks.Trace.SingleSpanAspNetCoreBenchmark.SingleSpanAspNetCore net472

ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
🟥 execution_time [+300.283ms; +300.963ms] or [+149.782%; +150.122%]
🟩 throughput [+44331311.564op/s; +53961411.631op/s] or [+32.285%; +39.298%]

scenario:Benchmarks.Trace.SingleSpanAspNetCoreBenchmark.SingleSpanAspNetCore net6.0

ignore allocated_mem [+64 bytes; +66 bytes] or [+0.376%; +0.385%]
unstable execution_time [+385.318ms; +415.610ms] or [+479.212%; +516.886%]
🟩 throughput [+1015.956op/s; +1193.395op/s] or [+7.854%; +9.226%]

scenario:Benchmarks.Trace.SingleSpanAspNetCoreBenchmark.SingleSpanAspNetCore netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
🟥 execution_time [+299.527ms; +300.455ms] or [+149.397%; +149.860%]
ignore throughput [+1776239.117op/s; +2714016.244op/s] or [+0.787%; +1.202%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishScope net472

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.006%]
ignore execution_time [+439.191µs; +935.259µs] or [+0.220%; +0.468%]
ignore throughput [-9653.432op/s; -5370.986op/s] or [-1.077%; -0.599%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishScope net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.007%]
ignore execution_time [-4.830ms; -3.520ms] or [-2.366%; -1.724%]
🟩 throughput [+69784.373op/s; +82908.151op/s] or [+6.516%; +7.741%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishScope netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.003%; +0.006%]
ignore execution_time [-1425.847µs; +2743.989µs] or [-0.721%; +1.388%]
🟩 throughput [+58983.758op/s; +78264.820op/s] or [+6.827%; +9.059%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishSpan net472

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.000%; +0.009%]
ignore execution_time [+386.181µs; +958.007µs] or [+0.193%; +0.479%]
ignore throughput [-18748.968op/s; -15018.613op/s] or [-1.716%; -1.375%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishSpan net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.004%]
ignore execution_time [+6.129ms; +10.231ms] or [+3.193%; +5.330%]
🟩 throughput [+77563.840op/s; +107960.057op/s] or [+6.004%; +8.356%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishSpan netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.001%; +0.008%]
ignore execution_time [-5.443ms; -3.965ms] or [-2.674%; -1.948%]
🟩 throughput [+83985.423op/s; +93610.626op/s] or [+8.341%; +9.297%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishTwoScopes net472

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.008%; +0.002%]
ignore execution_time [-660.360µs; +609.847µs] or [-0.329%; +0.304%]
ignore throughput [+9240.288op/s; +12475.688op/s] or [+2.059%; +2.780%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishTwoScopes net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.009%]
ignore execution_time [-687.810µs; +760.783µs] or [-0.343%; +0.380%]
🟩 throughput [+50947.080op/s; +55374.624op/s] or [+9.251%; +10.055%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishTwoScopes netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.004%]
ignore execution_time [-2441.068µs; +1694.760µs] or [-1.226%; +0.852%]
🟩 throughput [+25254.451op/s; +35030.110op/s] or [+5.653%; +7.841%]

scenario:Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin net472

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.006%]
ignore execution_time [-835.447µs; +130.884µs] or [-0.416%; +0.065%]
ignore throughput [-24243.699op/s; -20709.443op/s] or [-3.548%; -3.031%]

scenario:Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin net6.0

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.007%]
ignore execution_time [-1430.065µs; +2092.572µs] or [-0.715%; +1.047%]
🟩 throughput [+69559.291op/s; +86734.830op/s] or [+7.772%; +9.690%]

scenario:Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin netcoreapp3.1

ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.005%]
ignore execution_time [+1.309ms; +5.207ms] or [+0.665%; +2.644%]
🟩 throughput [+38414.765op/s; +53226.438op/s] or [+5.364%; +7.432%]

dd-trace-dotnet-ci-bot · 2026-04-16T16:30:15Z

Execution-Time Benchmarks Report ⏱️

Execution-time results for samples comparing This PR (8470) and master.

✅ No regressions detected - check the details below

Full Metrics Comparison

FakeDbCommand

Metric	Master (Mean ± 95% CI)	Current (Mean ± 95% CI)	Change	Status
.NET Framework 4.8 - Baseline
duration	73.97 ± (73.77 - 74.35) ms	72.42 ± (72.49 - 72.84) ms	-2.1%	✅
.NET Framework 4.8 - Bailout
duration	77.65 ± (77.55 - 78.02) ms	79.25 ± (79.11 - 79.68) ms	+2.1%	✅⬆️
.NET Framework 4.8 - CallTarget+Inlining+NGEN
duration	1070.45 ± (1070.90 - 1076.81) ms	1076.83 ± (1075.81 - 1081.43) ms	+0.6%	✅⬆️
.NET Core 3.1 - Baseline
process.internal_duration_ms	22.77 ± (22.70 - 22.83) ms	22.58 ± (22.52 - 22.63) ms	-0.8%	✅
process.time_to_main_ms	86.00 ± (85.68 - 86.31) ms	85.52 ± (85.21 - 85.82) ms	-0.6%	✅
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	10.91 ± (10.91 - 10.91) MB	10.92 ± (10.91 - 10.92) MB	+0.1%	✅⬆️
runtime.dotnet.threads.count	12 ± (12 - 12)	12 ± (12 - 12)	+0.0%	✅
.NET Core 3.1 - Bailout
process.internal_duration_ms	22.38 ± (22.35 - 22.41) ms	22.78 ± (22.72 - 22.84) ms	+1.8%	✅⬆️
process.time_to_main_ms	85.50 ± (85.28 - 85.71) ms	88.70 ± (88.41 - 89.00) ms	+3.7%	✅⬆️
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	10.95 ± (10.95 - 10.96) MB	10.95 ± (10.95 - 10.95) MB	-0.0%	✅
runtime.dotnet.threads.count	13 ± (13 - 13)	13 ± (13 - 13)	+0.0%	✅
.NET Core 3.1 - CallTarget+Inlining+NGEN
process.internal_duration_ms	229.67 ± (228.36 - 230.99) ms	229.43 ± (228.46 - 230.39) ms	-0.1%	✅
process.time_to_main_ms	525.99 ± (524.79 - 527.19) ms	527.50 ± (526.15 - 528.84) ms	+0.3%	✅⬆️
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	48.49 ± (48.46 - 48.52) MB	48.49 ± (48.46 - 48.51) MB	-0.0%	✅
runtime.dotnet.threads.count	28 ± (28 - 28)	28 ± (28 - 28)	+0.0%	✅
.NET 6 - Baseline
process.internal_duration_ms	21.49 ± (21.43 - 21.55) ms	21.22 ± (21.17 - 21.27) ms	-1.3%	✅
process.time_to_main_ms	74.95 ± (74.62 - 75.27) ms	73.84 ± (73.60 - 74.09) ms	-1.5%	✅
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	10.62 ± (10.62 - 10.62) MB	10.63 ± (10.63 - 10.64) MB	+0.1%	✅⬆️
runtime.dotnet.threads.count	10 ± (10 - 10)	10 ± (10 - 10)	+0.0%	✅
.NET 6 - Bailout
process.internal_duration_ms	21.07 ± (21.03 - 21.10) ms	21.48 ± (21.42 - 21.54) ms	+1.9%	✅⬆️
process.time_to_main_ms	74.14 ± (73.96 - 74.32) ms	77.28 ± (76.98 - 77.57) ms	+4.2%	✅⬆️
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	10.71 ± (10.71 - 10.72) MB	10.74 ± (10.74 - 10.75) MB	+0.3%	✅⬆️
runtime.dotnet.threads.count	11 ± (11 - 11)	11 ± (11 - 11)	+0.0%	✅
.NET 6 - CallTarget+Inlining+NGEN
process.internal_duration_ms	384.84 ± (383.04 - 386.63) ms	385.35 ± (383.57 - 387.13) ms	+0.1%	✅⬆️
process.time_to_main_ms	526.54 ± (525.42 - 527.66) ms	529.90 ± (528.72 - 531.08) ms	+0.6%	✅⬆️
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	50.01 ± (49.98 - 50.03) MB	50.05 ± (50.03 - 50.08) MB	+0.1%	✅⬆️
runtime.dotnet.threads.count	28 ± (28 - 28)	28 ± (28 - 28)	+0.1%	✅⬆️
.NET 8 - Baseline
process.internal_duration_ms	19.35 ± (19.30 - 19.39) ms	19.47 ± (19.44 - 19.50) ms	+0.6%	✅⬆️
process.time_to_main_ms	72.52 ± (72.29 - 72.75) ms	72.49 ± (72.32 - 72.66) ms	-0.0%	✅
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	7.67 ± (7.66 - 7.68) MB	7.64 ± (7.64 - 7.64) MB	-0.4%	✅
runtime.dotnet.threads.count	10 ± (10 - 10)	10 ± (10 - 10)	+0.0%	✅
.NET 8 - Bailout
process.internal_duration_ms	19.60 ± (19.56 - 19.65) ms	19.42 ± (19.38 - 19.46) ms	-0.9%	✅
process.time_to_main_ms	74.75 ± (74.52 - 74.99) ms	73.62 ± (73.45 - 73.78) ms	-1.5%	✅
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	7.71 ± (7.70 - 7.71) MB	7.70 ± (7.70 - 7.71) MB	-0.1%	✅
runtime.dotnet.threads.count	11 ± (11 - 11)	11 ± (11 - 11)	+0.0%	✅
.NET 8 - CallTarget+Inlining+NGEN
process.internal_duration_ms	304.85 ± (302.54 - 307.15) ms	305.59 ± (303.34 - 307.85) ms	+0.2%	✅⬆️
process.time_to_main_ms	487.76 ± (486.79 - 488.73) ms	491.77 ± (490.45 - 493.09) ms	+0.8%	✅⬆️
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	37.04 ± (37.02 - 37.06) MB	37.10 ± (37.08 - 37.13) MB	+0.2%	✅⬆️
runtime.dotnet.threads.count	27 ± (27 - 27)	27 ± (27 - 27)	+0.2%	✅⬆️

HttpMessageHandler

Metric	Master (Mean ± 95% CI)	Current (Mean ± 95% CI)	Change	Status
.NET Framework 4.8 - Baseline
duration	206.01 ± (205.64 - 206.47) ms	211.23 ± (211.03 - 212.03) ms	+2.5%	✅⬆️
.NET Framework 4.8 - Bailout
duration	209.66 ± (209.35 - 210.27) ms	216.16 ± (215.78 - 216.78) ms	+3.1%	✅⬆️
.NET Framework 4.8 - CallTarget+Inlining+NGEN
duration	1204.02 ± (1202.96 - 1208.28) ms	1234.03 ± (1231.13 - 1238.62) ms	+2.5%	✅⬆️
.NET Core 3.1 - Baseline
process.internal_duration_ms	201.91 ± (201.51 - 202.30) ms	205.15 ± (204.69 - 205.62) ms	+1.6%	✅⬆️
process.time_to_main_ms	88.21 ± (87.88 - 88.53) ms	90.98 ± (90.64 - 91.32) ms	+3.1%	✅⬆️
runtime.dotnet.exceptions.count	3 ± (3 - 3)	3 ± (3 - 3)	+0.0%	✅
runtime.dotnet.mem.committed	16.06 ± (16.04 - 16.08) MB	15.93 ± (15.91 - 15.95) MB	-0.8%	✅
runtime.dotnet.threads.count	20 ± (20 - 20)	20 ± (20 - 20)	+0.3%	✅⬆️
.NET Core 3.1 - Bailout
process.internal_duration_ms	201.38 ± (201.02 - 201.74) ms	203.44 ± (202.99 - 203.88) ms	+1.0%	✅⬆️
process.time_to_main_ms	89.09 ± (88.89 - 89.30) ms	91.61 ± (91.35 - 91.86) ms	+2.8%	✅⬆️
runtime.dotnet.exceptions.count	3 ± (3 - 3)	3 ± (3 - 3)	+0.0%	✅
runtime.dotnet.mem.committed	16.13 ± (16.11 - 16.16) MB	15.97 ± (15.95 - 15.99) MB	-1.0%	✅
runtime.dotnet.threads.count	21 ± (21 - 21)	21 ± (21 - 21)	-0.8%	✅
.NET Core 3.1 - CallTarget+Inlining+NGEN
process.internal_duration_ms	414.22 ± (413.18 - 415.26) ms	419.82 ± (418.34 - 421.30) ms	+1.4%	✅⬆️
process.time_to_main_ms	546.24 ± (545.22 - 547.27) ms	552.11 ± (550.41 - 553.81) ms	+1.1%	✅⬆️
runtime.dotnet.exceptions.count	3 ± (3 - 3)	3 ± (3 - 3)	+0.0%	✅
runtime.dotnet.mem.committed	59.40 ± (59.36 - 59.43) MB	59.35 ± (59.30 - 59.39) MB	-0.1%	✅
runtime.dotnet.threads.count	30 ± (30 - 30)	30 ± (30 - 30)	+0.5%	✅⬆️
.NET 6 - Baseline
process.internal_duration_ms	207.99 ± (207.61 - 208.37) ms	210.54 ± (210.11 - 210.97) ms	+1.2%	✅⬆️
process.time_to_main_ms	77.20 ± (76.97 - 77.42) ms	78.91 ± (78.60 - 79.22) ms	+2.2%	✅⬆️
runtime.dotnet.exceptions.count	4 ± (4 - 4)	4 ± (4 - 4)	+0.0%	✅
runtime.dotnet.mem.committed	16.24 ± (16.23 - 16.26) MB	16.18 ± (16.16 - 16.21) MB	-0.4%	✅
runtime.dotnet.threads.count	19 ± (19 - 19)	19 ± (19 - 20)	+0.2%	✅⬆️
.NET 6 - Bailout
process.internal_duration_ms	206.59 ± (206.28 - 206.90) ms	210.50 ± (210.06 - 210.94) ms	+1.9%	✅⬆️
process.time_to_main_ms	77.82 ± (77.62 - 78.03) ms	80.26 ± (80.02 - 80.50) ms	+3.1%	✅⬆️
runtime.dotnet.exceptions.count	4 ± (4 - 4)	4 ± (4 - 4)	+0.0%	✅
runtime.dotnet.mem.committed	16.26 ± (16.24 - 16.29) MB	16.23 ± (16.21 - 16.25) MB	-0.2%	✅
runtime.dotnet.threads.count	21 ± (20 - 21)	20 ± (20 - 21)	-0.2%	✅
.NET 6 - CallTarget+Inlining+NGEN
process.internal_duration_ms	601.62 ± (598.96 - 604.28) ms	599.54 ± (597.18 - 601.91) ms	-0.3%	✅
process.time_to_main_ms	543.00 ± (541.68 - 544.31) ms	550.65 ± (549.35 - 551.95) ms	+1.4%	✅⬆️
runtime.dotnet.exceptions.count	4 ± (4 - 4)	4 ± (4 - 4)	+0.0%	✅
runtime.dotnet.mem.committed	61.96 ± (61.87 - 62.05) MB	61.82 ± (61.72 - 61.92) MB	-0.2%	✅
runtime.dotnet.threads.count	31 ± (31 - 31)	31 ± (31 - 31)	+0.4%	✅⬆️
.NET 8 - Baseline
process.internal_duration_ms	205.30 ± (204.84 - 205.76) ms	208.65 ± (208.22 - 209.09) ms	+1.6%	✅⬆️
process.time_to_main_ms	76.22 ± (75.94 - 76.51) ms	77.57 ± (77.33 - 77.81) ms	+1.8%	✅⬆️
runtime.dotnet.exceptions.count	4 ± (4 - 4)	4 ± (4 - 4)	+0.0%	✅
runtime.dotnet.mem.committed	11.66 ± (11.64 - 11.68) MB	11.53 ± (11.51 - 11.55) MB	-1.1%	✅
runtime.dotnet.threads.count	19 ± (19 - 19)	19 ± (19 - 19)	+0.2%	✅⬆️
.NET 8 - Bailout
process.internal_duration_ms	204.63 ± (204.23 - 205.03) ms	208.02 ± (207.60 - 208.44) ms	+1.7%	✅⬆️
process.time_to_main_ms	77.37 ± (77.15 - 77.59) ms	78.79 ± (78.57 - 79.00) ms	+1.8%	✅⬆️
runtime.dotnet.exceptions.count	4 ± (4 - 4)	4 ± (4 - 4)	+0.0%	✅
runtime.dotnet.mem.committed	11.71 ± (11.69 - 11.73) MB	11.66 ± (11.64 - 11.67) MB	-0.4%	✅
runtime.dotnet.threads.count	20 ± (20 - 20)	20 ± (20 - 20)	+0.6%	✅⬆️
.NET 8 - CallTarget+Inlining+NGEN
process.internal_duration_ms	524.81 ± (520.16 - 529.45) ms	533.58 ± (527.16 - 540.01) ms	+1.7%	✅⬆️
process.time_to_main_ms	504.18 ± (503.25 - 505.12) ms	514.43 ± (513.63 - 515.24) ms	+2.0%	✅⬆️
runtime.dotnet.exceptions.count	4 ± (4 - 4)	4 ± (4 - 4)	+0.0%	✅
runtime.dotnet.mem.committed	50.69 ± (50.64 - 50.75) MB	50.78 ± (50.71 - 50.86) MB	+0.2%	✅⬆️
runtime.dotnet.threads.count	30 ± (30 - 30)	30 ± (30 - 30)	-0.1%	✅

Comparison explanation

Execution-time benchmarks measure the whole time it takes to execute a program, and are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are highlighted in **red**. The following thresholds were used for comparing the execution times:

Welch test with statistical test for significance of 5%
Only results indicating a difference greater than 5% and 5 ms are considered.

Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.

Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).

Duration charts

FakeDbCommand (.NET Framework 4.8)

gantt
    title Execution time (ms) FakeDbCommand (.NET Framework 4.8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8470) - mean (73ms)  : 70, 75
    master - mean (74ms)  : 70, 79

    section Bailout
    This PR (8470) - mean (79ms)  : 75, 84
    master - mean (78ms)  : 74, 81

    section CallTarget+Inlining+NGEN
    This PR (8470) - mean (1,079ms)  : 1038, 1119
    master - mean (1,074ms)  : 1032, 1116

FakeDbCommand (.NET Core 3.1)

gantt
    title Execution time (ms) FakeDbCommand (.NET Core 3.1)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8470) - mean (115ms)  : 109, 122
    master - mean (116ms)  : 109, 122

    section Bailout
    This PR (8470) - mean (119ms)  : 113, 124
    master - mean (115ms)  : 111, 119

    section CallTarget+Inlining+NGEN
    This PR (8470) - mean (794ms)  : 769, 819
    master - mean (793ms)  : 771, 814

FakeDbCommand (.NET 6)

gantt
    title Execution time (ms) FakeDbCommand (.NET 6)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8470) - mean (101ms)  : 97, 106
    master - mean (103ms)  : 97, 109

    section Bailout
    This PR (8470) - mean (106ms)  : 101, 111
    master - mean (102ms)  : 97, 106

    section CallTarget+Inlining+NGEN
    This PR (8470) - mean (943ms)  : 906, 980
    master - mean (938ms)  : 906, 970

FakeDbCommand (.NET 8)

gantt
    title Execution time (ms) FakeDbCommand (.NET 8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8470) - mean (100ms)  : 96, 103
    master - mean (99ms)  : 95, 104

    section Bailout
    This PR (8470) - mean (101ms)  : 99, 103
    master - mean (102ms)  : 97, 107

    section CallTarget+Inlining+NGEN
    This PR (8470) - mean (828ms)  : 791, 865
    master - mean (825ms)  : 775, 875

HttpMessageHandler (.NET Framework 4.8)

gantt
    title Execution time (ms) HttpMessageHandler (.NET Framework 4.8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8470) - mean (212ms)  : 207, 216
    master - mean (206ms)  : 202, 210

    section Bailout
    This PR (8470) - mean (216ms)  : 211, 221
    master - mean (210ms)  : 205, 214

    section CallTarget+Inlining+NGEN
    This PR (8470) - mean (1,235ms)  : 1180, 1290
    master - mean (1,206ms)  : 1168, 1243

HttpMessageHandler (.NET Core 3.1)

gantt
    title Execution time (ms) HttpMessageHandler (.NET Core 3.1)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8470) - mean (306ms)  : 298, 313
    master - mean (299ms)  : 293, 305

    section Bailout
    This PR (8470) - mean (304ms)  : 299, 310
    master - mean (300ms)  : 295, 304

    section CallTarget+Inlining+NGEN
    This PR (8470) - mean (1,016ms)  : 989, 1042
    master - mean (997ms)  : 962, 1031

HttpMessageHandler (.NET 6)

gantt
    title Execution time (ms) HttpMessageHandler (.NET 6)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8470) - mean (298ms)  : 292, 305
    master - mean (294ms)  : 286, 302

    section Bailout
    This PR (8470) - mean (299ms)  : 293, 306
    master - mean (293ms)  : 288, 298

    section CallTarget+Inlining+NGEN
    This PR (8470) - mean (1,182ms)  : 1150, 1214
    master - mean (1,176ms)  : 1138, 1213

HttpMessageHandler (.NET 8)

gantt
    title Execution time (ms) HttpMessageHandler (.NET 8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8470) - mean (297ms)  : 289, 306
    master - mean (293ms)  : 285, 300

    section Bailout
    This PR (8470) - mean (297ms)  : 292, 303
    master - mean (293ms)  : 287, 298

    section CallTarget+Inlining+NGEN
    This PR (8470) - mean (1,081ms)  : 992, 1170
    master - mean (1,064ms)  : 997, 1131

ci: point DSM benchmark at flakiness-fix branch for testing

eb8d52f

igoragoli changed the title ~~ci: test DSM benchmark flakiness fixes~~ Test DSM benchmark flakiness fixes Apr 16, 2026

igoragoli added 2 commits April 16, 2026 17:06

test: when: always on trigger job to make my life easier

94b028b

test: no needs

ac3f80a

Conversation

igoragoli commented Apr 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!