Skip to content

add dummy file#8443

Draft
igoragoli wants to merge 1 commit intomasterfrom
augusto/test-fix
Draft

add dummy file#8443
igoragoli wants to merge 1 commit intomasterfrom
augusto/test-fix

Conversation

@igoragoli
Copy link
Copy Markdown
Contributor

Summary of changes

Reason for change

Implementation details

Test coverage

Other details

@dd-trace-dotnet-ci-bot
Copy link
Copy Markdown

Execution-Time Benchmarks Report ⏱️

Execution-time results for samples comparing This PR (8443) and master.

✅ No regressions detected - check the details below

Full Metrics Comparison

FakeDbCommand

Metric Master (Mean ± 95% CI) Current (Mean ± 95% CI) Change Status
.NET Framework 4.8 - Baseline
duration71.39 ± (71.35 - 71.69) ms72.01 ± (71.86 - 72.20) ms+0.9%✅⬆️
.NET Framework 4.8 - Bailout
duration75.97 ± (75.92 - 76.25) ms75.50 ± (75.32 - 75.74) ms-0.6%
.NET Framework 4.8 - CallTarget+Inlining+NGEN
duration1062.42 ± (1063.05 - 1069.02) ms1059.98 ± (1061.44 - 1065.93) ms-0.2%
.NET Core 3.1 - Baseline
process.internal_duration_ms22.14 ± (22.10 - 22.18) ms22.15 ± (22.12 - 22.17) ms+0.0%✅⬆️
process.time_to_main_ms82.69 ± (82.50 - 82.87) ms82.74 ± (82.56 - 82.92) ms+0.1%✅⬆️
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed10.92 ± (10.91 - 10.92) MB10.92 ± (10.91 - 10.92) MB+0.0%✅⬆️
runtime.dotnet.threads.count12 ± (12 - 12)12 ± (12 - 12)+0.0%
.NET Core 3.1 - Bailout
process.internal_duration_ms22.13 ± (22.10 - 22.17) ms22.07 ± (22.05 - 22.09) ms-0.3%
process.time_to_main_ms84.10 ± (83.88 - 84.31) ms83.74 ± (83.57 - 83.91) ms-0.4%
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed10.96 ± (10.95 - 10.96) MB10.95 ± (10.95 - 10.96) MB-0.0%
runtime.dotnet.threads.count13 ± (13 - 13)13 ± (13 - 13)+0.0%
.NET Core 3.1 - CallTarget+Inlining+NGEN
process.internal_duration_ms225.34 ± (224.22 - 226.47) ms222.50 ± (221.44 - 223.55) ms-1.3%
process.time_to_main_ms518.49 ± (517.34 - 519.63) ms517.62 ± (516.49 - 518.75) ms-0.2%
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed48.46 ± (48.43 - 48.49) MB48.44 ± (48.42 - 48.46) MB-0.0%
runtime.dotnet.threads.count28 ± (28 - 28)28 ± (28 - 28)+0.0%
.NET 6 - Baseline
process.internal_duration_ms20.99 ± (20.96 - 21.03) ms20.86 ± (20.83 - 20.89) ms-0.6%
process.time_to_main_ms72.20 ± (72.02 - 72.37) ms71.71 ± (71.55 - 71.88) ms-0.7%
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed10.63 ± (10.63 - 10.63) MB10.62 ± (10.62 - 10.63) MB-0.1%
runtime.dotnet.threads.count10 ± (10 - 10)10 ± (10 - 10)+0.0%
.NET 6 - Bailout
process.internal_duration_ms20.81 ± (20.79 - 20.84) ms20.80 ± (20.77 - 20.84) ms-0.1%
process.time_to_main_ms72.29 ± (72.12 - 72.45) ms72.53 ± (72.37 - 72.69) ms+0.3%✅⬆️
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed10.72 ± (10.72 - 10.73) MB10.74 ± (10.74 - 10.74) MB+0.2%✅⬆️
runtime.dotnet.threads.count11 ± (11 - 11)11 ± (11 - 11)+0.0%
.NET 6 - CallTarget+Inlining+NGEN
process.internal_duration_ms384.26 ± (382.35 - 386.17) ms388.41 ± (386.26 - 390.56) ms+1.1%✅⬆️
process.time_to_main_ms519.43 ± (518.52 - 520.33) ms518.35 ± (517.39 - 519.31) ms-0.2%
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed49.91 ± (49.88 - 49.94) MB49.92 ± (49.89 - 49.95) MB+0.0%✅⬆️
runtime.dotnet.threads.count28 ± (28 - 28)28 ± (28 - 28)-0.1%
.NET 8 - Baseline
process.internal_duration_ms19.17 ± (19.14 - 19.20) ms19.20 ± (19.17 - 19.23) ms+0.2%✅⬆️
process.time_to_main_ms71.18 ± (71.04 - 71.32) ms71.00 ± (70.87 - 71.13) ms-0.3%
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed7.71 ± (7.70 - 7.71) MB7.68 ± (7.67 - 7.69) MB-0.3%
runtime.dotnet.threads.count10 ± (10 - 10)10 ± (10 - 10)+0.0%
.NET 8 - Bailout
process.internal_duration_ms19.01 ± (18.98 - 19.05) ms19.12 ± (19.09 - 19.14) ms+0.5%✅⬆️
process.time_to_main_ms71.92 ± (71.77 - 72.07) ms72.09 ± (71.98 - 72.20) ms+0.2%✅⬆️
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed7.74 ± (7.74 - 7.75) MB7.71 ± (7.71 - 7.72) MB-0.4%
runtime.dotnet.threads.count11 ± (11 - 11)11 ± (11 - 11)+0.0%
.NET 8 - CallTarget+Inlining+NGEN
process.internal_duration_ms305.31 ± (303.20 - 307.41) ms304.67 ± (302.52 - 306.83) ms-0.2%
process.time_to_main_ms476.74 ± (475.90 - 477.57) ms479.92 ± (479.14 - 480.70) ms+0.7%✅⬆️
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed37.08 ± (37.06 - 37.10) MB37.02 ± (37.00 - 37.05) MB-0.2%
runtime.dotnet.threads.count27 ± (27 - 27)27 ± (27 - 27)+0.1%✅⬆️

HttpMessageHandler

Metric Master (Mean ± 95% CI) Current (Mean ± 95% CI) Change Status
.NET Framework 4.8 - Baseline
duration190.88 ± (190.80 - 191.52) ms191.17 ± (191.07 - 191.69) ms+0.2%✅⬆️
.NET Framework 4.8 - Bailout
duration194.55 ± (194.52 - 194.87) ms194.96 ± (194.85 - 195.27) ms+0.2%✅⬆️
.NET Framework 4.8 - CallTarget+Inlining+NGEN
duration1136.55 ± (1137.88 - 1143.80) ms1142.31 ± (1146.95 - 1154.33) ms+0.5%✅⬆️
.NET Core 3.1 - Baseline
process.internal_duration_ms185.18 ± (184.88 - 185.48) ms186.91 ± (186.63 - 187.20) ms+0.9%✅⬆️
process.time_to_main_ms79.73 ± (79.57 - 79.88) ms80.59 ± (80.39 - 80.79) ms+1.1%✅⬆️
runtime.dotnet.exceptions.count3 ± (3 - 3)3 ± (3 - 3)+0.0%
runtime.dotnet.mem.committed16.13 ± (16.10 - 16.15) MB16.19 ± (16.15 - 16.23) MB+0.4%✅⬆️
runtime.dotnet.threads.count20 ± (19 - 20)20 ± (20 - 20)+0.8%✅⬆️
.NET Core 3.1 - Bailout
process.internal_duration_ms184.85 ± (184.65 - 185.04) ms185.80 ± (185.58 - 186.01) ms+0.5%✅⬆️
process.time_to_main_ms81.05 ± (80.95 - 81.15) ms81.65 ± (81.52 - 81.78) ms+0.7%✅⬆️
runtime.dotnet.exceptions.count3 ± (3 - 3)3 ± (3 - 3)+0.0%
runtime.dotnet.mem.committed16.15 ± (16.10 - 16.20) MB16.18 ± (16.16 - 16.21) MB+0.2%✅⬆️
runtime.dotnet.threads.count21 ± (20 - 21)21 ± (21 - 21)+0.7%✅⬆️
.NET Core 3.1 - CallTarget+Inlining+NGEN
process.internal_duration_ms391.78 ± (390.52 - 393.03) ms394.18 ± (392.99 - 395.38) ms+0.6%✅⬆️
process.time_to_main_ms505.19 ± (504.19 - 506.20) ms509.31 ± (508.35 - 510.26) ms+0.8%✅⬆️
runtime.dotnet.exceptions.count3 ± (3 - 3)3 ± (3 - 3)+0.0%
runtime.dotnet.mem.committed58.71 ± (58.50 - 58.91) MB58.90 ± (58.71 - 59.10) MB+0.3%✅⬆️
runtime.dotnet.threads.count30 ± (30 - 30)30 ± (30 - 30)-0.0%
.NET 6 - Baseline
process.internal_duration_ms190.44 ± (190.13 - 190.75) ms190.51 ± (190.27 - 190.75) ms+0.0%✅⬆️
process.time_to_main_ms69.75 ± (69.60 - 69.91) ms69.89 ± (69.73 - 70.05) ms+0.2%✅⬆️
runtime.dotnet.exceptions.count4 ± (4 - 4)4 ± (4 - 4)+0.0%
runtime.dotnet.mem.committed15.93 ± (15.76 - 16.11) MB16.20 ± (16.06 - 16.34) MB+1.7%✅⬆️
runtime.dotnet.threads.count18 ± (18 - 18)18 ± (18 - 19)+2.2%✅⬆️
.NET 6 - Bailout
process.internal_duration_ms189.27 ± (189.05 - 189.49) ms189.34 ± (189.13 - 189.56) ms+0.0%✅⬆️
process.time_to_main_ms70.60 ± (70.53 - 70.67) ms70.65 ± (70.57 - 70.73) ms+0.1%✅⬆️
runtime.dotnet.exceptions.count4 ± (4 - 4)4 ± (4 - 4)+0.0%
runtime.dotnet.mem.committed15.92 ± (15.75 - 16.09) MB15.90 ± (15.73 - 16.07) MB-0.1%
runtime.dotnet.threads.count19 ± (19 - 19)19 ± (19 - 19)-0.1%
.NET 6 - CallTarget+Inlining+NGEN
process.internal_duration_ms598.10 ± (595.54 - 600.66) ms599.83 ± (597.30 - 602.35) ms+0.3%✅⬆️
process.time_to_main_ms508.25 ± (507.47 - 509.02) ms512.70 ± (511.63 - 513.76) ms+0.9%✅⬆️
runtime.dotnet.exceptions.count4 ± (4 - 4)4 ± (4 - 4)+0.0%
runtime.dotnet.mem.committed61.49 ± (61.39 - 61.59) MB61.68 ± (61.58 - 61.78) MB+0.3%✅⬆️
runtime.dotnet.threads.count30 ± (30 - 30)30 ± (30 - 30)+0.0%✅⬆️
.NET 8 - Baseline
process.internal_duration_ms187.58 ± (187.30 - 187.86) ms188.64 ± (188.42 - 188.87) ms+0.6%✅⬆️
process.time_to_main_ms69.00 ± (68.86 - 69.13) ms69.39 ± (69.24 - 69.53) ms+0.6%✅⬆️
runtime.dotnet.exceptions.count4 ± (4 - 4)4 ± (4 - 4)+0.0%
runtime.dotnet.mem.committed11.77 ± (11.75 - 11.80) MB11.83 ± (11.80 - 11.85) MB+0.5%✅⬆️
runtime.dotnet.threads.count18 ± (18 - 18)18 ± (18 - 18)-0.2%
.NET 8 - Bailout
process.internal_duration_ms186.96 ± (186.71 - 187.20) ms187.79 ± (187.52 - 188.06) ms+0.4%✅⬆️
process.time_to_main_ms70.09 ± (70.01 - 70.17) ms70.40 ± (70.29 - 70.50) ms+0.4%✅⬆️
runtime.dotnet.exceptions.count4 ± (4 - 4)4 ± (4 - 4)+0.0%
runtime.dotnet.mem.committed11.60 ± (11.49 - 11.72) MB11.85 ± (11.81 - 11.89) MB+2.1%✅⬆️
runtime.dotnet.threads.count18 ± (18 - 19)19 ± (19 - 19)+3.8%✅⬆️
.NET 8 - CallTarget+Inlining+NGEN
process.internal_duration_ms516.44 ± (513.77 - 519.11) ms515.70 ± (512.79 - 518.61) ms-0.1%
process.time_to_main_ms468.89 ± (468.23 - 469.55) ms470.22 ± (469.59 - 470.84) ms+0.3%✅⬆️
runtime.dotnet.exceptions.count4 ± (4 - 4)4 ± (4 - 4)+0.0%
runtime.dotnet.mem.committed50.68 ± (50.65 - 50.71) MB50.73 ± (50.70 - 50.76) MB+0.1%✅⬆️
runtime.dotnet.threads.count30 ± (30 - 30)30 ± (30 - 30)-0.2%
Comparison explanation

Execution-time benchmarks measure the whole time it takes to execute a program, and are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are highlighted in **red**. The following thresholds were used for comparing the execution times:

  • Welch test with statistical test for significance of 5%
  • Only results indicating a difference greater than 5% and 5 ms are considered.

Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.

Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).

Duration charts
FakeDbCommand (.NET Framework 4.8)
gantt
    title Execution time (ms) FakeDbCommand (.NET Framework 4.8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8443) - mean (72ms)  : 70, 74
    master - mean (72ms)  : 69, 74

    section Bailout
    This PR (8443) - mean (76ms)  : 73, 78
    master - mean (76ms)  : 75, 78

    section CallTarget+Inlining+NGEN
    This PR (8443) - mean (1,064ms)  : 1032, 1095
    master - mean (1,066ms)  : 1023, 1110

Loading
FakeDbCommand (.NET Core 3.1)
gantt
    title Execution time (ms) FakeDbCommand (.NET Core 3.1)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8443) - mean (111ms)  : 108, 115
    master - mean (111ms)  : 108, 115

    section Bailout
    This PR (8443) - mean (112ms)  : 110, 115
    master - mean (113ms)  : 110, 116

    section CallTarget+Inlining+NGEN
    This PR (8443) - mean (778ms)  : 757, 798
    master - mean (783ms)  : 763, 803

Loading
FakeDbCommand (.NET 6)
gantt
    title Execution time (ms) FakeDbCommand (.NET 6)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8443) - mean (98ms)  : 95, 102
    master - mean (99ms)  : 95, 103

    section Bailout
    This PR (8443) - mean (99ms)  : 96, 103
    master - mean (99ms)  : 97, 102

    section CallTarget+Inlining+NGEN
    This PR (8443) - mean (933ms)  : 901, 966
    master - mean (931ms)  : 903, 960

Loading
FakeDbCommand (.NET 8)
gantt
    title Execution time (ms) FakeDbCommand (.NET 8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8443) - mean (98ms)  : 95, 100
    master - mean (98ms)  : 95, 101

    section Bailout
    This PR (8443) - mean (99ms)  : 97, 100
    master - mean (98ms)  : 96, 100

    section CallTarget+Inlining+NGEN
    This PR (8443) - mean (813ms)  : 780, 847
    master - mean (811ms)  : 778, 844

Loading
HttpMessageHandler (.NET Framework 4.8)
gantt
    title Execution time (ms) HttpMessageHandler (.NET Framework 4.8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8443) - mean (191ms)  : 188, 194
    master - mean (191ms)  : 188, 195

    section Bailout
    This PR (8443) - mean (195ms)  : 193, 197
    master - mean (195ms)  : 193, 196

    section CallTarget+Inlining+NGEN
    This PR (8443) - mean (1,151ms)  : 1098, 1204
    master - mean (1,141ms)  : 1097, 1185

Loading
HttpMessageHandler (.NET Core 3.1)
gantt
    title Execution time (ms) HttpMessageHandler (.NET Core 3.1)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8443) - mean (276ms)  : 272, 280
    master - mean (273ms)  : 269, 277

    section Bailout
    This PR (8443) - mean (276ms)  : 273, 278
    master - mean (274ms)  : 271, 277

    section CallTarget+Inlining+NGEN
    This PR (8443) - mean (930ms)  : 911, 948
    master - mean (925ms)  : 905, 944

Loading
HttpMessageHandler (.NET 6)
gantt
    title Execution time (ms) HttpMessageHandler (.NET 6)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8443) - mean (269ms)  : 265, 272
    master - mean (268ms)  : 265, 272

    section Bailout
    This PR (8443) - mean (268ms)  : 265, 271
    master - mean (268ms)  : 265, 270

    section CallTarget+Inlining+NGEN
    This PR (8443) - mean (1,143ms)  : 1112, 1175
    master - mean (1,136ms)  : 1093, 1179

Loading
HttpMessageHandler (.NET 8)
gantt
    title Execution time (ms) HttpMessageHandler (.NET 8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8443) - mean (267ms)  : 263, 272
    master - mean (267ms)  : 262, 271

    section Bailout
    This PR (8443) - mean (268ms)  : 264, 271
    master - mean (266ms)  : 263, 270

    section CallTarget+Inlining+NGEN
    This PR (8443) - mean (1,019ms)  : 965, 1073
    master - mean (1,018ms)  : 979, 1058

Loading

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant