Disallow compare-mode=nll test differences

[jackh726]

This ensures that new tests don't get added not as revisions if they have nll output. This will make stabilization PR easier.

r? @Mark-Simulacrum

[jackh726]

@Mark-Simulacrum this is ready for review :)

[Mark-Simulacrum]

@bors r+ rollup=iffy

[bors]

📌 Commit 2c75eca has been approved by Mark-Simulacrum

[bors]

⌛ Testing commit 2c75eca with merge 7668bedeea66c6b840f92309fc439781a3e38cdf...

[rust-log-analyzer]

The job x86_64-apple-2 failed! Check out the build log: (web) (plain)

Click to see the possible cause of the failure (guessed by this bot)

      Memory: 14 GB
      System Firmware Version: VMW71.00V.13989454.B64.1906190538
      Apple ROM Info: [MS_VM_CERT/SHA1/27d66596a61c48dd3dc7216fd715126e33f59ae7]Welcome to the Virtual Machine
      SMC Version (system): 2.8f0
      Serial Number (system): VMzEydMr2vHT
      Provisioning UDID: 4203018E-580F-C1B5-9525-B745CECA79EB

hw.ncpu: 3
hw.byteorder: 1234
---
failures:

---- [ui] src/test/ui/abi/abi-sysv64-register-usage.rs stdout ----

error: test compilation failed although it shouldn't!
status: signal: 9
command: "/Users/runner/work/rust/rust/build/x86_64-apple-darwin/stage2/bin/rustc" "/Users/runner/work/rust/rust/src/test/ui/abi/abi-sysv64-register-usage.rs" "-Zthreads=1" "--target=x86_64-apple-darwin" "--error-format" "json" "--json" "future-incompat" "-Ccodegen-units=1" "-Zui-testing" "-Zdeduplicate-diagnostics=no" "-C" "prefer-dynamic" "-o" "/Users/runner/work/rust/rust/build/x86_64-apple-darwin/test/ui/abi/abi-sysv64-register-usage/a" "-Crpath" "-O" "-Cdebuginfo=0" "-Lnative=/Users/runner/work/rust/rust/build/x86_64-apple-darwin/native/rust-test-helpers" "-L" "/Users/runner/work/rust/rust/build/x86_64-apple-darwin/test/ui/abi/abi-sysv64-register-usage/auxiliary"
stdout: none
stderr: none


failures:
    [ui] src/test/ui/abi/abi-sysv64-register-usage.rs

[bors]

💔 Test failed - checks-actions

[jackh726]

@bors retry seems unrelated

[bors]

⌛ Testing commit 2c75eca with merge b8d0cd8...

[bors]

☀️ Test successful - checks-actions
Approved by: Mark-Simulacrum
Pushing b8d0cd8 to master...

[rust-timer]

Finished benchmarking commit (b8d0cd8): comparison url.

Instruction count

This benchmark run did not return any relevant results for this metric.

Max RSS (memory usage)

Results

• Primary benchmarks: 🎉 relevant improvement found
• Secondary benchmarks: mixed results

	Regressions 😿 (primary)	Regressions 😿 (secondary)	Improvements 🎉 (primary)	Improvements 🎉 (secondary)	All 😿 🎉 (primary)
count1	0	2	1	4	1
mean2	N/A	1.3%	-2.5%	-1.3%	-2.5%
max	N/A	1.4%	-2.5%	-1.5%	-2.5%

Cycles

Results

• Primary benchmarks: 🎉 relevant improvements found
• Secondary benchmarks: mixed results

	Regressions 😿 (primary)	Regressions 😿 (secondary)	Improvements 🎉 (primary)	Improvements 🎉 (secondary)	All 😿 🎉 (primary)
count1	0	1	2	4	2
mean2	N/A	7.7%	-2.3%	-2.2%	-2.3%
max	N/A	7.7%	-2.5%	-2.6%	-2.5%

If you disagree with this performance assessment, please file an issue in rust-lang/rustc-perf.

@rustbot label: -perf-regression

Footnotes

1. number of relevant changes ↩ ↩²

2. the arithmetic mean of the percent change ↩ ↩²