Template engine tests hitting known parallelism issue in GetVisualStudioInstances

[marcpopMSFT]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=869444
Build error leg or test failing: Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewInstantiateTests.CanInstantiateTemplate_WithConditions_BasedOnFileName
Pull request: #44859

Error Message

{
  "ErrorMessage": "57005",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=869444
Error message validated: [57005]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 11/14/2024 7:41:30 PM UTC

Report

Build	Definition	Step Name	Console log	Pull Request
2948538	dotnet-sdk	Build	Log	#59726
1374109	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53807
1373820	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53759
1373592	dotnet/sdk	🟣 Build	Log	#53802
1371905	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53760
2946887	dotnet-sdk	🟣 Build	Log
1371157	dotnet/sdk	🟣 Build	Log	#53762
2946370	dotnet-sdk	Build	Log	#59726
1368022	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53665
1369430	dotnet/sdk	Run TestBuild Tests	Log	#53728
1369027	dotnet/sdk	Run TestBuild Tests	Log	#53739
2945171	dotnet-sdk	Build	Log
2945169	dotnet-sdk	Build	Log
1364970	dotnet/sdk	Run TestBuild Tests	Log	#53542
1364714	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53680
1364252	dotnet/sdk	Sync repo into VMR (Unix)	Log	#53181
2941860	dotnet-sdk	Run FullFramework Tests	Log	#59580
2941751	dotnet-sdk	Run Tests in Helix	Log	#59725
1360283	dotnet/sdk	🟣 Run TestBuild Tests	Log	#52396
1358723	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53620
1356167	dotnet/sdk	🟣 Build	Log	#53611
1355113	dotnet/sdk	🟣 Run FullFramework Tests	Log	#52930
1354404	dotnet/sdk	Sync repo into VMR (Windows)	Log	#53580
1354223	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53597
1354254	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53608
2936968	dotnet-sdk	Build	Log
1353317	dotnet/sdk	🟣 Build	Log	#53547
1352962	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53518
1352188	dotnet/sdk	🟣 Run FullFramework Tests	Log	#52930
1351629	dotnet/sdk	🟣 Build	Log	#53580
1351533	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53581
1349440	dotnet/sdk	🟣 Build	Log	#53555
1349011	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53350
2931771	dotnet-sdk	Build	Log	#59223
2931770	dotnet-sdk	Build	Log	#59224
1345553	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53546
2931381	dotnet-sdk	Run Tests in Helix	Log	#59224
2931382	dotnet-sdk	Run Tests in Helix	Log	#59223
1342737	dotnet/sdk	🟣 Build	Log	#53504
1342631	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53510
1340246	dotnet/sdk	🟣 Build	Log	#53499
1342286	dotnet/sdk	Run Tests in Helix	Log	#53529
1341747	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53517
1340537	dotnet/sdk	🟣 Build	Log	#53510
1339118	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53487
1338351	dotnet/sdk	🟣 Run FullFramework Tests	Log	#53452
2926416	dotnet-sdk	Run Tests in Helix	Log	#58634
1333988	dotnet/sdk	🟣 Build	Log	#53350
1333687	dotnet/sdk	🟣 Build	Log	#53263

Build	Definition	Test	Pull Request
1354629	dotnet/sdk	dotnet-new.IntegrationTests.dll.8.WorkItemExecution	#53613

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	13	50

[BrennanConroy]

Template engine tests hitting known parallelism issue in GetVisualStudioInstances

Is there an issue describing the problem? Are there people working on fixing it? We're hitting this in the aspnetcore repo a lot and as far as I'm aware we don't do anything with UWP which is how the sdk resolved the problem.

[baronfel]

@jaredpar sent a PR here with a short-term workaround that we're working to merge: #44930

The 'true' fix is coming in a future VS release, there was some unintended concurrent access to a critical section that wasn't locked.

[tmat]

@baronfel @jaredpar should this issue be closed?

[baronfel]

I don't think so - the tracker is still making recent edits, which impliies it's still being hit.

[tmat]

So the fix above didn't fix it?