The Operation will be canceled. The next steps may not contain expected logs.

[tarekgh]

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=696281

Build leg reported

Build / browser-wasm linux Release LibraryTests / Send to Helix

Pull Request

dotnet/runtime#103009

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The Operation will be canceled. The next steps may not contain expected logs.",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=696281
Error message validated: [The Operation will be canceled. The next steps may not contain expected logs.]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 6/4/2024 8:08:48 PM UTC

Report

Build	Definition	Step Name	Console log	Pull Request
1433098	dotnet/maui	Controls WebView	Log
1433120	dotnet/sdk	🟣 Run TestBuild Tests	Log	dotnet/sdk#54410
1433070	dotnet/aspnetcore	Run build.cmd helix target	Log
1433071	dotnet/performance	Send job to Helix (Windows)	Log
1433036	dotnet/sdk	🟣 Run TestBuild Tests	Log	dotnet/sdk#54415
1432992	dotnet/roslyn	Run Unit Tests	Log
1432988	dotnet/roslyn	Run Unit Tests	Log
1432928	dotnet/runtime	Checkout dotnet/runtime@refs/pull/128523/merge to s	Log	dotnet/runtime#128523
1432983	dotnet/runtime	Checkout dotnet/runtime@refs/pull/126947/merge to s	Log	dotnet/runtime#126947
1432976	dotnet/roslyn	Run Unit Tests	Log
1432820	dotnet/runtime	Send to Helix	Log	dotnet/runtime#127989
1432949	dotnet/aspnetcore	Run build.cmd helix target	Log
1432885	dotnet/runtime	Checkout dotnet/runtime@refs/pull/128522/merge to s	Log	dotnet/runtime#128522
1432954	dotnet/runtime	Checkout dotnet/runtime@refs/pull/128521/merge to s	Log	dotnet/runtime#128521
2982565	dotnet-maui	Run Integration Tests - RunOniOS_BlazorDebug	Log
2982591	dotnet-roslyn	Run Unit Tests	Log
1432910	dotnet/roslyn	Run Unit Tests	Log
1432865	dotnet/maui	DeviceTestsAndroid (Windows)	Log
1432790	dotnet/runtime	Send to Helix	Log
1432826	dotnet/runtime	Checkout dotnet/runtime@refs/pull/126947/merge to s	Log	dotnet/runtime#126947
1432716	dotnet/performance	Send job to Helix (Windows)	Log	dotnet/performance#5220
1432815	dotnet/aspnetcore	Run build.cmd helix target	Log
1432817	dotnet/performance	Send job to Helix (Windows)	Log
1432786	dotnet/runtime	Checkout dotnet/runtime@release/8.0 to s	Log
1432757	dotnet/roslyn	Checkout dotnet/roslyn@refs/pull/83397/merge to s	Log	dotnet/roslyn#83397
1432780	dotnet/aspnetcore	Checkout dotnet/aspnetcore@refs/pull/66811/merge to s	Log	dotnet/aspnetcore#66811
2982482	dotnet-runtime	Send to Helix	Log
1432774	dotnet/runtime	Checkout dotnet/runtime@main to s	Log
1432751	dotnet/roslyn	Checkout dotnet/roslyn@refs/pull/83761/merge to s	Log	dotnet/roslyn#83761
1432771	dotnet/aspnetcore	Checkout dotnet/aspnetcore@release/8.0 to s	Log
1432766	dotnet/aspnetcore	Run build.cmd helix target	Log
1432748	dotnet/roslyn	Checkout dotnet/roslyn@refs/pull/83760/merge to s	Log	dotnet/roslyn#83760
1432746	dotnet/roslyn	Checkout dotnet/roslyn@refs/pull/83758/merge to s	Log	dotnet/roslyn#83758
1432755	dotnet/roslyn	Checkout dotnet/roslyn@refs/pull/83352/merge to s	Log	dotnet/roslyn#83352
1432747	dotnet/roslyn	Checkout dotnet/roslyn@refs/pull/83758/merge to s	Log	dotnet/roslyn#83758
1432728	dotnet/runtime	Checkout dotnet/runtime@refs/pull/128517/merge to s	Log	dotnet/runtime#128517
1432481	dotnet/runtime	Send tests to Helix (Unix)	Log
1432638	dotnet/sdk	🟣 Run TestBuild Tests	Log	dotnet/sdk#54418
1432687	dotnet/runtime	Send to Helix	Log	dotnet/runtime#128519
1432693	dotnet/aspnetcore	Run build.cmd helix target	Log	dotnet/aspnetcore#66810
1432672	dotnet/maui	Controls WebView	Log
1432621	dotnet/runtime	Send to Helix	Log
2982386	dotnet-docker-tools	🟪 Clean public/dotnet/* (pruneEol > 15d)	Log
1432644	dotnet/aspnetcore	Run build.cmd helix target	Log	dotnet/aspnetcore#66809
1432563	dotnet/maui	Controls WebView	Log
1432595	dotnet/sdk	🟣 Run TestBuild Tests	Log	dotnet/sdk#54410
1432518	dotnet/runtime	Publish Build Assets	Log
1432392	dotnet/runtime	Send to Helix	Log
1432489	dotnet/aspnetcore	Run build.cmd helix target	Log
1432487	dotnet/performance	Send job to Helix (Windows)	Log
2982050	dotnet-maui	Controls CollectionView	Log
1432305	dotnet/runtime	Send to Helix	Log
2982121	dotnet-maui	Run Integration Tests - RunOniOS_MauiNativeAOT	Log
1432422	dotnet/arcade	Run Helix Tests	Log	dotnet/arcade#16871
1432421	dotnet/arcade	Run Helix Tests	Log	dotnet/arcade#16874
1432163	dotnet/maui	Controls Layout	Log	dotnet/maui#35385
1432419	dotnet/arcade	Run Helix Tests	Log	dotnet/arcade#16875
1432308	dotnet/roslyn	Test	Log
2982174	dotnet-dotnet-docker	🟪 Reference DotnetDockerBuild-2	Log
2982175	dotnet-docker-tools	🔒 Start Network Isolation	Log
2982155	dotnet-dotnet-docker	1ES PT Post-UserSteps (1ES PT)	Log
1432404	dotnet/aspnetcore	Run build.cmd helix target	Log	dotnet/aspnetcore#66808
2982156	dotnet-dotnet-buildtools-prereqs-docker	🟪 Build Images	Log
1432399	dotnet/arcade	Run Helix Tests	Log
1431538	dotnet/runtime	Send to Helix	Log	dotnet/runtime#128409
2982036	dotnet-dotnet	🛡 Guardian: AntiMalware Scanner (Binary)	Log
1432396	dotnet/sdk	🟣 Run TestBuild Tests	Log	dotnet/sdk#54082
2982153	dotnet-docker-tools	🟪 Purge msdotnetcontainers.azurecr.io	Log
1432368	dotnet/arcade	Run Helix Tests	Log	dotnet/arcade#16868
1432257	dotnet/roslyn	Run Unit Tests	Log
2982040	dotnet-maui	Run Integration Tests - RunOniOS_MauiDebug	Log
1431485	dotnet/aspnetcore	Run build.cmd helix target	Log	dotnet/aspnetcore#66795
2982029	dotnet-maui	Run Integration Tests - RunOniOS_MauiReleaseTrimFull	Log
1432291	dotnet/sdk	🟣 Run TestBuild Tests	Log	dotnet/sdk#54295
1432092	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#128459
1432251	dotnet/aspnetcore	Run build.cmd helix target	Log
1431794	dotnet/runtime	Send to Helix	Log
2981996	dotnet-maui	Run Integration Tests - Build	Log
2982062	dotnet-docker-tools	🟪 Purge msdotnetcontainers.azurecr.io	Log
1432064	dotnet/runtime	Send to Helix	Log	dotnet/runtime#128498
1432188	dotnet/maui	Controls CollectionView	Log
2981849	dotnet-maui	Controls Editor,Effects,Essentials,FlyoutPage,Focus,Fonts,Frame,Gestures,GraphicsView	Log
1432143	dotnet/roslyn	Run Unit Tests	Log	dotnet/roslyn#83236
1432154	dotnet/sdk	🟣 Run TestBuild Tests	Log	dotnet/sdk#54384
1431731	dotnet/maui	Controls CollectionView	Log
1432113	dotnet/aspnetcore	Run build.cmd helix target	Log
1432118	dotnet/aspnetcore	Run build.cmd helix target	Log
2982027	dotnet-sdk	Build	Log	#61472
2981964	dotnet-dotnet	Build (centOSStreamContainer)	Log
1432103	dotnet/aspnetcore	Run build.cmd helix target	Log
1432072	dotnet/aspnetcore	Run build.cmd helix target	Log
2982000	dotnet-docker-tools	🟪 Purge msdotnetcontainers.azurecr.io	Log
1432097	dotnet/roslyn	Test	Log
1431792	dotnet/runtime	Send to Helix	Log
1432023	dotnet/runtime	Send job to Helix (Unix)	Log
1432044	dotnet/aspnetcore	Run build.cmd helix target	Log	dotnet/aspnetcore#66585
1432042	dotnet/aspnetcore	Run build.cmd helix target	Log	dotnet/aspnetcore#66585
1432037	dotnet/performance	Send job to Helix (Unix)	Log	dotnet/performance#5220
1431998	dotnet/aspnetcore	Run build.cmd helix target	Log	dotnet/aspnetcore#66331
2981853	dotnet-dotnet	🛡 Guardian: 1ES Secret Scanning (SPMI)	Log
Displaying 100 of 3346 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
41	879	3346

[dkurepa]

These appear to be timeout cancellations, and most of them are happening on the same runtime leg that uses OSX.1200.ARM64.Open, looking at grafana, they do indeed appear to be quite high. Will check with the team on what we can do about this

[dkurepa]

For pipelines experiencing timeouts on osx.1200.arm64.open we recommend using osx.14.arm64.open, as this queue has a lot more machines

[dkurepa]

There is also a number of Publish Using Darc timeouts, these are in 99% of cases AzDo Api issues. During the Publish Using Darc job, we queue up a Maestro Promotion pipeline, that downloads the artifacts from the build calling it, and publishes them where they need to go. While publishing is happening, the build pipeline keeps busy waiting for the promotion pipeline to be done, checking the status of it every 60 seconds. In cases where this times out, the build most likely did get promoted, the AzDo API just kept telling us the wrong thing

[ivanpovazan]

@dkurepa for context, the same timeouts are also caught with this tracking #1883
where I asked about potentially bumping the queues to osx.13.amd/arm64, would that suffice?
(bumping to osx.14 is not an option right now as we still want testing on osx.13 which is the minimum supported OS version)

[CarnaViire]

For the "known issues" folks: the timeout here is reported twice, making BA red despite the tracking issue. E.g.:

1️⃣ dotnet/runtime#117255

2️⃣ dotnet/runtime#117800

cc @AlitzelMendez