Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[wasm] Wasm.Build.Tests timing out on Windows #69860

Closed
radical opened this issue May 26, 2022 · 4 comments · Fixed by #70328
Closed

[wasm] Wasm.Build.Tests timing out on Windows #69860

radical opened this issue May 26, 2022 · 4 comments · Fixed by #70328
Assignees
@radical
Labels
arch-wasm WebAssembly architecture area-Build-mono blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' test-failure

Comments

@radical
Copy link
Member

radical commented May 26, 2022

This is being hit on rolling builds, for example - https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-heads-main-93da5e9e54644bb5a2/Workloads-.BuildPublishTests/1/console.1923710a.log?helixlogtype=result .

    Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT(buildArgs: BuildArgs { ProjectName = placeholder, Config = Release, AOT = True, ProjectFileContents = placeholder, ExtraBuildArgs =  }, host: V8, id: "lyqlwa0s.m2z") [STARTING]
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:02:00
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:04:01
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:06:01
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:08:02
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:10:03
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:12:03
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:14:04
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:16:05
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:18:05
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:20:06
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:22:07
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:24:08
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:26:08
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:28:08
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:30:09
    Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT(buildArgs: BuildArgs { ProjectName = placeholder, Config = Release, AOT = True, ProjectFileContents = placeholder, ExtraBuildArgs =  }, host: V8, id: "lyqlwa0s.m2z") [FAIL]
      System.AggregateException : One or more errors occurred. (Process timed out. Last 20 lines of output:
      
      [lyqlwa0s.m2z]   build_publish_Release -> C:\helix\work\workitem\e\lyqlwa0s.m2z\bin\Release\net7.0\browser-wasm\build_publish_Release.dll
      
      [lyqlwa0s.m2z]   ** MicrosoftNetCoreAppRuntimePackDir : C:\helix\work\correlation\dotnet-workload\packs\Microsoft.NETCore.App.Runtime.Mono.browser-wasm\7.0.0-ci
      
      [lyqlwa0s.m2z]   build_publish_Release -> C:\helix\work\workitem\e\lyqlwa0s.m2z\bin\Release\net7.0\browser-wasm\publish\
      
      [lyqlwa0s.m2z]   AOT'ing 5 assemblies
      
      [lyqlwa0s.m2z]   [1/5] build_publish_Release.dll -> build_publish_Release.dll.bc
      
      [lyqlwa0s.m2z]   [2/5] System.Private.Runtime.InteropServices.JavaScript.dll -> System.Private.Runtime.InteropServices.JavaScript.dll.bc
      
      [lyqlwa0s.m2z]   [3/5] System.Private.Uri.dll -> System.Private.Uri.dll.bc
      
      [lyqlwa0s.m2z]   [4/5] System.Runtime.dll -> System.Runtime.dll.bc
      
      [lyqlwa0s.m2z]   [5/5] System.Private.CoreLib.dll -> System.Private.CoreLib.dll.bc
      
      )
      ---- Process timed out. Last 20 lines of output:
      
      [lyqlwa0s.m2z]   build_publish_Release -> C:\helix\work\workitem\e\lyqlwa0s.m2z\bin\Release\net7.0\browser-wasm\build_publish_Release.dll
      
      [lyqlwa0s.m2z]   ** MicrosoftNetCoreAppRuntimePackDir : C:\helix\work\correlation\dotnet-workload\packs\Microsoft.NETCore.App.Runtime.Mono.browser-wasm\7.0.0-ci
      
      [lyqlwa0s.m2z]   build_publish_Release -> C:\helix\work\workitem\e\lyqlwa0s.m2z\bin\Release\net7.0\browser-wasm\publish\
      
      [lyqlwa0s.m2z]   AOT'ing 5 assemblies
      
      [lyqlwa0s.m2z]   [1/5] build_publish_Release.dll -> build_publish_Release.dll.bc
      
      [lyqlwa0s.m2z]   [2/5] System.Private.Runtime.InteropServices.JavaScript.dll -> System.Private.Runtime.InteropServices.JavaScript.dll.bc
      
      [lyqlwa0s.m2z]   [3/5] System.Private.Uri.dll -> System.Private.Uri.dll.bc
      
      [lyqlwa0s.m2z]   [4/5] System.Runtime.dll -> System.Runtime.dll.bc
      
      [lyqlwa0s.m2z]   [5/5] System.Private.CoreLib.dll -> System.Private.CoreLib.dll.bc
      
      
      Stack Trace:
           at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
           at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
           at System.Threading.Tasks.Task.Wait()
        /_/src/tests/BuildWasmApps/Wasm.Build.Tests/BuildTestBase.cs(683,0): at Wasm.Build.Tests.BuildTestBase.RunProcess(String path, ITestOutputHelper _testOutput, String args, IDictionary`2 envVars, String workingDir, String label, Boolean logToXUnit, Nullable`1 timeoutMs)
        /_/src/tests/BuildWasmApps/Wasm.Build.Tests/BuildTestBase.cs(590,0): at Wasm.Build.Tests.BuildTestBase.AssertBuild(String args, String label, Boolean expectSuccess, IDictionary`2 envVars, Nullable`1 timeoutMs)
        /_/src/tests/BuildWasmApps/Wasm.Build.Tests/BuildTestBase.cs(348,0): at Wasm.Build.Tests.BuildTestBase.BuildProject(BuildArgs buildArgs, String id, BuildProjectOptions options)
        /_/src/tests/BuildWasmApps/Wasm.Build.Tests/BuildPublishTests.cs(114,0): at Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT(BuildArgs buildArgs, RunHost host, String id)
           at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
           at System.Reflection.RuntimeMethodInfo.InvokeNonEmitUnsafe(Object obj, IntPtr* arguments, Span`1 argsForTemporaryMonoSupport, BindingFlags invokeAttr)
        ----- Inner Stack Trace -----
        /_/src/tests/BuildWasmApps/Wasm.Build.Tests/BuildTestBase.cs(758,0): at Wasm.Build.Tests.BuildTestBase.RunProcessAsync(String path, ITestOutputHelper _testOutput, String args, IDictionary`2 envVars, String workingDir, String label, Boolean logToXUnit, Nullable`1 timeoutMs)
@radical radical added arch-wasm WebAssembly architecture blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' test-failure labels May 26, 2022
@dotnet-issue-labeler
Copy link

I couldn't figure out the best area label to add to this issue. If you have write-permissions please help me learn by adding exactly one area label.

@ghost ghost added the untriaged New issue has not been triaged by the area owner label May 26, 2022
@ghost
Copy link

ghost commented May 26, 2022

Tagging subscribers to 'arch-wasm': @lewing
See info in area-owners.md if you want to be subscribed.

Issue Details

This is being hit on rolling builds, for example - https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-heads-main-93da5e9e54644bb5a2/Workloads-.BuildPublishTests/1/console.1923710a.log?helixlogtype=result .

    Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT(buildArgs: BuildArgs { ProjectName = placeholder, Config = Release, AOT = True, ProjectFileContents = placeholder, ExtraBuildArgs =  }, host: V8, id: "lyqlwa0s.m2z") [STARTING]
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:02:00
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:04:01
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:06:01
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:08:02
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:10:03
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:12:03
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:14:04
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:16:05
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:18:05
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:20:06
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:22:07
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:24:08
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:26:08
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:28:08
   Wasm.Build.Tests: [Long Running Test] 'Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT', Elapsed: 00:30:09
    Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT(buildArgs: BuildArgs { ProjectName = placeholder, Config = Release, AOT = True, ProjectFileContents = placeholder, ExtraBuildArgs =  }, host: V8, id: "lyqlwa0s.m2z") [FAIL]
      System.AggregateException : One or more errors occurred. (Process timed out. Last 20 lines of output:
      
      [lyqlwa0s.m2z]   build_publish_Release -> C:\helix\work\workitem\e\lyqlwa0s.m2z\bin\Release\net7.0\browser-wasm\build_publish_Release.dll
      
      [lyqlwa0s.m2z]   ** MicrosoftNetCoreAppRuntimePackDir : C:\helix\work\correlation\dotnet-workload\packs\Microsoft.NETCore.App.Runtime.Mono.browser-wasm\7.0.0-ci
      
      [lyqlwa0s.m2z]   build_publish_Release -> C:\helix\work\workitem\e\lyqlwa0s.m2z\bin\Release\net7.0\browser-wasm\publish\
      
      [lyqlwa0s.m2z]   AOT'ing 5 assemblies
      
      [lyqlwa0s.m2z]   [1/5] build_publish_Release.dll -> build_publish_Release.dll.bc
      
      [lyqlwa0s.m2z]   [2/5] System.Private.Runtime.InteropServices.JavaScript.dll -> System.Private.Runtime.InteropServices.JavaScript.dll.bc
      
      [lyqlwa0s.m2z]   [3/5] System.Private.Uri.dll -> System.Private.Uri.dll.bc
      
      [lyqlwa0s.m2z]   [4/5] System.Runtime.dll -> System.Runtime.dll.bc
      
      [lyqlwa0s.m2z]   [5/5] System.Private.CoreLib.dll -> System.Private.CoreLib.dll.bc
      
      )
      ---- Process timed out. Last 20 lines of output:
      
      [lyqlwa0s.m2z]   build_publish_Release -> C:\helix\work\workitem\e\lyqlwa0s.m2z\bin\Release\net7.0\browser-wasm\build_publish_Release.dll
      
      [lyqlwa0s.m2z]   ** MicrosoftNetCoreAppRuntimePackDir : C:\helix\work\correlation\dotnet-workload\packs\Microsoft.NETCore.App.Runtime.Mono.browser-wasm\7.0.0-ci
      
      [lyqlwa0s.m2z]   build_publish_Release -> C:\helix\work\workitem\e\lyqlwa0s.m2z\bin\Release\net7.0\browser-wasm\publish\
      
      [lyqlwa0s.m2z]   AOT'ing 5 assemblies
      
      [lyqlwa0s.m2z]   [1/5] build_publish_Release.dll -> build_publish_Release.dll.bc
      
      [lyqlwa0s.m2z]   [2/5] System.Private.Runtime.InteropServices.JavaScript.dll -> System.Private.Runtime.InteropServices.JavaScript.dll.bc
      
      [lyqlwa0s.m2z]   [3/5] System.Private.Uri.dll -> System.Private.Uri.dll.bc
      
      [lyqlwa0s.m2z]   [4/5] System.Runtime.dll -> System.Runtime.dll.bc
      
      [lyqlwa0s.m2z]   [5/5] System.Private.CoreLib.dll -> System.Private.CoreLib.dll.bc
      
      
      Stack Trace:
           at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
           at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
           at System.Threading.Tasks.Task.Wait()
        /_/src/tests/BuildWasmApps/Wasm.Build.Tests/BuildTestBase.cs(683,0): at Wasm.Build.Tests.BuildTestBase.RunProcess(String path, ITestOutputHelper _testOutput, String args, IDictionary`2 envVars, String workingDir, String label, Boolean logToXUnit, Nullable`1 timeoutMs)
        /_/src/tests/BuildWasmApps/Wasm.Build.Tests/BuildTestBase.cs(590,0): at Wasm.Build.Tests.BuildTestBase.AssertBuild(String args, String label, Boolean expectSuccess, IDictionary`2 envVars, Nullable`1 timeoutMs)
        /_/src/tests/BuildWasmApps/Wasm.Build.Tests/BuildTestBase.cs(348,0): at Wasm.Build.Tests.BuildTestBase.BuildProject(BuildArgs buildArgs, String id, BuildProjectOptions options)
        /_/src/tests/BuildWasmApps/Wasm.Build.Tests/BuildPublishTests.cs(114,0): at Wasm.Build.Tests.BuildPublishTests.BuildThenPublishWithAOT(BuildArgs buildArgs, RunHost host, String id)
           at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
           at System.Reflection.RuntimeMethodInfo.InvokeNonEmitUnsafe(Object obj, IntPtr* arguments, Span`1 argsForTemporaryMonoSupport, BindingFlags invokeAttr)
        ----- Inner Stack Trace -----
        /_/src/tests/BuildWasmApps/Wasm.Build.Tests/BuildTestBase.cs(758,0): at Wasm.Build.Tests.BuildTestBase.RunProcessAsync(String path, ITestOutputHelper _testOutput, String args, IDictionary`2 envVars, String workingDir, String label, Boolean logToXUnit, Nullable`1 timeoutMs)
Author: radical
Assignees: -
Labels:

arch-wasm, blocking-clean-ci, test-failure
Milestone: -

@radical radical added area-Build-mono and removed untriaged New issue has not been triaged by the area owner labels May 26, 2022
@runfoapp runfoapp bot mentioned this issue May 26, 2022
Closed
@radical radical self-assigned this May 26, 2022
@radical
Copy link
Member Author

radical commented Jun 1, 2022

The commits between the last good one, and first bad one: 4ff994e...9859f70

I think the emsdk update might be related. It has a rollback to 3.1.7 .

@radekdoulik are you able to run wasm.build.tests on windows? I'm having trouble running them at all. It complains of missing xunit.console.dll!?! I'll dig more tomorrow.

@radical
Copy link
Member Author

radical commented Jun 1, 2022

@radekdoulik for example, are you able to run XUnitClassName=Wasm.Build.Tests.InvariantGlobalizationTests completely?

This was referenced Jun 6, 2022
Merged
Merged
@ghost ghost added the in-pr There is an active PR which will close this issue when it is merged label Jun 7, 2022
@ghost ghost removed the in-pr There is an active PR which will close this issue when it is merged label Jun 7, 2022
@ghost ghost locked as resolved and limited conversation to collaborators Jul 8, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@radical radical

Labels
arch-wasm WebAssembly architecture area-Build-mono blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' test-failure
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[wasm] Fix Wasm.Build.Tests test failures on windows radical/runtime
1 participant
@radical