Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[wasm] 2 runtime tests failing with emscripten 3.1.34 #84786

Closed
radekdoulik opened this issue Apr 13, 2023 · 7 comments
Closed

[wasm] 2 runtime tests failing with emscripten 3.1.34 #84786

radekdoulik opened this issue Apr 13, 2023 · 7 comments
Assignees
@radekdoulik
Labels
arch-wasm WebAssembly architecture area-Infrastructure-mono runtime-mono specific to the Mono runtime
Milestone
10.0.0

Comments

@radekdoulik
Copy link
Member

These failures might be related to change in handling of ExitStatus exception in emscripten.

Failing tests

=== TEST EXECUTION SUMMARY ===
   GC.API.XUnitWrapper                                 Total: 17, Errors: 0, Failed: 1, Skipped: 0, Time:  49.980s
   tracing.eventcounter.XUnitWrapper                   Total:  2, Errors: 0, Failed: 1, Skipped: 0, Time: 600.040s
                                                              --          -          -           -        --------
                                                 GRAND TOTAL: 97          0          2           0        798.676s (799.073s)

Logs

  Starting:    GC.API.XUnitWrapper (parallel test collections = on, max threads = 2)
    GC/API/GCHandleCollector/Usage/Usage.sh [FAIL]
      {"name":"ExitStatus","message":"Program terminated with exit(100)","status":100}
      
      Unhandled Exception:
      System.InvalidOperationException: Handle collector count overflows or underflows.
         at System.Runtime.InteropServices.HandleCollector.Remove()
         at HandleCollectorTest.Finalize()
      
      Unhandled Exception:
      System.InvalidOperationException: Handle collector count overflows or underflows.
         at System.Runtime.InteropServices.HandleCollector.Remove()
         at HandleCollectorTest.Finalize()
      [ERROR] FATAL UNHANDLED EXCEPTION: System.InvalidOperationException: Handle collector count overflows or underflows.
         at System.Runtime.InteropServices.HandleCollector.Remove()
         at HandleCollectorTest.Finalize()
      
      Return code:      1
      Raw output file:      /root/helix/work/workitem/uploads/Reports/GC.API/GCHandleCollector/Usage/Usage.output.txt
      Raw output:
      BEGIN EXECUTION
      MSBuild version 17.6.0-preview-23108-10+51df47643 for .NET
        AppDir: /root/helix/work/workitem/e/GC/API/GCHandleCollector/Usage/WasmApp/
        TestBinDir: /root/helix/work/workitem/e/GC/API/GCHandleCollector/Usage
        ArtifactsBinDir: 
        Generated app bundle at /root/helix/work/workitem/e/GC/API/GCHandleCollector/Usage/WasmApp/
      Incoming arguments: --run Usage.dll
      Application arguments: --run Usage.dll
      console.info: Initializing dotnet version 8.0.0-ci commit hash 09041216c7a8afd4c5fc26abad1d77bf6c35ea22
      Case 1 Passed!
      100, 100
      Case 2 Passed!
      Case 3 Passed!
      
      Test Passed!
      WASM EXIT 100

   tracing.eventcounter.XUnitWrapper: [Long Running Test] 'tracing/eventcounter/regression-25709/regression-25709.sh', Elapsed: 00:08:12
    tracing/eventcounter/regression-25709/regression-25709.sh [FAIL]
      {"name":"ExitStatus","message":"Program terminated with exit(100)","status":100}
      
      cmdLine:/root/helix/work/workitem/e/tracing/eventcounter/regression-25709/regression-25709.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 4/13/2023 10:40:59 AM, end: 4/13/2023 10:50:59 AM)
      
      Return code:      -100
      Raw output file:      /root/helix/work/workitem/uploads/Reports/tracing.eventcounter/regression-25709/regression-25709.output.txt
      Raw output:
      BEGIN EXECUTION
      MSBuild version 17.6.0-preview-23108-10+51df47643 for .NET
        AppDir: /root/helix/work/workitem/e/tracing/eventcounter/regression-25709/WasmApp/
        TestBinDir: /root/helix/work/workitem/e/tracing/eventcounter/regression-25709
        ArtifactsBinDir: 
        Generated app bundle at /root/helix/work/workitem/e/tracing/eventcounter/regression-25709/WasmApp/
      Incoming arguments: --run regression-25709.dll
      Application arguments: --run regression-25709.dll
      console.info: Initializing dotnet version 8.0.0-ci commit hash 09041216c7a8afd4c5fc26abad1d77bf6c35ea22
      Test passed
      WASM EXIT 100
      
      cmdLine:/root/helix/work/workitem/e/tracing/eventcounter/regression-25709/regression-25709.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 4/13/2023 10:40:59 AM, end: 4/13/2023 10:50:59 AM)
      Test Harness Exitcode is : -100
      To run the test:
      > set CORE_ROOT=/root/helix/work/correlation
      > /root/helix/work/workitem/e/tracing/eventcounter/regression-25709/regression-25709.sh
      Expected: True
      Actual:   False
      Stack Trace:
           at tracing_eventcounter._regression_25709_regression_25709_._regression_25709_regression_25709_sh()
           at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
           at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)
      Output:
        {"name":"ExitStatus","message":"Program terminated with exit(100)","status":100}
        
        cmdLine:/root/helix/work/workitem/e/tracing/eventcounter/regression-25709/regression-25709.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 4/13/2023 10:40:59 AM, end: 4/13/2023 10:50:59 AM)
        
        Return code:      -100
        Raw output file:      /root/helix/work/workitem/uploads/Reports/tracing.eventcounter/regression-25709/regression-25709.output.txt
        Raw output:
        BEGIN EXECUTION
        MSBuild version 17.6.0-preview-23108-10+51df47643 for .NET
          AppDir: /root/helix/work/workitem/e/tracing/eventcounter/regression-25709/WasmApp/
          TestBinDir: /root/helix/work/workitem/e/tracing/eventcounter/regression-25709
          ArtifactsBinDir: 
          Generated app bundle at /root/helix/work/workitem/e/tracing/eventcounter/regression-25709/WasmApp/
        Incoming arguments: --run regression-25709.dll
        Application arguments: --run regression-25709.dll
        console.info: Initializing dotnet version 8.0.0-ci commit hash 09041216c7a8afd4c5fc26abad1d77bf6c35ea22
        Test passed
        WASM EXIT 100
        
        cmdLine:/root/helix/work/workitem/e/tracing/eventcounter/regression-25709/regression-25709.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 4/13/2023 10:40:59 AM, end: 4/13/2023 10:50:59 AM)
        Test Harness Exitcode is : -100
        To run the test:
        > set CORE_ROOT=/root/helix/work/correlation
        > /root/helix/work/workitem/e/tracing/eventcounter/regression-25709/regression-25709.sh
@dotnet-issue-labeler dotnet-issue-labeler bot added the needs-area-label An area label is needed to ensure this gets routed to the appropriate area owners label Apr 13, 2023
@ghost ghost added the untriaged New issue has not been triaged by the area owner label Apr 13, 2023
@radekdoulik radekdoulik added this to the 8.0.0 milestone Apr 13, 2023
@ghost ghost removed the untriaged New issue has not been triaged by the area owner label Apr 13, 2023
@radekdoulik radekdoulik added untriaged New issue has not been triaged by the area owner runtime-mono specific to the Mono runtime area-Infrastructure-mono labels Apr 13, 2023
@ghost
Copy link

ghost commented Apr 13, 2023

Tagging subscribers to this area: @directhex
See info in area-owners.md if you want to be subscribed.

Issue Details

These failures might be related to change in handling of ExitStatus exception in emscripten.

Failing tests

=== TEST EXECUTION SUMMARY ===
   GC.API.XUnitWrapper                                 Total: 17, Errors: 0, Failed: 1, Skipped: 0, Time:  49.980s
   tracing.eventcounter.XUnitWrapper                   Total:  2, Errors: 0, Failed: 1, Skipped: 0, Time: 600.040s
                                                              --          -          -           -        --------
                                                 GRAND TOTAL: 97          0          2           0        798.676s (799.073s)

Logs

  Starting:    GC.API.XUnitWrapper (parallel test collections = on, max threads = 2)
    GC/API/GCHandleCollector/Usage/Usage.sh [FAIL]
      {"name":"ExitStatus","message":"Program terminated with exit(100)","status":100}
      
      Unhandled Exception:
      System.InvalidOperationException: Handle collector count overflows or underflows.
         at System.Runtime.InteropServices.HandleCollector.Remove()
         at HandleCollectorTest.Finalize()
      
      Unhandled Exception:
      System.InvalidOperationException: Handle collector count overflows or underflows.
         at System.Runtime.InteropServices.HandleCollector.Remove()
         at HandleCollectorTest.Finalize()
      [ERROR] FATAL UNHANDLED EXCEPTION: System.InvalidOperationException: Handle collector count overflows or underflows.
         at System.Runtime.InteropServices.HandleCollector.Remove()
         at HandleCollectorTest.Finalize()
      
      Return code:      1
      Raw output file:      /root/helix/work/workitem/uploads/Reports/GC.API/GCHandleCollector/Usage/Usage.output.txt
      Raw output:
      BEGIN EXECUTION
      MSBuild version 17.6.0-preview-23108-10+51df47643 for .NET
        AppDir: /root/helix/work/workitem/e/GC/API/GCHandleCollector/Usage/WasmApp/
        TestBinDir: /root/helix/work/workitem/e/GC/API/GCHandleCollector/Usage
        ArtifactsBinDir: 
        Generated app bundle at /root/helix/work/workitem/e/GC/API/GCHandleCollector/Usage/WasmApp/
      Incoming arguments: --run Usage.dll
      Application arguments: --run Usage.dll
      console.info: Initializing dotnet version 8.0.0-ci commit hash 09041216c7a8afd4c5fc26abad1d77bf6c35ea22
      Case 1 Passed!
      100, 100
      Case 2 Passed!
      Case 3 Passed!
      
      Test Passed!
      WASM EXIT 100

   tracing.eventcounter.XUnitWrapper: [Long Running Test] 'tracing/eventcounter/regression-25709/regression-25709.sh', Elapsed: 00:08:12
    tracing/eventcounter/regression-25709/regression-25709.sh [FAIL]
      {"name":"ExitStatus","message":"Program terminated with exit(100)","status":100}
      
      cmdLine:/root/helix/work/workitem/e/tracing/eventcounter/regression-25709/regression-25709.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 4/13/2023 10:40:59 AM, end: 4/13/2023 10:50:59 AM)
      
      Return code:      -100
      Raw output file:      /root/helix/work/workitem/uploads/Reports/tracing.eventcounter/regression-25709/regression-25709.output.txt
      Raw output:
      BEGIN EXECUTION
      MSBuild version 17.6.0-preview-23108-10+51df47643 for .NET
        AppDir: /root/helix/work/workitem/e/tracing/eventcounter/regression-25709/WasmApp/
        TestBinDir: /root/helix/work/workitem/e/tracing/eventcounter/regression-25709
        ArtifactsBinDir: 
        Generated app bundle at /root/helix/work/workitem/e/tracing/eventcounter/regression-25709/WasmApp/
      Incoming arguments: --run regression-25709.dll
      Application arguments: --run regression-25709.dll
      console.info: Initializing dotnet version 8.0.0-ci commit hash 09041216c7a8afd4c5fc26abad1d77bf6c35ea22
      Test passed
      WASM EXIT 100
      
      cmdLine:/root/helix/work/workitem/e/tracing/eventcounter/regression-25709/regression-25709.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 4/13/2023 10:40:59 AM, end: 4/13/2023 10:50:59 AM)
      Test Harness Exitcode is : -100
      To run the test:
      > set CORE_ROOT=/root/helix/work/correlation
      > /root/helix/work/workitem/e/tracing/eventcounter/regression-25709/regression-25709.sh
      Expected: True
      Actual:   False
      Stack Trace:
           at tracing_eventcounter._regression_25709_regression_25709_._regression_25709_regression_25709_sh()
           at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
           at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)
      Output:
        {"name":"ExitStatus","message":"Program terminated with exit(100)","status":100}
        
        cmdLine:/root/helix/work/workitem/e/tracing/eventcounter/regression-25709/regression-25709.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 4/13/2023 10:40:59 AM, end: 4/13/2023 10:50:59 AM)
        
        Return code:      -100
        Raw output file:      /root/helix/work/workitem/uploads/Reports/tracing.eventcounter/regression-25709/regression-25709.output.txt
        Raw output:
        BEGIN EXECUTION
        MSBuild version 17.6.0-preview-23108-10+51df47643 for .NET
          AppDir: /root/helix/work/workitem/e/tracing/eventcounter/regression-25709/WasmApp/
          TestBinDir: /root/helix/work/workitem/e/tracing/eventcounter/regression-25709
          ArtifactsBinDir: 
          Generated app bundle at /root/helix/work/workitem/e/tracing/eventcounter/regression-25709/WasmApp/
        Incoming arguments: --run regression-25709.dll
        Application arguments: --run regression-25709.dll
        console.info: Initializing dotnet version 8.0.0-ci commit hash 09041216c7a8afd4c5fc26abad1d77bf6c35ea22
        Test passed
        WASM EXIT 100
        
        cmdLine:/root/helix/work/workitem/e/tracing/eventcounter/regression-25709/regression-25709.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 4/13/2023 10:40:59 AM, end: 4/13/2023 10:50:59 AM)
        Test Harness Exitcode is : -100
        To run the test:
        > set CORE_ROOT=/root/helix/work/correlation
        > /root/helix/work/workitem/e/tracing/eventcounter/regression-25709/regression-25709.sh
Author: radekdoulik
Assignees: -
Labels:

untriaged, area-Infrastructure-mono, runtime-mono, needs-area-label
Milestone: 8.0.0

@radekdoulik radekdoulik removed untriaged New issue has not been triaged by the area owner needs-area-label An area label is needed to ensure this gets routed to the appropriate area owners labels Apr 13, 2023
@carlossanlop
Copy link
Member

@radekdoulik the first error message is already being tracked with #81383 : Handle collector count overflows or underflows.. We are already tracking the hits of that one with Known Build Error.

For the second error message, can you please make sure this issue is linked with Known Build Error? The instructions can be found in our template: https://github.com/dotnet/runtime/issues/new?assignees=&labels=blocking-clean-ci%2CKnown+Build+Error&template=04_ci_known_issue.yml

@radekdoulik
Copy link
Member Author

@radekdoulik the first error message is already being tracked with #81383 : Handle collector count overflows or underflows.. We are already tracking the hits of that one with Known Build Error.

For the second error message, can you please make sure this issue is linked with Known Build Error? The instructions can be found in our template: https://github.com/dotnet/runtime/issues/new?assignees=&labels=blocking-clean-ci%2CKnown+Build+Error&template=04_ci_known_issue.yml

These are now disabled on wasm, so they shouldn't fail on CI.

Looking at the logs, it also seems different than #81383, because in our case the tests passes, but xharness evaluates it as failed.

@radical radical added the arch-wasm WebAssembly architecture label May 1, 2023
@ghost
Copy link

ghost commented May 1, 2023

Tagging subscribers to 'arch-wasm': @lewing
See info in area-owners.md if you want to be subscribed.

Issue Details

These failures might be related to change in handling of ExitStatus exception in emscripten.

Failing tests

=== TEST EXECUTION SUMMARY ===
   GC.API.XUnitWrapper                                 Total: 17, Errors: 0, Failed: 1, Skipped: 0, Time:  49.980s
   tracing.eventcounter.XUnitWrapper                   Total:  2, Errors: 0, Failed: 1, Skipped: 0, Time: 600.040s
                                                              --          -          -           -        --------
                                                 GRAND TOTAL: 97          0          2           0        798.676s (799.073s)

Logs

  Starting:    GC.API.XUnitWrapper (parallel test collections = on, max threads = 2)
    GC/API/GCHandleCollector/Usage/Usage.sh [FAIL]
      {"name":"ExitStatus","message":"Program terminated with exit(100)","status":100}
      
      Unhandled Exception:
      System.InvalidOperationException: Handle collector count overflows or underflows.
         at System.Runtime.InteropServices.HandleCollector.Remove()
         at HandleCollectorTest.Finalize()
      
      Unhandled Exception:
      System.InvalidOperationException: Handle collector count overflows or underflows.
         at System.Runtime.InteropServices.HandleCollector.Remove()
         at HandleCollectorTest.Finalize()
      [ERROR] FATAL UNHANDLED EXCEPTION: System.InvalidOperationException: Handle collector count overflows or underflows.
         at System.Runtime.InteropServices.HandleCollector.Remove()
         at HandleCollectorTest.Finalize()
      
      Return code:      1
      Raw output file:      /root/helix/work/workitem/uploads/Reports/GC.API/GCHandleCollector/Usage/Usage.output.txt
      Raw output:
      BEGIN EXECUTION
      MSBuild version 17.6.0-preview-23108-10+51df47643 for .NET
        AppDir: /root/helix/work/workitem/e/GC/API/GCHandleCollector/Usage/WasmApp/
        TestBinDir: /root/helix/work/workitem/e/GC/API/GCHandleCollector/Usage
        ArtifactsBinDir: 
        Generated app bundle at /root/helix/work/workitem/e/GC/API/GCHandleCollector/Usage/WasmApp/
      Incoming arguments: --run Usage.dll
      Application arguments: --run Usage.dll
      console.info: Initializing dotnet version 8.0.0-ci commit hash 09041216c7a8afd4c5fc26abad1d77bf6c35ea22
      Case 1 Passed!
      100, 100
      Case 2 Passed!
      Case 3 Passed!
      
      Test Passed!
      WASM EXIT 100

   tracing.eventcounter.XUnitWrapper: [Long Running Test] 'tracing/eventcounter/regression-25709/regression-25709.sh', Elapsed: 00:08:12
    tracing/eventcounter/regression-25709/regression-25709.sh [FAIL]
      {"name":"ExitStatus","message":"Program terminated with exit(100)","status":100}
      
      cmdLine:/root/helix/work/workitem/e/tracing/eventcounter/regression-25709/regression-25709.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 4/13/2023 10:40:59 AM, end: 4/13/2023 10:50:59 AM)
      
      Return code:      -100
      Raw output file:      /root/helix/work/workitem/uploads/Reports/tracing.eventcounter/regression-25709/regression-25709.output.txt
      Raw output:
      BEGIN EXECUTION
      MSBuild version 17.6.0-preview-23108-10+51df47643 for .NET
        AppDir: /root/helix/work/workitem/e/tracing/eventcounter/regression-25709/WasmApp/
        TestBinDir: /root/helix/work/workitem/e/tracing/eventcounter/regression-25709
        ArtifactsBinDir: 
        Generated app bundle at /root/helix/work/workitem/e/tracing/eventcounter/regression-25709/WasmApp/
      Incoming arguments: --run regression-25709.dll
      Application arguments: --run regression-25709.dll
      console.info: Initializing dotnet version 8.0.0-ci commit hash 09041216c7a8afd4c5fc26abad1d77bf6c35ea22
      Test passed
      WASM EXIT 100
      
      cmdLine:/root/helix/work/workitem/e/tracing/eventcounter/regression-25709/regression-25709.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 4/13/2023 10:40:59 AM, end: 4/13/2023 10:50:59 AM)
      Test Harness Exitcode is : -100
      To run the test:
      > set CORE_ROOT=/root/helix/work/correlation
      > /root/helix/work/workitem/e/tracing/eventcounter/regression-25709/regression-25709.sh
      Expected: True
      Actual:   False
      Stack Trace:
           at tracing_eventcounter._regression_25709_regression_25709_._regression_25709_regression_25709_sh()
           at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
           at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)
      Output:
        {"name":"ExitStatus","message":"Program terminated with exit(100)","status":100}
        
        cmdLine:/root/helix/work/workitem/e/tracing/eventcounter/regression-25709/regression-25709.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 4/13/2023 10:40:59 AM, end: 4/13/2023 10:50:59 AM)
        
        Return code:      -100
        Raw output file:      /root/helix/work/workitem/uploads/Reports/tracing.eventcounter/regression-25709/regression-25709.output.txt
        Raw output:
        BEGIN EXECUTION
        MSBuild version 17.6.0-preview-23108-10+51df47643 for .NET
          AppDir: /root/helix/work/workitem/e/tracing/eventcounter/regression-25709/WasmApp/
          TestBinDir: /root/helix/work/workitem/e/tracing/eventcounter/regression-25709
          ArtifactsBinDir: 
          Generated app bundle at /root/helix/work/workitem/e/tracing/eventcounter/regression-25709/WasmApp/
        Incoming arguments: --run regression-25709.dll
        Application arguments: --run regression-25709.dll
        console.info: Initializing dotnet version 8.0.0-ci commit hash 09041216c7a8afd4c5fc26abad1d77bf6c35ea22
        Test passed
        WASM EXIT 100
        
        cmdLine:/root/helix/work/workitem/e/tracing/eventcounter/regression-25709/regression-25709.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 4/13/2023 10:40:59 AM, end: 4/13/2023 10:50:59 AM)
        Test Harness Exitcode is : -100
        To run the test:
        > set CORE_ROOT=/root/helix/work/correlation
        > /root/helix/work/workitem/e/tracing/eventcounter/regression-25709/regression-25709.sh
Author: radekdoulik
Assignees: -
Labels:

arch-wasm, area-Infrastructure-mono, runtime-mono
Milestone: 8.0.0

@lewing lewing modified the milestones: 8.0.0, 9.0.0 Aug 13, 2023
@lewing
Copy link
Member

lewing commented Aug 13, 2023

@radekdoulik please update the status of this issue

@ilonatommy
Copy link
Member

@radekdoulik, should #100334 try to enable the tests? Or a separate PR when the bump is merged.

@lewing lewing modified the milestones: 9.0.0, 10.0.0 Jul 30, 2024
radekdoulik added a commit to radekdoulik/runtime that referenced this issue Oct 17, 2024
@radekdoulik
[wasm] Enable few tests
b53a344 
To check whether dotnet#84786 is still valid for 3.1.56
@radekdoulik radekdoulik mentioned this issue Oct 17, 2024
Merged
radekdoulik added a commit that referenced this issue Oct 18, 2024
@radekdoulik
[wasm] Enable few tests (#108977)
24dd2bc 
To check whether #84786 is still valid for 3.1.56
@radekdoulik
Copy link
Member Author

resolved with #108977

@github-actions github-actions bot locked and limited conversation to collaborators Nov 18, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@radekdoulik radekdoulik

Labels
arch-wasm WebAssembly architecture area-Infrastructure-mono runtime-mono specific to the Mono runtime
Projects
None yet
Milestone
10.0.0
Development

No branches or pull requests
5 participants
@radical @lewing @carlossanlop @radekdoulik @ilonatommy