Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[browser][MT] ThreadStartException in System.Net.WebSockets.Client.Tests on WASM #93323

Closed
danmoseley opened this issue Oct 11, 2023 · 5 comments
Closed

[browser][MT] ThreadStartException in System.Net.WebSockets.Client.Tests on WASM #93323

danmoseley opened this issue Oct 11, 2023 · 5 comments
Assignees
@pavelsavara
Labels
arch-wasm WebAssembly architecture area-VM-threading-mono disabled-test The test is disabled in source code against the issue os-browser Browser variant of arch-wasm
Milestone
9.0.0

Comments

@danmoseley
Copy link
Member 

warn: 
warn: Unhandled Exception:
warn: System.Threading.ThreadStartException: Thread failed to start.
warn:  ---> System.ExecutionEngineException: mono_thread_platform_create_thread() failed
warn:    --- End of inner exception stack trace ---
warn:    at System.Threading.Thread.ThrowThreadStartException(Exception ex)
warn:    at System.Threading.Thread.StartCore()
warn:    at System.Threading.Thread.Start(Boolean captureContext, Boolean internalThread)
warn:    at System.Threading.Thread.UnsafeStart()
warn:    at System.Threading.WebWorkerEventLoop.StartExitable(Thread thread, Boolean captureContext)
warn:    at System.Threading.PortableThreadPool.WorkerThread.CreateWorkerThread()
warn:    at System.Threading.PortableThreadPool.WorkerThread.MaybeAddWorkingWorker(PortableThreadPool threadPoolInstance)
warn:    at System.Threading.PortableThreadPool.RequestWorker()
warn:    at System.Threading.ThreadPoolWorkQueue.Dispatch()
warn:    at System.Threading.PortableThreadPool.WorkerThread.WorkLoopSemaphoreSuccess(LowLevelLifoAsyncWaitSemaphore semaphore, Object stateObject)
warn:    at System.Threading.LowLevelLifoAsyncWaitSemaphore.InternalAsyncWaitSuccess(LowLevelLifoAsyncWaitSemaphore self, WaitEntry internalWaitEntry)
warn:    at System.Threading.LowLevelLifoAsyncWaitSemaphore.SuccessCallback(IntPtr lifoSemaphore, IntPtr userData)
warn: [2023-10-10T23:38:40.616Z] [ERROR] FATAL UNHANDLED EXCEPTION: System.Threading.ThreadStartException: Thread failed to start.
warn:  ---> System.ExecutionEngineException: mono_thread_platform_create_thread() failed
warn:    --- End of inner exception stack trace ---
warn:    at System.Threading.Thread.ThrowThreadStartException(Exception ex)
warn:    at System.Threading.Thread.StartCore()
warn:    at System.Threading.Thread.Start(Boolean captureContext, Boolean internalThread)
warn:    at System.Threading.Thread.UnsafeStart()
warn:    at System.Threading.WebWorkerEventLoop.StartExitable(Thread thread, Boolean captureContext)
warn:    at System.Threading.PortableThreadPool.WorkerThread.CreateWorkerThread()
warn:    at System.Threading.PortableThreadPool.WorkerThread.MaybeAddWorkingWorker(PortableThreadPool threadPoolInstance)
warn:    at System.Threading.PortableThreadPool.RequestWorker()
warn:    at System.Threading.ThreadPoolWorkQueue.Dispatch()
warn:    at System.Threading.PortableThreadPool.WorkerThread.WorkLoopSemaphoreSuccess(LowLevelLifoAsyncWaitSemaphore semaphore, Object stateObject)
warn:    at System.Threading.LowLevelLifoAsyncWaitSemaphore.InternalAsyncWaitSuccess(LowLevelLifoAsyncWaitSemaphore self, WaitEntry internalWaitEntry)
warn:    at System.Threading.LowLevelLifoAsyncWaitSemaphore.SuccessCallback(IntPtr lifoSemaphore, IntPtr userData)
info: Waiting to flush log messages with a timeout of 120 secs ..
fail: Flushing log messages failed with: System.OperationCanceledException: The operation was canceled.
         at System.Threading.Channels.AsyncOperation`1.GetResult(Int16 token)
         at System.Threading.Channels.ChannelReader`1.ReadAllAsync(CancellationToken cancellationToken)+MoveNext()
         at System.Threading.Channels.ChannelReader`1.ReadAllAsync(CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestMessagesProcessor.RunAsync(CancellationToken token) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/WasmTestMessagesProcessor.cs:line 68
         at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestMessagesProcessor.RunAsync(CancellationToken token) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/WasmTestMessagesProcessor.cs:line 68
         at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestMessagesProcessor.CompleteAndFlushAsync(Nullable`1 timeout) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/WasmTestMessagesProcessor.cs:line 140. Ignoring.
fail: Tests timed out. Killing driver service pid 79

Build Information

Build: https://helixre107v0xdcypoyl9e7f.blob.core.windows.net/dotnet-runtime-refs-pull-92682-merge-d089dcadfcc74738af/WasmTestOnBrowser-System.Net.WebSockets.Client.Tests/1/console.7cb91235.log?helixlogtype=result
Leg Name: Console log: 'WasmTestOnBrowser-System.Net.WebSockets.Client.Tests' from job d089dcad-fcc7-4738-afd1-f43163be9d35 (ubuntu.2204.amd64.open.rt) using docker image mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-22.04-helix-webassembly on a002M59

Error Message

{ 
    "ErrorMessage": "System.ExecutionEngineException: mono_thread_platform_create_thread() failed",
    "BuildRetry": true,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
}
@ghost ghost added the untriaged New issue has not been triaged by the area owner label Oct 11, 2023
@ghost
Copy link

ghost commented Oct 11, 2023

Tagging subscribers to this area: @mangod9
See info in area-owners.md if you want to be subscribed.

Issue Details 
warn: 
warn: Unhandled Exception:
warn: System.Threading.ThreadStartException: Thread failed to start.
warn:  ---> System.ExecutionEngineException: mono_thread_platform_create_thread() failed
warn:    --- End of inner exception stack trace ---
warn:    at System.Threading.Thread.ThrowThreadStartException(Exception ex)
warn:    at System.Threading.Thread.StartCore()
warn:    at System.Threading.Thread.Start(Boolean captureContext, Boolean internalThread)
warn:    at System.Threading.Thread.UnsafeStart()
warn:    at System.Threading.WebWorkerEventLoop.StartExitable(Thread thread, Boolean captureContext)
warn:    at System.Threading.PortableThreadPool.WorkerThread.CreateWorkerThread()
warn:    at System.Threading.PortableThreadPool.WorkerThread.MaybeAddWorkingWorker(PortableThreadPool threadPoolInstance)
warn:    at System.Threading.PortableThreadPool.RequestWorker()
warn:    at System.Threading.ThreadPoolWorkQueue.Dispatch()
warn:    at System.Threading.PortableThreadPool.WorkerThread.WorkLoopSemaphoreSuccess(LowLevelLifoAsyncWaitSemaphore semaphore, Object stateObject)
warn:    at System.Threading.LowLevelLifoAsyncWaitSemaphore.InternalAsyncWaitSuccess(LowLevelLifoAsyncWaitSemaphore self, WaitEntry internalWaitEntry)
warn:    at System.Threading.LowLevelLifoAsyncWaitSemaphore.SuccessCallback(IntPtr lifoSemaphore, IntPtr userData)
warn: [2023-10-10T23:38:40.616Z] [ERROR] FATAL UNHANDLED EXCEPTION: System.Threading.ThreadStartException: Thread failed to start.
warn:  ---> System.ExecutionEngineException: mono_thread_platform_create_thread() failed
warn:    --- End of inner exception stack trace ---
warn:    at System.Threading.Thread.ThrowThreadStartException(Exception ex)
warn:    at System.Threading.Thread.StartCore()
warn:    at System.Threading.Thread.Start(Boolean captureContext, Boolean internalThread)
warn:    at System.Threading.Thread.UnsafeStart()
warn:    at System.Threading.WebWorkerEventLoop.StartExitable(Thread thread, Boolean captureContext)
warn:    at System.Threading.PortableThreadPool.WorkerThread.CreateWorkerThread()
warn:    at System.Threading.PortableThreadPool.WorkerThread.MaybeAddWorkingWorker(PortableThreadPool threadPoolInstance)
warn:    at System.Threading.PortableThreadPool.RequestWorker()
warn:    at System.Threading.ThreadPoolWorkQueue.Dispatch()
warn:    at System.Threading.PortableThreadPool.WorkerThread.WorkLoopSemaphoreSuccess(LowLevelLifoAsyncWaitSemaphore semaphore, Object stateObject)
warn:    at System.Threading.LowLevelLifoAsyncWaitSemaphore.InternalAsyncWaitSuccess(LowLevelLifoAsyncWaitSemaphore self, WaitEntry internalWaitEntry)
warn:    at System.Threading.LowLevelLifoAsyncWaitSemaphore.SuccessCallback(IntPtr lifoSemaphore, IntPtr userData)
info: Waiting to flush log messages with a timeout of 120 secs ..
fail: Flushing log messages failed with: System.OperationCanceledException: The operation was canceled.
         at System.Threading.Channels.AsyncOperation`1.GetResult(Int16 token)
         at System.Threading.Channels.ChannelReader`1.ReadAllAsync(CancellationToken cancellationToken)+MoveNext()
         at System.Threading.Channels.ChannelReader`1.ReadAllAsync(CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestMessagesProcessor.RunAsync(CancellationToken token) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/WasmTestMessagesProcessor.cs:line 68
         at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestMessagesProcessor.RunAsync(CancellationToken token) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/WasmTestMessagesProcessor.cs:line 68
         at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestMessagesProcessor.CompleteAndFlushAsync(Nullable`1 timeout) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/WasmTestMessagesProcessor.cs:line 140. Ignoring.
fail: Tests timed out. Killing driver service pid 79

Build Information

Build: https://helixre107v0xdcypoyl9e7f.blob.core.windows.net/dotnet-runtime-refs-pull-92682-merge-d089dcadfcc74738af/WasmTestOnBrowser-System.Net.WebSockets.Client.Tests/1/console.7cb91235.log?helixlogtype=result
Leg Name: Console log: 'WasmTestOnBrowser-System.Net.WebSockets.Client.Tests' from job d089dcad-fcc7-4738-afd1-f43163be9d35 (ubuntu.2204.amd64.open.rt) using docker image mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-22.04-helix-webassembly on a002M59

Error Message

{ 
    "ErrorMessage": "System.ExecutionEngineException: mono_thread_platform_create_thread() failed",
    "BuildRetry": true,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
}
Author: danmoseley
Assignees: -
Labels:

area-System.Threading
Milestone: -

@danmoseley
Copy link
Member Author

@ilonatommy there are several issues with other tests but similar failure:
https://github.com/dotnet/runtime/issues?q=is%3Aissue+is%3Aopen+ThrowThreadStartException

none of them have a known issues blob so I made this one fairly generic.

@ghost
Copy link

ghost commented Oct 11, 2023

Tagging subscribers to 'arch-wasm': @lewing
See info in area-owners.md if you want to be subscribed.

Issue Details 
warn: 
warn: Unhandled Exception:
warn: System.Threading.ThreadStartException: Thread failed to start.
warn:  ---> System.ExecutionEngineException: mono_thread_platform_create_thread() failed
warn:    --- End of inner exception stack trace ---
warn:    at System.Threading.Thread.ThrowThreadStartException(Exception ex)
warn:    at System.Threading.Thread.StartCore()
warn:    at System.Threading.Thread.Start(Boolean captureContext, Boolean internalThread)
warn:    at System.Threading.Thread.UnsafeStart()
warn:    at System.Threading.WebWorkerEventLoop.StartExitable(Thread thread, Boolean captureContext)
warn:    at System.Threading.PortableThreadPool.WorkerThread.CreateWorkerThread()
warn:    at System.Threading.PortableThreadPool.WorkerThread.MaybeAddWorkingWorker(PortableThreadPool threadPoolInstance)
warn:    at System.Threading.PortableThreadPool.RequestWorker()
warn:    at System.Threading.ThreadPoolWorkQueue.Dispatch()
warn:    at System.Threading.PortableThreadPool.WorkerThread.WorkLoopSemaphoreSuccess(LowLevelLifoAsyncWaitSemaphore semaphore, Object stateObject)
warn:    at System.Threading.LowLevelLifoAsyncWaitSemaphore.InternalAsyncWaitSuccess(LowLevelLifoAsyncWaitSemaphore self, WaitEntry internalWaitEntry)
warn:    at System.Threading.LowLevelLifoAsyncWaitSemaphore.SuccessCallback(IntPtr lifoSemaphore, IntPtr userData)
warn: [2023-10-10T23:38:40.616Z] [ERROR] FATAL UNHANDLED EXCEPTION: System.Threading.ThreadStartException: Thread failed to start.
warn:  ---> System.ExecutionEngineException: mono_thread_platform_create_thread() failed
warn:    --- End of inner exception stack trace ---
warn:    at System.Threading.Thread.ThrowThreadStartException(Exception ex)
warn:    at System.Threading.Thread.StartCore()
warn:    at System.Threading.Thread.Start(Boolean captureContext, Boolean internalThread)
warn:    at System.Threading.Thread.UnsafeStart()
warn:    at System.Threading.WebWorkerEventLoop.StartExitable(Thread thread, Boolean captureContext)
warn:    at System.Threading.PortableThreadPool.WorkerThread.CreateWorkerThread()
warn:    at System.Threading.PortableThreadPool.WorkerThread.MaybeAddWorkingWorker(PortableThreadPool threadPoolInstance)
warn:    at System.Threading.PortableThreadPool.RequestWorker()
warn:    at System.Threading.ThreadPoolWorkQueue.Dispatch()
warn:    at System.Threading.PortableThreadPool.WorkerThread.WorkLoopSemaphoreSuccess(LowLevelLifoAsyncWaitSemaphore semaphore, Object stateObject)
warn:    at System.Threading.LowLevelLifoAsyncWaitSemaphore.InternalAsyncWaitSuccess(LowLevelLifoAsyncWaitSemaphore self, WaitEntry internalWaitEntry)
warn:    at System.Threading.LowLevelLifoAsyncWaitSemaphore.SuccessCallback(IntPtr lifoSemaphore, IntPtr userData)
info: Waiting to flush log messages with a timeout of 120 secs ..
fail: Flushing log messages failed with: System.OperationCanceledException: The operation was canceled.
         at System.Threading.Channels.AsyncOperation`1.GetResult(Int16 token)
         at System.Threading.Channels.ChannelReader`1.ReadAllAsync(CancellationToken cancellationToken)+MoveNext()
         at System.Threading.Channels.ChannelReader`1.ReadAllAsync(CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestMessagesProcessor.RunAsync(CancellationToken token) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/WasmTestMessagesProcessor.cs:line 68
         at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestMessagesProcessor.RunAsync(CancellationToken token) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/WasmTestMessagesProcessor.cs:line 68
         at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestMessagesProcessor.CompleteAndFlushAsync(Nullable`1 timeout) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/WasmTestMessagesProcessor.cs:line 140. Ignoring.
fail: Tests timed out. Killing driver service pid 79

Build Information

Build: https://helixre107v0xdcypoyl9e7f.blob.core.windows.net/dotnet-runtime-refs-pull-92682-merge-d089dcadfcc74738af/WasmTestOnBrowser-System.Net.WebSockets.Client.Tests/1/console.7cb91235.log?helixlogtype=result
Leg Name: Console log: 'WasmTestOnBrowser-System.Net.WebSockets.Client.Tests' from job d089dcad-fcc7-4738-afd1-f43163be9d35 (ubuntu.2204.amd64.open.rt) using docker image mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-22.04-helix-webassembly on a002M59

Error Message

{ 
    "ErrorMessage": "System.ExecutionEngineException: mono_thread_platform_create_thread() failed",
    "BuildRetry": true,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
}
Author: danmoseley
Assignees: -
Labels:

arch-wasm, untriaged, area-VM-threading-mono
Milestone: -

@danmoseley danmoseley mentioned this issue Oct 11, 2023
Merged
@lambdageek
Copy link
Member

lambdageek commented Oct 11, 2023 •
edited
Loading

There's a setting in the threadpool for the maximum number of threads that it is allowed to start that can be set in runtimeconfig.json: https://learn.microsoft.com/en-us/dotnet/core/runtime-config/threading#maximum-threads. we should probably set it to be equal to the max number of threads that we tell emscripten to allow (minus 2-3 - the runtime consumes a bunch of threads for its own uses)

@pavelsavara pavelsavara added this to the 9.0.0 milestone Oct 19, 2023
@ghost ghost removed the untriaged New issue has not been triaged by the area owner label Oct 19, 2023
@pavelsavara pavelsavara self-assigned this Oct 19, 2023
@pavelsavara pavelsavara added the os-browser Browser variant of arch-wasm label Oct 19, 2023
@pavelsavara pavelsavara added the disabled-test The test is disabled in source code against the issue label Nov 9, 2023
@pavelsavara pavelsavara changed the title ThreadStartException in System.Net.WebSockets.Client.Tests on WASM [browser][MT] ThreadStartException in System.Net.WebSockets.Client.Tests on WASM Nov 9, 2023
@pavelsavara pavelsavara mentioned this issue Nov 9, 2023
Closed
31 tasks
@pavelsavara
Copy link
Member

Duplicate of #91538

@pavelsavara pavelsavara marked this as a duplicate of #91538 Jan 14, 2024
@github-actions github-actions bot locked and limited conversation to collaborators Feb 14, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@pavelsavara pavelsavara

Labels
arch-wasm WebAssembly architecture area-VM-threading-mono disabled-test The test is disabled in source code against the issue os-browser Browser variant of arch-wasm
Projects
None yet
Milestone
9.0.0
Development

No branches or pull requests
3 participants
@pavelsavara @lambdageek @danmoseley