[Android][libraries] Test suites failing with A JSON parsing exception

[mdh1418]

The following test suites are failing on Android arm64 on CI
System.IO.Pipes.Tests
System.Numerics.Vectors.Tests
System.Reflection.Emit.Tests
System.Xml.Misc.Tests
System.Xml.XmlNodeReader.Tests
System.Xml.XmlSerializer.Tests
System.Security.Claims.Tests
System.Security.Cryptography.Primitives.Tests
System.Text.RegularExpressions.Tests

A JSON parsing exception occurred in [C:\h\w\AA5F0978\p\microsoft.dotnet.xharness.cli\1.0.0-prerelease.21268.1\tools\net6.0\any\Microsoft.DotNet.XHarness.CLI.runtimeconfig.json], offset 0 (line 1, column 1): The document is empty.
Invalid runtimeconfig.json [C:\h\w\AA5F0978\p\microsoft.dotnet.xharness.cli\1.0.0-prerelease.21268.1\tools\net6.0\any\Microsoft.DotNet.XHarness.CLI.runtimeconfig.json] [C:\h\w\AA5F0978\p\microsoft.dotnet.xharness.cli\1.0.0-prerelease.21268.1\tools\net6.0\any\Microsoft.DotNet.XHarness.CLI.runtimeconfig.dev.json]

[ghost]

Tagging subscribers to this area: @eiriktsarpalis, @layomia
See info in area-owners.md if you want to be subscribed.

Issue Details

---

The following test suites are failing on Android arm64 on CI
System.IO.Pipes.Tests
System.Numerics.Vectors.Tests
System.Reflection.Emit.Tests
System.Xml.Misc.Tests
System.Xml.XmlNodeReader.Tests
System.Xml.XmlSerializer.Tests
System.Security.Claims.Tests
System.Security.Cryptography.Primitives.Tests
System.Text.RegularExpressions.Tests

A JSON parsing exception occurred in [C:\h\w\AA5F0978\p\microsoft.dotnet.xharness.cli\1.0.0-prerelease.21268.1\tools\net6.0\any\Microsoft.DotNet.XHarness.CLI.runtimeconfig.json], offset 0 (line 1, column 1): The document is empty.
Invalid runtimeconfig.json [C:\h\w\AA5F0978\p\microsoft.dotnet.xharness.cli\1.0.0-prerelease.21268.1\tools\net6.0\any\Microsoft.DotNet.XHarness.CLI.runtimeconfig.json] [C:\h\w\AA5F0978\p\microsoft.dotnet.xharness.cli\1.0.0-prerelease.21268.1\tools\net6.0\any\Microsoft.DotNet.XHarness.CLI.runtimeconfig.dev.json]

<table>
  <tr>
    <th align="left">Author:</th>
    <td>mdh1418</td>
  </tr>
  <tr>
    <th align="left">Assignees:</th>
    <td>-</td>
  </tr>
  <tr>
    <th align="left">Labels:</th>
    <td>

`area-System.Text.Json`, `os-android`, `untriaged`

</td>
  </tr>
  <tr>
    <th align="left">Milestone:</th>
    <td>6.0.0</td>
  </tr>
</table>
</details>

[steveisok]

@mdh1418 I believe this might have to do w/ the runtimecfg.json we have for the tests.

[ghost]

Tagging subscribers to this area: @directhex
See info in area-owners.md if you want to be subscribed.

Issue Details

---

The following test suites are failing on Android arm64 on CI
System.IO.Pipes.Tests
System.Numerics.Vectors.Tests
System.Reflection.Emit.Tests
System.Xml.Misc.Tests
System.Xml.XmlNodeReader.Tests
System.Xml.XmlSerializer.Tests
System.Security.Claims.Tests
System.Security.Cryptography.Primitives.Tests
System.Text.RegularExpressions.Tests

A JSON parsing exception occurred in [C:\h\w\AA5F0978\p\microsoft.dotnet.xharness.cli\1.0.0-prerelease.21268.1\tools\net6.0\any\Microsoft.DotNet.XHarness.CLI.runtimeconfig.json], offset 0 (line 1, column 1): The document is empty.
Invalid runtimeconfig.json [C:\h\w\AA5F0978\p\microsoft.dotnet.xharness.cli\1.0.0-prerelease.21268.1\tools\net6.0\any\Microsoft.DotNet.XHarness.CLI.runtimeconfig.json] [C:\h\w\AA5F0978\p\microsoft.dotnet.xharness.cli\1.0.0-prerelease.21268.1\tools\net6.0\any\Microsoft.DotNet.XHarness.CLI.runtimeconfig.dev.json]

<table>
  <tr>
    <th align="left">Author:</th>
    <td>mdh1418</td>
  </tr>
  <tr>
    <th align="left">Assignees:</th>
    <td>mdh1418</td>
  </tr>
  <tr>
    <th align="left">Labels:</th>
    <td>

`area-Infrastructure-mono`, `area-System.Text.Json`, `os-android`

</td>
  </tr>
  <tr>
    <th align="left">Milestone:</th>
    <td>6.0.0</td>
  </tr>
</table>
</details>

[MaximLipnin]

This is being hit again on https://dev.azure.com/dnceng/public/_build/results?buildId=1573033&view=ms.vss-test-web.build-test-results-tab&runId=44174110&paneView=dotnet-dnceng.dnceng-build-release-tasks.helix-test-information-tab&resultId=162612

A JSON parsing exception occurred in [C:\h\w\B9090A3E\p\microsoft.dotnet.xharness.cli\1.0.0-prerelease.22074.1\tools\net6.0\any\Microsoft.DotNet.XHarness.CLI.runtimeconfig.json], offset 0 (line 1, column 1): The document is empty.
Invalid runtimeconfig.json [C:\h\w\B9090A3E\p\microsoft.dotnet.xharness.cli\1.0.0-prerelease.22074.1\tools\net6.0\any\Microsoft.DotNet.XHarness.CLI.runtimeconfig.json] [C:\h\w\B9090A3E\p\microsoft.dotnet.xharness.cli\1.0.0-prerelease.22074.1\tools\net6.0\any\Microsoft.DotNet.XHarness.CLI.runtimeconfig.dev.json]
User command ended with -2147450733

@premun Is this something you may be aware of?

[steveisok]

The log from another run https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-heads-main-07e81141872e45d1a4/System.Threading.RateLimiting.Tests/1/console.b4164c1d.log?sv=2019-07-07&se=2022-02-14T22%3A55%3A19Z&sr=c&sp=rl&sig=LoIU642MUilyWTZg5WrwjSrOpsb7%2BWaL2Btx102fbT8%3D

C:\h\w\9D2A08E6\w\AEF30932\e>powershell -ExecutionPolicy ByPass -NoProfile -File "xharness-helix-job.android.ps1" -app "System.Threading.RateLimiting.Tests.apk" -command_timeout 2280 -timeout "00:30:00" -package_name "net.dot.System.Threading.RateLimiting.Tests" -instrumentation "net.dot.MonoRunner"  
True
A JSON parsing exception occurred in [C:\h\w\9D2A08E6\p\dotnet-cli\shared\Microsoft.NETCore.App\6.0.0\Microsoft.NETCore.App.runtimeconfig.json], offset 0 (line 1, column 1): The document is empty.
Invalid framework config.json [C:\h\w\9D2A08E6\p\dotnet-cli\shared\Microsoft.NETCore.App\6.0.0\Microsoft.NETCore.App.runtimeconfig.json]
User command ended with -2147450733

[premun]

Interesting - for example a job 07e81141-872e-45d1-a49b-92904cac347e has many failures like this - all on the same machine.

I suspect the correlation payload (XHarness) was unzipped wrong?

[premun]

Actually, all failures in the past 14 days are coming from the same machine DNCENGWIN-036:

WorkItems
| where Finished > now() - 14d and ExitCode == -2147450733
| project FriendlyName, MachineName, Queued, Finished, ExitCode, Status, PassCount, FailCount, SkipCount, ConsoleUri

[premun]

I opened https://github.com/dotnet/core-eng/issues/15447 to track this on our side

[mdh1418]

From what it seems, the machine was reimaged and this is probably no longer an issue. Ran the test suites locally and they all passed on Android arm64 Debug. Except now System.Security.Cryptography.Primitives.Tests seems to no longer be a test suite.