Assembies are loaded incorrecty

[kemsky]

I got many random issues trying to run tests using console runner, but finally I found a reason.

Basically, bin folder contains blank dll ("\bin\Debug\net7.0\Microsoft.Data.SqlClient.dll"), which should be resolved to a more specific dll in the runtime folder (something like "bin\Debug\net7.0\runtimes\win\lib\net6.0\Microsoft.Data.SqlClient.dll") but it does not happen.

See full discussion here: dotnet/SqlClient#2064, there is a detailed explanation.

There are many many other cases like this.

This is sample repo: https://github.com/kemsky/nunit-bug

[OsirisTerje]

@kemsky Sorry for responding late on this. We have several of the same issues.
Which version of the console are you using?

[kemsky]

@OsirisTerje, I've provided sample repo, there you can find all version information.

[OsirisTerje]

    <PackageReference Include="NUnit.ConsoleRunner" Version="3.16.3" GeneratePathProperty="true" />
    <PackageReference Include="NUnit3TestAdapter" Version="4.5.0" />

You're using both these together, they don't match. See information in docs.nunit.org, under the adapter.

[manfred-brands]

@kemsky I cloned your repo and cannot reproduce an error. Both dotnet test and dotnet msbuild -t:RunTests run fine.

I also do see the runtimes folder under bin.

[kemsky]

@manfred-brands, it seems that some lower level dependency has been upgraded since I originally posted this bug which was 1,5 months ago. I can no longer reproduce it using original sample, but full test suite still fails with the same kind of errors.

dotnet-trace collect --providers Microsoft-Windows-DotNETRuntime:4 shows that different assemblies are loaded, it loads Microsoft.Extensions.Caching.Memory from program files/dotnet/shared/asp instead of local version in the bin folder when I use standalone runnner 3.16.3, when I use runner from package (also 3.16.3) it suddenly can't load System.Collections.Immutable.

dotnet test --no-build works on the very same binaries.

So problem is still there, but there is no way to reproduce it easily.

@OsirisTerje, I removed NUnit3TestAdapter - makes zero difference.

[kemsky]

@manfred-brands, original sample still fails when you use standalone runner:

NUnit Console 3.16.0 (Release)
Copyright (c) 2022 Charlie Poole, Rob Prouse
17 october 2023  15:13:32

[CharliePoole]

@kemsky Not clear which standalone runner you are using. There are, unfortunately, two different runners which display the same header information. What package did you install?