Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

debug slow windows temp purge #3677

Closed

Conversation

IanButterworth
Copy link
Sponsor Member

@IanButterworth IanButterworth commented Oct 26, 2023

I'm not sure why Windows is so much slower than other platforms.
Some rudimentary benchmarking here done on all Github CI runners doesn't show the Windows runners as outliers in cpu or disk io (the analysis is crude though)..
IanButterworth/SystemBenchmark.jl#8 (comment)

@IanButterworth
Copy link
Sponsor Member Author

IanButterworth commented Oct 26, 2023

Some path cleanup jobs are very slow on Windows, but most are <<1s
These are all that are > 1s

Windows

Test Summary: | Pass  Broken  Total      Time
Pkg           | 3258       2   3260  41m13.5s
[ Info: temp_cleanup_purge started
┌ Info: C:\Users\runneradmin\AppData\Local\Temp\jl_FIOQpu took 1.3071288 seconds
│   contents =
│    2-element Vector{String}:
│     "Project.toml"
└     "src"
┌ Info: C:\Users\runneradmin\AppData\Local\Temp\jl_tGKtvr took 165.7193711 seconds
│   contents =
│    2-element Vector{String}:
│     "loaded_depot"
└     "registry_depot"
┌ Info: C:\Users\runneradmin\AppData\Local\Temp\jl_sUpiWl took 1.0247196 seconds
│   contents =
│    6-element Vector{String}:
│     "clones"
│     "compiled"
│     "logs"
│     "packages"
│     "registries"
└     "scratchspaces"
┌ Info: C:\Users\runneradmin\AppData\Local\Temp\jl_DZAS4U took 145.986978 seconds
│   contents =
│    1-element Vector{String}:
└     "registry_depot"
temp_cleanup_purge(force = true): 316.891713 seconds (5.22 M allocations: 383.824 MiB, 0.41% gc time, 0.20% compilation time)

Linux

Test Summary: | Pass  Broken  Total      Time
Pkg           | 3278       2   3280  21m47.3s
[ Info: temp_cleanup_purge started
┌ Info: /tmp/jl_QjyQib took 1.704146616 seconds
│   contents =
│    1-element Vector{String}:
└     "registry_depot"
┌ Info: /tmp/jl_y9iBfz took 1.768122787 seconds
│   contents =
│    2-element Vector{String}:
│     "loaded_depot"
└     "registry_depot"
temp_cleanup_purge(force = true): 4.140046 seconds (1.57 M allocations: 151.227 MiB, 0.99% gc time, 14.00% compilation time)

@IanButterworth
Copy link
Sponsor Member Author

There are a few upstream issues/regressions reported

actions/checkout#1186

actions/runner-images#7320

@IanButterworth IanButterworth deleted the ib/debug_slow_windows branch November 3, 2023 23:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant