Improve validation time performance by re-using caching compiler host from previous steps

[timocov]

We can reduce validation time as technically we can re-use the same caches during the validation time (when running without --no-check) to avoid processing the same files again and again, probably get drop a few extra hundreds of ms.

Originally posted by @timocov in #303 (comment)