Use a temp dir for the cache fixture

[jonkeane]

We can't just call https://docs.python.org/3/library/tempfile.html#examples and then use that, since we do want to pre-populate it with the contents of tests/fixtures/test_cache, but this would allow us to get rid of some of the bespoke clean up code (and likely enable the skipped tests on windows)