Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Split cache into subdirs for faster fs #1322

Merged
merged 4 commits into from Jul 22, 2018
Merged

Split cache into subdirs for faster fs #1322

Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
58665d3
split cache into subdirs
DeMoorJasper May 8, 2018
9f9e831
Pre-create sub-directories
devongovett Jul 22, 2018
1118a0c
Fix node 6
devongovett Jul 22, 2018
76690ed
Clean up
devongovett Jul 22, 2018
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
13 changes: 12 additions & 1 deletion src/FSCache.js
View file
Open in desktop
Expand Up @@ -23,13 +23,24 @@ class FSCache {
}

async ensureDirExists() {
if (this.dirExists) {
return;
}

await fs.mkdirp(this.dir);

// Create sub-directories for every possible hex value
// This speeds up large caches on many file systems since there are fewer files in a single directory.
for (let i = 0; i < 256; i++) {
await fs.mkdirp(path.join(this.dir, ('00' + i.toString(16)).slice(-2)));
}

this.dirExists = true;
}

getCacheFile(filename) {
let hash = md5(this.optionsHash + filename);
return path.join(this.dir, hash + '.json');
return path.join(this.dir, hash.slice(0, 2), hash.slice(2) + '.json');
}

async getLastModified(filename) {
Expand Down