Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use temporary filenames in the pipeline #10

Open
morungos opened this issue Jun 3, 2014 · 0 comments
Open

Use temporary filenames in the pipeline #10

morungos opened this issue Jun 3, 2014 · 0 comments
Assignees

Comments

@morungos
Copy link
Member

morungos commented Jun 3, 2014

This is a serious one. Basically, the pipeline uses temporary files with names that are keyed to the alignment alone, and within $TMPDIR. This means there is a hugely significant risk of file name conflicts between different processes handling different samples, if the same alignment is used. Much better to use a filename provided by the system, at least as part of the name, reducing the change of temporary file conflicts.

I cannot confirm that this will corrupt data, but it seems very likely when run in a cluster/cloud-type environment that temporary files will get entangled.

@morungos morungos self-assigned this Jun 3, 2014
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant