Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

datasets: fix benchmark dataset folder #44

Open
ocramz opened this issue Feb 14, 2019 · 1 comment
Open

datasets: fix benchmark dataset folder #44

ocramz opened this issue Feb 14, 2019 · 1 comment
Assignees
Labels
bug Something isn't working infrastructure Related to the library infrastructure itself (e.g. testing, CI, etc.)

Comments

@ocramz
Copy link
Member

ocramz commented Feb 14, 2019

When running stack bench I get

bench: /Users/ocramz/.cache/datasets-hs/cifar-10-imagefolder/Truck: getDirectoryContents:openDirStream: does not exist (No such file or directory)

I guess it's a matter of copying the test data in a temporary directory before these tests.

@ocramz ocramz added the bug Something isn't working label Feb 14, 2019
@stites
Copy link
Member

stites commented Feb 15, 2019

Ah! There was a provisioning step on my machine to run the benchmark. I'll try to get to this, but the rough idea was to stream cifar-10 into the designated .cache/datasets-hs/cifar-10-imagefolder in the standard image-folder style (documented in pytorch's ImageFolder class, or the keras ImageGenerator.flow_from_directory method). I think you can do this in ghci with the current infrastructure in datasets, but I don't recall how to do it off the top of my head.

@ocramz ocramz added the infrastructure Related to the library infrastructure itself (e.g. testing, CI, etc.) label Mar 11, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working infrastructure Related to the library infrastructure itself (e.g. testing, CI, etc.)
Projects
None yet
Development

No branches or pull requests

2 participants