Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Idea] Option to add dataflow, model tests #5

Open
vfdev-5 opened this issue Mar 9, 2021 · 0 comments
Open

[Idea] Option to add dataflow, model tests #5

vfdev-5 opened this issue Mar 9, 2021 · 0 comments
Labels
enhancement New feature or request needs-discussion

Comments

@vfdev-5
Copy link
Member

vfdev-5 commented Mar 9, 2021

Here is an idea to think about for later versions, like v0.3 etc

Context

Let's imagine I use the generator to quick-start with my specific problem: own dataflow, model etc.
I generate the code and start to bootstrap things between the training code and my custom things. Without running the training, it is almost impossible to ensure the correctness, however, I could think of some basic additional tests with verbose option to ensure that my own dataloaders and the model provide the expected info.

Feature

Let's say generated files are:

- main.py
- model.py
- dataflow.py
- utils.py

The idea is to provide additional folder:

tests
 - test_dataflow.py
 - test_model.py

where we can provide a skeleton code for

  • loop over few dataloader batches and either show images (like here)or assert dimensions.
  • assert the output shape/type of the model

Anyway, this is something to discuss and brain storm...

@vfdev-5 vfdev-5 added enhancement New feature or request needs-discussion labels Mar 9, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request needs-discussion
Projects
None yet
Development

No branches or pull requests

1 participant