Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How-to guide to cover multi-output models and their evaluation #68

Open
vfdev-5 opened this issue Nov 5, 2021 · 0 comments · May be fixed by #71
Open

How-to guide to cover multi-output models and their evaluation #68

vfdev-5 opened this issue Nov 5, 2021 · 0 comments · May be fixed by #71
Assignees
Labels
how-to-guide Improvements or additions in how-to guides

Comments

@vfdev-5
Copy link
Member

vfdev-5 commented Nov 5, 2021

The idea is to show how to tackle a use-case like:

x, y1, y2 = batch
y_pred1, y_pred2, aux = model(x)

and where we would like to compute metrics between y_pred1 vs y1 and y_pred2 vs y2.

  • Show that we can create custom evaluator that returns a dict
  • We attach metric and specify output_transform for each metric

Context: discussed on discord, "questions" channel, multi-output thread.

@vfdev-5 vfdev-5 added the how-to-guide Improvements or additions in how-to guides label Nov 5, 2021
@Priyansi Priyansi linked a pull request Nov 20, 2021 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
how-to-guide Improvements or additions in how-to guides
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants