Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Calculation of "beam_scores" and gradient #213

Open
Ivan-Fan opened this issue Jan 18, 2023 · 2 comments
Open

Calculation of "beam_scores" and gradient #213

Ivan-Fan opened this issue Jan 18, 2023 · 2 comments

Comments

@Ivan-Fan
Copy link

Hi! It's really great work!I am now learning and working on ASR related tasks and really appreciate your effort!

However, I still have some questions about the outputs of the functions. I noticed that "beam_scores" is a tensor but without grad_fn. Is there any way that I could preserving the computation graph in the meantime? So that I could directly use "beam_scores" to define new loss in my task.

Actually I found that tensorflow has an implementation called tf.nn.ctc_beam_search_decoder, which they could return a beam_score with gradient preserved. So I was wondering if there is any similar implementation in PyTorch?

Also, could you explain a little bit on this:
// compute aproximate ctc score as the return score, without affecting the
// return order of decoding result. To delete when decoder gets stable.

@codeking233
Copy link

have you solved this problem? I got the same question with you

@Ivan-Fan
Copy link
Author

@codeking233 No, I have not:( Do you find any solutions?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants