Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add audio streaming support #67

Open
Pendrokar opened this issue Feb 10, 2024 · 2 comments
Open

Add audio streaming support #67

Pendrokar opened this issue Feb 10, 2024 · 2 comments

Comments

@Pendrokar
Copy link
Contributor

Pendrokar commented Feb 10, 2024

@DanRuta had mentioned that v0.12 of TorchAudio has streaming capabilities. If TorchAudio was xVASynth's was updated, perhaps it would easily allow implementing audio streaming?
https://pytorch.org/blog/pytorch-1.12-new-library-releases/#beta-streaming-api

[Edit] Misinterpreted, while xVASynth does install TorchAudio, it is only used for mel spectrogram representation

@Pendrokar Pendrokar changed the title Streaming support Streaming support (TorchAudio) Feb 10, 2024
@lexkoro
Copy link

lexkoro commented Feb 25, 2024

What would be the use case of this?

@Pendrokar
Copy link
Contributor Author

Pendrokar commented Feb 25, 2024

What would be the use case of this?

This would allow real-time generation of audio for Text-To-Speech and Speech-To-Speech (STS). STS also known as Voice Conversion. Playback of incomplete files depends on the use audio player or game audio engine. So while xVASynth is currently most used by Skyrim's Mantella mod, Skyrim itself is not able to playback incomplete files.

@Pendrokar Pendrokar changed the title Streaming support (TorchAudio) Add audio streaming support Feb 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants