Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] sherpa-onnx tts models support #171

Open
mablue opened this issue Feb 24, 2024 · 4 comments
Open

[Feature Request] sherpa-onnx tts models support #171

mablue opened this issue Feb 24, 2024 · 4 comments

Comments

@mablue
Copy link

mablue commented Feb 24, 2024

Hi. Thanks for your support and fixs.
We as persian blinds community now have not any bug in latest test version :)

Please Add sherpa onnx tts models support.

Its an small opensource apk that can read sherpa models
If we can support these models internally inside tts-server we can mix up different offline languages internally in tts server and use them for multilingual porpuses. Them are like online microsoft service but them dont need internet connection that can be useable for people that some times have not internet connection.
This is the link of compiled apk files
https://k2-fsa.github.io/sherpa/onnx/tts/apk-engine.html

Also we have hugging face directory for compile and generate the tts engines apk automatically:

https://huggingface.co/csukuangfj/sherpa-onnx-apk/tree/main/tts-engine

@mablue mablue changed the title [Feature Request] sha [Feature Request] sherpa-onnx tts models support Feb 24, 2024
@jing332
Copy link
Owner

jing332 commented Feb 26, 2024

Sorry.
TTS Server is only for calling network or local TTS, I have no plans for a built-in offline engine.

@mablue
Copy link
Author

mablue commented Feb 26, 2024

Sherpa's biggest drawback is its limited GUI, which doesn't allow users to install multiple language dictionaries and rules. However, it excels as an offline Microsoft Read Aloud alternative.

TTS-server's main concern is its potential vulnerability to becoming outdated if technology advancements are not closely monitored, rendering its online services obsolete. It's important to remember that Microsoft Read Aloud is a new service and shouldn't be dismissed prematurely.

Combining these two technologies has the potential to create the best accessibility tool ever designed for the visually impaired. I plan to discuss this possibility with @csukuangfj, who might be interested in integrating this technology into their GUI.

While I believe you are an excellent Android developer, I consider @csukuangfj to be the superior expert in { #onnx, #pytorch } AI programming for this specific task.

@jing332
Copy link
Owner

jing332 commented Feb 26, 2024

If the sherpa-onnx.apk supports multiple models, would it be possible to use the local TTS functionality of the TTS server to call it?

@mablue
Copy link
Author

mablue commented Feb 27, 2024

If the sherpa-onnx.apk supports multiple models, would it be possible to use the local TTS functionality of the TTS server to call it?

Sure, The Sherpa team is seeking an expert contributor for Android UI development for make a multi voice/language UI for sherpa. Additionally, the tts-server may benefit from the incorporation of AI functionality.

k2-fsa/sherpa-onnx#569

k2-fsa/sherpa-onnx#563

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants