Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

External embeddings #239

Open
jgcb00 opened this issue Aug 29, 2022 · 0 comments
Open

External embeddings #239

jgcb00 opened this issue Aug 29, 2022 · 0 comments
Assignees

Comments

@jgcb00
Copy link

jgcb00 commented Aug 29, 2022

Is your feature request related to a problem? Please describe.
GPU are most of the time not on the same machine than web crawlers. CPU takes time and is too slow to be use at scale for sentence embeddings.

Describe the solution you'd like
It would be nice to have an external scripts exactly like externalMT. This script will read in stdin and write embedding on stdout.
On the script the user will use whatever he wants to send the sentences to a machine with GPU to run it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants