You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
GPU are most of the time not on the same machine than web crawlers. CPU takes time and is too slow to be use at scale for sentence embeddings.
Describe the solution you'd like
It would be nice to have an external scripts exactly like externalMT. This script will read in stdin and write embedding on stdout.
On the script the user will use whatever he wants to send the sentences to a machine with GPU to run it.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
GPU are most of the time not on the same machine than web crawlers. CPU takes time and is too slow to be use at scale for sentence embeddings.
Describe the solution you'd like
It would be nice to have an external scripts exactly like externalMT. This script will read in stdin and write embedding on stdout.
On the script the user will use whatever he wants to send the sentences to a machine with GPU to run it.
The text was updated successfully, but these errors were encountered: