You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Python sentencepiece is a google project which is basically a tokenizer for LLM if I understand correctly?
they can be either distributed as two different packages or just one, the reason to request here is that it can't be build with a mere pip install, since of course people assume once again windows==msvc
URL for package's homepage
No response
Provide a basic test case to validate the package's functionality.
import sentencepiece in python,
MINGW environments where you need the package
MINGW64
MINGW32
UCRT64
CLANG64
CLANG32
CLANGARM64
Are you willing to submit a PR?
No response
The text was updated successfully, but these errors were encountered:
Package name
python-senetencepiece and sentencepiece
Brief description of package
Python sentencepiece is a google project which is basically a tokenizer for LLM if I understand correctly?
they can be either distributed as two different packages or just one, the reason to request here is that it can't be build with a mere pip install, since of course people assume once again windows==msvc
URL for package's homepage
No response
Provide a basic test case to validate the package's functionality.
import sentencepiece
in python,MINGW environments where you need the package
Are you willing to submit a PR?
No response
The text was updated successfully, but these errors were encountered: