Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Error when test tokenizer #145

Open
chientv-comartek opened this issue Aug 10, 2023 · 6 comments
Open

Error when test tokenizer #145

chientv-comartek opened this issue Aug 10, 2023 · 6 comments

Comments

@chientv-comartek
Copy link

chientv-comartek commented Aug 10, 2023 •
edited

environment: Ubuntu 20.04
Step : /usr/local/bin/tokenizer "Cộng hòa Xã hội chủ nghĩa Việt Nam"
Error: Error openning file, alphabetic
@xujiaw
Copy link

xujiaw commented Aug 25, 2023

Me too

@duydo
Copy link
Owner

duydo commented Aug 30, 2023

Thanks for opening issue, I'll take time to investigate.

@vinhnguyen-ct
Copy link

I also facing same issue during verify tokenizer.
Thanks you.

@diep233
Copy link

diep233 commented Apr 3, 2024

Error: Error openning file, alphabetic

Anh ơi lỗi này fix được chưa ạ, em vừa test cũng bị báo Error: Error openning file, alphabetic, em cảm ơn

@vinhnguyen-ct
Copy link

vinhnguyen-ct commented Apr 3, 2024 •
edited

hi Diep233,
Workaround, follow docker setup và copy tokenizer từ docker vào trong vm setup.
it's worked ở phía mình.
Thanks
vin

@laotong95
Copy link

Mình cũng vậy, giải quyết thế nào?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@duydo @xujiaw @diep233 @vinhnguyen-ct @chientv-comartek @laotong95