Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

vivos和vivo同时存在于字典中,但是vivo无法被召回 #995

Open
lujinchao0416 opened this issue Jul 10, 2023 · 2 comments
Open

Comments

@lujinchao0416
Copy link

1、dict.txt如下
image
2、测试代码如下,使用搜索引擎模式
image
3、结果如下,只能召回vivos,无法召回vivo
image

@csyangchen
Copy link

搜索分词是分词加个后处理规则: 把所有长度为2或者3的子串查一遍在不在词典, 在的话输出

for w in words:

vivos中vivo刚好不符合这个规则, 可以自行加逻辑处理.

或者用AC之类的找出所有字典词

@oldeightLB
Copy link

这不是中文分词库吗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants