Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add full support of the custom filters for OpusCleaner #210

Closed
Tracked by #369
, #216
...
eu9ene opened this issue Sep 25, 2023 · 0 comments · Fixed by #547
Closed
Tracked by #369
, #216
...

Add full support of the custom filters for OpusCleaner #210

eu9ene opened this issue Sep 25, 2023 · 0 comments · Fixed by #547
Assignees
@eu9ene
Labels
quality

Comments

@eu9ene
Copy link
Collaborator

eu9ene commented Sep 25, 2023 •
edited

As a follow-up for the initial integration we should:

  • Use the OpusCleaner UI and produce the full training config for all datasets for a language pair
  • Figure out where to store all the filter configs (either this repo and being able to add a directory to TC resources or probably better using a separate repo). We can also discuss this with HPLT folks.
  • Test training with the full config
  • Compare quality to training with the default config
  • Refactor and document things if needed (see comments for the PR)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@eu9ene eu9ene

Labels
quality
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Custom cleaning mozilla/firefox-translations-training
1 participant
@eu9ene