Optimize markdown files processing #14
Labels
Back-end (Python)
enhancement
New feature or request
hacktoberfest
help wanted
Extra attention is needed
The processing of markdown files so they can be classified is very slow, and is code I haven't messed around with.
It should probably be this script: https://github.com/hpbl/WRITEME/blob/master/containerizedModel/script/classifier/load_combined_set_and_train_model.py
But it could also involve other ones.
Maybe there are ways to make this faster (parallel?). It might even be the case to write this part using another language like cpp.
Thanks!
The text was updated successfully, but these errors were encountered: