simple regex for correcting punctuations
-
Updated
Apr 28, 2018 - Python
simple regex for correcting punctuations
Basic text to numbers tokenizer for machine learning
A PHP Library to extract n-grams from a text. Simple preprocessing tools (cleaning, tokenizing) included.
Trained a model to extract features such as tokens, stems, and capitalization from sentences in a document. Received precision score of 89.41, recall of 92.11, and F1 of 90.74. From my undergraduate NLP class at NYU.
textmining_project
SerialConfigCommand allows user to issue commands, with or without values via the Serial Monitor easily. Example: "LED=255", "Lock=1", "Start". Compatible with Arduino String() class and character array.
Python3 module to tokenize english sentences.
Developed a text classification model to classify SMS as either spam or non-spam using Python.
Implemented transformer NN block for Machine translation, text classfication, Natural language inference as well as Machine reading comprehension model.
parse text into tokens, build memory-efficient token lists and trees,
Simple Go lexer: Lex own syntax and read it's from file.
A Look at the Structure and Themes of Religious Texts Through the Ages
Add a description, image, and links to the tokenize topic page so that developers can more easily learn about it.
To associate your repository with the tokenize topic, visit your repo's landing page and select "manage topics."