Language processing interface: some tools to process different natural languages
-
Updated
Jul 28, 2017 - Java
Language processing interface: some tools to process different natural languages
Compiler Construction contains three phase 1)Lexical Analyzer 2)Syntax Analyzer 3)Semantic Analyzer
deep learning based sequence labeling tools
Basics of Natural Language Processing
A restaurant management web application in which the system assigns a unique token to each order and notifies the customer when the order is complete.
A small experiment using both Mecab and Tinysegmenter to create a tokenized list of Japanese sentences in JSON, taken from the Tatoeba corpus.
A simple spam classifier using Naive Bayes and Natural Language Processing
Simple Swift Introduction to Natural Language Processing for Educational purposes
Designed a mini-search engine using English language Wikipedia corpus of size 80 GB by creating inverted indices. It gives you top search result related to given query words.
Super-efficient and capable MIDI music AI encoding/tokenization strategy proposal
Implementation of C++ lexical analyzer to demonstrate how it actually works as a part of the compiler.
Sentiment Analysis for Moroccan Dialect
DApp for digitizing real estate assets
Preprocess a sample text by performing word and sentence tokenization, stopword removal, and stemming
Welcome to the Zenith Token Application, where managing your Zenith tokens is a seamless experience. This application empowers you to effortlessly check your token balance and execute secure transactions by sending Zenith tokens to other addresses.
This project utilizes a machine learning model where consumer brand data is employed. Initially, a preliminary model is developed, followed by a refined model using a process called 'fine-tuning' to improve results. Additionally, a comprehensive testing suite has been created to validate accuracy and reliability of the model's predictions.
Add a description, image, and links to the tokenization topic page so that developers can more easily learn about it.
To associate your repository with the tokenization topic, visit your repo's landing page and select "manage topics."