Taiwanese Hokkien Transliterator and Tokeniser
-
Updated
May 25, 2024 - JavaScript
Taiwanese Hokkien Transliterator and Tokeniser
Taiwanese Hokkien Transliterator and Tokeniser
XFT's smart wallet docs
Build and tokenize your own smart contract factory using Fundi, Openzeppelin, and Chainlink contracts with Foundry framework on Etherum/Base Sepolia
Sudachi in Rust 🦀 and new generation of SudachiPy
🍶 llm-distillery ⇢ use LLMs to run map-reduce summarization tasks on large documents until a target token size is met.
Ravencoin Core integration/staging tree
Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
The Libre Multilingual Analyzer, a Natural Language Processing (NLP) C++ toolkit.
Public code samples and resources for the Thales CipherTrust Application Protection products of the CipherTrust Data Security Platform
Repo Related to Natural Language Processing and Social Media Analytics.
Use Hugging Face Transformers to classify news articles
A Python library for interacting with TI-(e)z80 (82/83/84 series) calculator files
🧪 N-Gram Tools for 🙃 Phony Language that includes features like sanitizing, tokenization, n-gram extraction, frequency mapping.
Easy token price estimates for LLMs
serverless ☁️ 🚀 , pseudonymizing proxy between Worklytics and your workplace 💼 SaaS data sources' APIs. Data Loss Prevention (DLP) 🛡️🔒 and compliance layer deployable to AWS Lambda or GCP Cloud Functions.
Strukt Common Utilities
Rosette API Client Library for Java
Add a description, image, and links to the tokenization topic page so that developers can more easily learn about it.
To associate your repository with the tokenization topic, visit your repo's landing page and select "manage topics."