Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
-
Updated
Jun 12, 2024 - Dart
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM). Powers 👋 Jan
Tools for easing the handoff between AI/ML and App/SRE teams.
Gradio based tool to run opensource LLM models directly from Huggingface
Making offline AI models accessible to all types of edge devices.
PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-term memory and task automation.
Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma
Search for anything using the Google, DuckDuckGo, phind.com. Also containes AI models, can transcribe yt videos, temporary email and phone number generation, have TTS support and webai(terminal gpt and open interpeter)
Extract structured data from local or remote LLM models
Add a description, image, and links to the gguf topic page so that developers can more easily learn about it.
To associate your repository with the gguf topic, visit your repo's landing page and select "manage topics."