Skip to content
This repository has been archived by the owner on Jun 3, 2024. It is now read-only.
/ py.gpt.prompt Public archive

PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-term memory and task automation.

License

Notifications You must be signed in to change notification settings

teleprint-me/py.gpt.prompt

Repository files navigation

📝 This project and its contents were created with the assistance of OpenAI's GPT-3.5 and GPT-4.

PyGPTPrompt

PyGPTPrompt is a powerful CLI tool designed to streamline interactions with advanced AI models. It specializes in managing context windows, optimizing both short and long-term memory performance of models like OpenAI's GPT-3.5, GPT-4, and those supported by the llama.cpp Python API.

GPT-3.5 Turbo Demo

Please note that the application is currently under active development. The developer is working on separating concerns for handling the APIs and related models, implementing context window management features, and restructuring the core aspects of the library for better organization, efficiency, and performance.

Table of Contents

Prerequisites

Hardware requirements:

  • Minimum: Quad-Core Processor, 8 GB CPU RAM
  • Recommended: Octa-Core Processor, 64 GB CPU RAM, 16 GB GPU VRAM

Features

  • Context Window Management: Enhances the short-term memory performance of AI models.
  • Data Ingestion: Simplifies feeding data into AI models, enhancing their long-term memory performance.
  • Task Automation: Enables effective task automation with AI models.
  • Multiple Model Support: Integrates with OpenAI and GGML models, supporting those quantized to 4, 5, and 8-bit variations supported by the llama.cpp library.
  • Flexible Configuration: Comprehensive configuration files for customization of various parameters and settings.

Development Status

PyGPTPrompt is currently in an experimental prototype phase. It is under active development and not yet production-ready.

Documentation

Roadmap

  • Context Management: Restructuring the core APIs for congruency and alignment to simplify hot-swapping between models and improve context management.
  • Context Window Control: Implementing IRC-like commands for handling the context window, such as freezing and unfreezing select messages within the queue.
  • GPT Function Execution: Incorporating OpenAI's new Function API features for more reliable retrieval of structured data.
  • Vector Database Integration: Implementing a vector database to enhance the model's memory capabilities.
  • Fine-Tuning LLama-2 Models: Creating fine-tuned Llama-2 models for utilizing the Functions API and improving Mathematical and Programmatic reasoning for chat-like interactions.

Updates

As of Sept 16, 2023, several major changes and updates have been made. For more detailed information, refer to the individual commits in the GitHub Commits section.

Support PyGPTPrompt

PyGPTPrompt is an open-source project, and it's made possible by the support of the community. If you find this project useful and want to show your appreciation, you can support it in the following ways:

Make a Donation

If you have the means and find PyGPTPrompt useful, consider making a donation. Your contribution will go directly towards the development and maintenance of the project. You can donate using Bitcoin:

Bitcoin

Contribute

Contributions to the project are always welcome. Whether it's reporting bugs, suggesting new features, improving documentation, or writing code, your contributions are greatly appreciated. Check out the contributing guidelines for more information.

License

PyGPTPrompt is a library and CLI suite for managing AI models.
Copyright (C) 2023 Austin Berrio

This program is free software: you can redistribute it and/or modify it under
the terms of the GNU Affero General Public License as published by the Free
Software Foundation, either version 3 of the License, or (at your option) any
later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY
WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A
PARTICULAR PURPOSE. See the GNU Affero General Public License for more details.

You should have received a copy of the GNU Affero General Public License along
with this program. If not, see <https://www.gnu.org/licenses/>.

About

PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-term memory and task automation.

Topics

Resources

License

Code of conduct

Stars

Watchers

Forks

Packages

No packages published