Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Budget Management #70

Open
suchintan opened this issue Mar 14, 2024 · 2 comments
Open

Budget Management #70

suchintan opened this issue Mar 14, 2024 · 2 comments
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed P2

Comments

@suchintan
Copy link
Contributor

What would be nice is a simple feature where you can input the maximum number of calls / tokens to use on the entire call. Or even better, do some math and put in a dollar cap. i.e., go fill out the Geico forms for me and don't spend more than $1.00 doing it.
@ykeremy ykeremy added enhancement New feature or request good first issue Good for newcomers labels Mar 15, 2024
@ykeremy
Copy link
Contributor

ykeremy commented Mar 17, 2024

We're going to start using LiteLLM for LLM requests with #95. It seems they already support budgeting 🎉

https://litellm.vercel.app/docs/budget_manager

@ykeremy ykeremy changed the title Add a limit on the number of tokens to use per task (cap at some $$ amount!) Budget Managemetn Mar 17, 2024
@ykeremy ykeremy changed the title Budget Managemetn Budget Management Mar 17, 2024
@suchintan suchintan added P2 help wanted Extra attention is needed labels Mar 22, 2024
@github-actions GitHub Actions
Copy link

This issue is stale because it has been open for 30 days with no activity.

@github-actions github-actions bot added the Stale label Apr 23, 2024
@suchintan suchintan removed the Stale label May 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed P2
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@suchintan @ykeremy