New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feat: Get token usage data for streamed chat completion response. #211

Open

sdimka wants to merge 1 commit into MacPaw:main from sdimka:feature

sdimka commented May 19, 2024

What

Added a feature to retrieve token usage in stream chat mode.

Why

This functionality is available in the original API and could be useful for some users.

Affected Areas

Added the streamOptions parameter to ChatQuery to enable feature.
Included Usage in ChatStreamResult to fetch data usage results.


          Feat: Get token usage data for streamed chat completion response.

9413cce

sonarcloud bot commented May 19, 2024

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
0.0% Duplication on New Code

See analysis details on SonarCloud

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment