Reboot Agents #30387
Merged
Reboot Agents #30387
+3,675
−5,419
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
aymeric-roucher
force-pushed
the
agents
branch
2 times, most recently
from
60ae172 to
5b859e9
Compare
LysandreJik
reviewed
May 1, 2024
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
ArthurZucker
reviewed
May 3, 2024
There was a problem hiding this comment.
The colors should IMO be different to clearly mark what the agent is executing. Small plus if the colors of the python code matches the intepretor colors.
I think I might not have librosa or soundfile.
Return code needs to be supported for easy debug especially here, the errors are not straighforward.
the warning of the validation should be better formatted.
There was a problem hiding this comment.
can 't we store these on the hub?
aymeric-roucher
force-pushed
the
agents
branch
2 times, most recently
from
d75d85a to
cabc614
Compare
ArthurZucker
approved these changes
May 6, 2024
Comment on lines
23
to
35
| class SpeechToTextTool(Tool): | ||
| description = "This is a tool that transcribes an audio into text. It returns the transcribed text." | ||
| name = "transcriber" | ||
|
|
||
| inputs = {"audio": {"type": "audio", "description": "The audio to transcribe"}} | ||
| output_type = "text" | ||
|
|
||
| def __init__(self, *args, **kwargs): | ||
| super().__init__() | ||
| self.client = InferenceClient(model="distil-whisper/distil-large-v3") | ||
|
|
||
| def forward(self, audio): | ||
| return self.client.automatic_speech_recognition(audio).text |
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
|
You can also check my mini autogpt repo for reevaluating outputs which had low confidence. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What does this PR do?
Reboot agents in transformers!
cc @LysandreJik