Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add checksum verification for downloaded models #977

Closed
benoitf opened this issue Apr 24, 2024 · 0 comments · Fixed by #1078
Closed

add checksum verification for downloaded models #977

benoitf opened this issue Apr 24, 2024 · 0 comments · Fixed by #1078
Assignees
Milestone

Comments

@benoitf
Copy link
Collaborator

benoitf commented Apr 24, 2024

it looks like when huggingface.co is not working, we download files thinking it worked well but in fact it downloaded a corrupted file

as huggingface.co is providing the checksums for the files, checksum should be added to the ai.json file in the models definition https://github.com/containers/podman-desktop-extension-ai-lab/blob/main/packages/backend/src/assets/ai.json#L110

and we should verify the checksum once downloaded

how to get checksum, just click on the file on huggingface.co
example on https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF/blob/main/mistral-7b-instruct-v0.1.Q4_K_M.gguf

you see

Git LFS Details
SHA256: 14466f9d658bf4a79f96c3f3f22759707c291cac4e62fea625e80c7d32169991
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: ✔️ Done
Development

Successfully merging a pull request may close this issue.

4 participants