Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consider versioning models directly in the repo #632

Open
erinys opened this issue Nov 22, 2023 · 6 comments
Open

Consider versioning models directly in the repo #632

erinys opened this issue Nov 22, 2023 · 6 comments

Comments

@erinys
Copy link

erinys commented Nov 22, 2023

Feature Request

What is the problem that this feature solves?

Current Git LFS path and GDrive model download paths are ok, but painful to actually figure out what you actually want, having to download everything locally or go file by file and then loading into Netron.

Describe the feature

Replace Git LFS and GDrive by just adding models and datasets directly into the repo with the XetData app and extension. This allows for easier updates and integrated Netron views. I made a copy of the existing repo with models so you can see what this would look like. It's a nicer development experience as well, since we show before and after views on commits and PRs.
netron-demo

Relevant Model Zoo feature areas

Feature Area: Model storage, file organization

Notes

I work for XetData and we are free for all public usage. Happy to make a PR for these updates if there's interest. We also have a version hosted with built in views on XetHub.

@ramkrishna2910
Copy link
Contributor

Hi @erinys
Thanks for opening the issue.
The integrated Netron visualization is really interesting.
If the models are not stored on Git LFS as its done now, where do the onnx files actually live?

@erinys
Copy link
Author

erinys commented Nov 28, 2023

The models would live in the XetHub storage backend, which is backed by S3 and free for all public repositories.

@ramkrishna2910
Copy link
Contributor

Hi @srinify @erinys
Can we setup a meeting to discuss the above proposal?

@erinys
Copy link
Author

erinys commented Feb 8, 2024

Definitely! Let me know when you're free or grab some time on my calendar: https://meetings.hubspot.com/annhuang/book.

@JigishaM
Copy link

Commenting to get updates

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants