Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can it run SDXL? #41

Open
Sovenok-Hacker opened this issue Aug 11, 2023 · 10 comments
Open

Can it run SDXL? #41

Sovenok-Hacker opened this issue Aug 11, 2023 · 10 comments

Comments

@Sovenok-Hacker
Copy link

No description provided.

@EdVince
Copy link
Owner

EdVince commented Aug 12, 2023

Thanks for your interest in my work. I have no plans to update this project. At first I just did it to show the possibility of running SD on mobile. For SDXL you can try to convert it yourself. You can refer to this repo: diffusers-ncnn

@Sovenok-Hacker
Copy link
Author

Thanks, I`ll try to do it.

@marcpre
Copy link

marcpre commented Aug 20, 2023

How would you conceptionally do it? Just convert the sdxl or dreamshaper model to ncnn and integrate it in your code?

Appreciate your reply!

@Sovenok-Hacker
Copy link
Author

I want to run SDXL model on my PC. I don`t have a GPU, but I have a powerful CPU and a lot of RAM.

@EdVince
Copy link
Owner

EdVince commented Aug 21, 2023

Replacing SDXL is tedious because it is a completely different model. You need to change “text encoder”, “unet”, “vae”.

@marcpre
Copy link

marcpre commented Aug 21, 2023

Replacing SDXL is tedious because it is a completely different model. You need to change “text encoder”, “unet”, “vae”.

What makes it so much different?

Would you only change the diffuser?

Is SD 1.0/1.5 so much different from SDXL?

@Sovenok-Hacker
Copy link
Author

Replacing SDXL is tedious because it is a completely different model. You need to change “text encoder”, “unet”, “vae”.

Is it so difficult to convert three models to NCNN?

@JohnClaw
Copy link

Is it so difficult to convert three models to NCNN?

Привет, Совёнок. Пожалуйста, конвертируй в NCNN стандартные модели SD 1.4, SD 1.5 и SD 2.1.

@Sovenok-Hacker
Copy link
Author

Is it so difficult to convert three models to NCNN?

Привет, Совёнок. Пожалуйста, конвертируй в NCNN стандартные модели SD 1.4, SD 1.5 и SD 2.1.

Извини, сам ещё не разобрался.
Sorry, I am learning how to do it now.

@earonesty
Copy link

earonesty commented Dec 12, 2023

you might want to try this: https://github.com/autocyz/pytorch2ncnn. cuz theoretically, you should be able to autoconvert. pytorch models are just code, and so is c++/ncnn. so a codegen pipe should work

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants