[New Extension] Ultimate SD upscaler

[Coyote-A]

It's tile-based upscale script like in-build "sd upscale", but can work with high denoise (0.35-0.5), produce less seams and makes more converging tiles.
https://github.com/Coyote-A/ultimate-upscale-for-automatic1111

I'd like to add it to extensions index. Can someone with write access help me? @AUTOMATIC1111 @ClashSAN

Some examples
original 512x768

sd upscale, 2048x3072, 0.45 denoise, 576x576 tile

ultimate sd upscaler, 2048x3072, 0.45 denoise, 576x576 tile

original 512x512

sd upscale 2048x2048, 0.45 denoise, 1088x1088 tile

ultimate sd upscaler 2048x2048, 0.45 denoise, 1024x1024 tile

[Michoko92]

Very nice extension, thank you!

I had very good results with denoising 0.3 (on par with upscalers like "003_realSR_BSRGAN_DFOWMFC_s64w8_SwinIR-L_x4_GAN"). I still have tests to make, but your work is really appreciated! Cheers!

[playlogitech]

is it any better than lsdr + valar?

[Coyote-A]

yes its better. i dont have valar but raw lsdr makes something like this on face when i try to upscale first image. I think sd passes is necessary to add detalization. lsdr is also dont use tiles, so my attemt to get 4k image failed because of "CUDA out of memory"

[Coyote-A]

compare it with ultimate sd upscaler

[playlogitech]

Honestly, i think there is no problem with upscaler but with original image eyes quality, because even with result you demonstrated from sd ultimate, eyes of knight girl still looks afwul. Yes there is no visible artifacts, but this result is still not apropriate. It will be easier to fix eyes in inpaint first and only then upscale, than wasting dozens of attempts on upscales to try fix that

[Coyote-A]

yep. i agree that this is not silver bullet. it's just another helpful tool in workflow. but don't forget that the images I've shown are quite high denoised for this tile size (0.45 for 512). if you use 0.35 then you can get a very clear image, almost without artifacts, which can then be finalized with a small number of inpaints.

[Michoko92]

I think it would be much better to have a dedicated "scale by" slider in the script, instead of having to change the image dimensions in the regular img2img width/height sliders. For me, those sliders are representative of the original image dimensions, and should not be used to set the dimensions of the final upscaled image. I really prefer the approach of the original SD upscale script regarding this, where you have a scale slider.

Thank you!

[Coyote-A]

you can use scale slider

[Michoko92]

Oh I had missed that, thank you!

[superprohero]

will this work for vlad diffusion?

[victor3387]

How can I use this script in txt2img?

[tieincred]

Hey, can someone explain what is this doing exactly, upscaling and then running tile on different parts of image?

[maciekish]

Is it possible to enable this for txt2img as well? It doesnt show up there, only img2img.

[Woisek]

t2i uses latent upscale, i2i pixel based upscale. USD is a pixel based upscaler, how do you think this should work? 🤷‍♂️