PyTorch for m1 (https://pytorch.org/blog/introducing-accelerated-pytorch-trainin... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		homarp on Aug 29, 2022 \| parent \| context \| favorite \| on: Run Stable Diffusion on Intel CPUs PyTorch for m1 (https://pytorch.org/blog/introducing-accelerated-pytorch-tra... ) will not work: https://github.com/CompVis/stable-diffusion/issues/25 says "StableDiffusion is CPU-only on M1 Macs because not all the pytorch ops are implemented for Metal. Generating one image with 50 steps takes 4-5 minutes."

fragmede on Aug 29, 2022 | [–]

Yeah you can. Using the mps backend, just set PYTORCH_ENABLE_MPS_FALLBACK=1 to use the CPU for unimplementeded ops. Takes a minute but it's mostly GPU accelerated.

andybak on Aug 29, 2022 | [–]

By comparison I can generate 512x512 images every 15 seconds on an RTX 3080 (although there's an initial 30 second setup penalty for each run)

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact