Latent space
Working on a compressed image, not full pixels, lets models run on consumer GPUs.
Read more about Latent space
Most modern models denoise a compressed representation (a latent) rather than full-size pixels, then decode it to an image. This is what made them run on consumer GPUs.