EigDiff: Eigensample Diffusion - or how to significantly reduce training dataset size with marginal performance variation?
arXiv:2610.20999v1 Announce Type: cross Abstract: Diffusion models are notoriously expensive to train, requiring large-scale datasets to learn how to gradually reverse the noise from images over multiple small denoising steps. Current approaches focus on distilling the number of diffusion steps, neglecting potential redundancies of the training data. In this paper, we explore the potential of harnessing eigensamples to train diffusion models on significantly smaller datasets, while preserving m…