arXiv · 2512.13083
DiRe: Diversity-promoting Regularization for Dataset Condensation
Abstract
In Dataset Condensation, the goal is to synthesize a small dataset that replicates the training utility of a large original dataset. Existing condensation methods synthesize datasets with significant redundancy, so there is a dire need to reduce redundancy and improve the diversity of the synthesized datasets. To tackle this, we propose an intuitive Diversity Regularizer (DiRe) composed of cosine similarity and Euclidean distance, which can be applied off-the-shelf to various state-of-the-art condensation methods. Through extensive experiments, we demonstrate that the addition of our regularizer improves state-of-the-art condensation methods on various benchmark datasets from CIFAR-10 to ImageNet-1K with respect to generalization and diversity metrics.
Explore related subjects
Keep this discovery
Saumyaranjan Mohanty, Aravind Reddy, Konda Reddy Mopuri. 2025-12-15. DiRe: Diversity-promoting Regularization for Dataset Condensation. https://arxiv.org/abs/2512.13083
Cite the original work for its findings. Save a collection to share your selection of sources.