arXiv · 2611.11967
Pairwise distortion distribution for compression and quantization
Abstract
Choosing the latent dimension is a critical challenge in data compression, where conventional hyperparameter optimization is costly and ad hoc. Intrinsic dimension provides a good alternative, which connects information-theoretic notions such as Renyi information dimension (RID) to rate-distortion dimension and random codebook compression. In this work, we introduce the pairwise distortion distribution (PDD) and its asymptotic limit, pairwise dimension (PD), which generalize the correlation integral to general distortion measures. We show that PD bounds RID, and PDD provides a lower bound for random codebook quantization performance, which can guide a practical use for compression, quantization, and dimensionality reduction applications.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Carl Nuzman, Jeongmin Chae, Kursat Rasim Mestav, Urbashi Mitra. 2026-11-09. Pairwise distortion distribution for compression and quantization. https://searcharxiv.com/abs/2611.11967
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.