arXiv · 2002.10574
Generalized scale behavior and renormalization group for data analysis
Abstract
Some recent results showed that renormalization group can be considered as a promising framework to address open issues in data analysis. In this work, we focus on one of these aspects, closely related to principal component analysis for the case of large dimensional data sets with covariance having a nearly continuous spectrum. In this case, the distinction between "noise-like" and "non-noise" modes becomes arbitrary and an open challenge for standard methods. Observing that both renormalization group and principal component analysis search for simplification for systems involving many degrees of freedom, we aim to use the renormalization group argument to clarify the turning point between noise and information modes. The analogy between coarse-graining renormalization and principal component analysis has been investigated in [Journal of Statistical Physics,167, Issue 3-4, pp 462-475, (2017)], from a perturbative framework, and the implementation with real sets of data by the same authors showed that the procedure may reflect more than a simple formal analogy. In particular, the separation of sampling noise modes may be controlled by a non-Gaussian fixed point, reminiscent of the behaviour of critical systems. In our analysis, we go beyond the perturbative framework using nonperturbative techniques to investigate non-Gaussian fixed points and propose a deeper formalism allowing going beyond power-law assumptions for explicit computations.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Vincent Lahoche, Dine Ousmane Samary, Mohamed Tamaazousti. 2021-04-13. Generalized scale behavior and renormalization group for data analysis. https://doi.org/10.1088/1742-5468%2Fac52a6
Cite the original work for its findings. Save a collection to share your selection of sources.