Searcharxiv⌕ Search

arXiv · 2610.19874

Principal Component Analysis for Zero-Inflated Probability Measures via Lorenz Curves

Abstract

This paper develops a principal component analysis framework for probability measures associated with non-negative real-valued random variables with structural zeros. Specifically, leveraging the associated Lorenz Curve (LC) and a suitable perspective transformation of the plane, a bijective embedding is defined to treat such measures as functional data in a Hilbert space. Once the random LC is embedded in this space, standard Functional Principal Component Analysis (FPCA) becomes directly applicable, and the diffeomorphic nature of the embedding allows the main convergence results and their interpretations to be transferred back to the original space of LC. The a.s. and $L^2(\mathbb{P})$ consistency of the estimated eigenfunctions, eigenvalues, and modes of variation is subsequently investigated, both in the embedded space and, by virtue of the embedding's diffeomorphism property, in the original LC space. Crucially, this consistency analysis accounts for the double stochasticity of the estimation problem: one level of randomness is tied to the underlying LC process itself, while the other stems from the empirical estimation of the LC from sample data. As a consequence, consistency of the Karhunen--Loève reconstructions is also established, guaranteeing faithful approximation of individual curves in both spaces. Finally, the proposed FPCA methodology is illustrated on a real-world dataset of global export flows and compared with a naive FPCA approach.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Giacomo Aletti, Enea G. Bongiorno. 2026-10-14. Principal Component Analysis for Zero-Inflated Probability Measures via Lorenz Curves. https://arxiv.org/abs/2610.19874

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Principal stratification with continuous treatments and continuous post-treatment variables

Principal stratification (PS) is a commonly used approach for understanding the mechanisms through which a treatment affects an outcome. The goal of this work is to extend the PS framework to studies with continuous treatments, which introduces a number of both challenges and opportunities in terms of defining causal effects and performing inference. This manuscript provides multiple key methodological contributions: 1) we introduce principal causal estimands for continuous treatments that provide insights into different causal mechanisms, 2) we show that nonparametric identification is possible under a principal ignorability assumption, but only under a restrictive assumption on the joint distribution of potential mediators, which can be dropped under certain parametric assumptions, 3) we utilize nonparametric Bayesian models for the joint distribution of the potential mediating variables to mitigate issues from model misspecification, and 4) we provide theoretical justification for utilizing an outcome model to identify the joint distribution of the potential mediating variables, and show that this is only possible if a principal ignorability assumption is violated. Lastly, we illustrate our methodology by applying it to a novel study of the relationship between the economy and arrest rates, and how this is potentially mediated by police capacity.

stat.ME↗

Controlling the false discovery rate in high-dimensional linear models using model-X knockoffs and $p$-values

We propose a novel multiple testing methodology for controlling the false discovery rate (FDR) in high-dimensional linear models that integrates model-X knockoff techniques with debiased penalized regression estimators. At the foundation of our methodology, we construct and study two sets of naturally paired high-dimensional test statistics and the associated $p$-values for evaluating the same null hypotheses. The first set is shown to be asymptotically mutually independent, justifying the use of the Benjamini-Hochberg procedure. We further exploit the pairing structure through a two-step procedure aimed at improving power. Our theoretical results establish the key properties of the framework with respect to asymptotic FDR control and formally characterize the associated power gains of the two-step procedure. Importantly, our framework accommodates general dependence in the design matrix. Extensive simulations demonstrate that our methods outperform existing approaches -- particularly those relying on empirical FDP estimates -- in both power and FDR control accuracy, with notable gains in settings involving weaker signals, small sample sizes, or low target FDR levels.

stat.ME↗

Measuring frailty in the elderly: an indicator based on a super-classifier

Identifying frail older adults in an ageing population is essential for improving healthcare services. This study proposes a composite indicator to assess individual frailty levels using administrative healthcare data. Given the complex and multidimensional nature of frailty, a multi-outcome approach is adopted. Following an extensive literature review, a set of adverse health events is selected as proxies for frailty. These events were modelled using logistic classifiers, with frailty determinants (associated to adverse health events, selected using a gradient tree boosting) serving as covariates. The sensitivity and specificity of each classifier is used to compose their combined likelihood. From this, we derive an indicator capable of quantifying frailty across the population. The indicator shows robust performance across multiple outcomes and over time. Its primary innovation lies in allowing the use of diverse and outcome-specific sets of frailty determinants without any structural constraint. Overall, we offer an effective tool for quantifying frailty among older adults, potentially supporting health authorities in the prevention of frailty-related adverse events.

stat.ME↗