SearcharxivSearch

arXiv subjects

Francesca Panero

Publications and source records attributed to Francesca Panero.

7 recordsLinked to original sources

The Role of Uncertainty in Assessing the Fairness of Machine Learning Models

Machine learning models are widely used in clinical applications, social media, law enforcement and critical infrastructure. Verifying whether their outputs are biased against disadvantaged groups or individuals is crucial to ensuring they are fair and allowing their use in such settings. A rigorous risk assessment of possible fairness violations requires quantifying the uncertainty associated with selecting and estimating such models. Yet, this is rarely done in the literature, which focuses on identifying a single model with a suitable trade-off between predictive accuracy and fairness. In this paper, we move beyond point estimation and discuss frequentist and Bayesian approaches to uncertainty quantification for fair machine learning, with practical examples and implications for simulated and real data.

stat.ML

Filling survey gaps in food security monitoring with spatio-temporal additive Gaussian process models

Ensuring food security across all regions of a country requires continuous monitoring, yet household surveys often leave significant spatio-temporal gaps due to resource constraints and operational priorities. In this paper, we propose a spatio-temporal additive Gaussian process model to estimate sub-national food security time series by regions. To address the computational cost of Gaussian process models, we exploit Kronecker structure of the spatio-temporal covariance matrix for scalable inference. We evaluate the proposed approach on food security survey data from Nigeria and Chad comparing it against other statistical and machine learning models and show how our proposal achieves better accuracy while retaining reliable uncertainty, especially when covariates are informative. We further apply the model to generate estimates for Nigerian states not covered by the survey, demonstrating its operational value for filling geographic gaps in food security monitoring.

stat.AP

Dynamic sparse graphs with overlapping communities

Dynamic community detection concerns inferring how community memberships evolve over time, including the emergence, persistence, merging, and dissolution of groups in temporal networks. We propose a Bayesian nonparametric model for time-evolving sparse networks, which captures power-law degree distributions and dynamically overlapping communities. The model is constructed from vectors of completely random measures coupled through a latent Markov process governing the evolution of node affiliations. This construction provides a flexible and interpretable approach to model dynamic communities, naturally generalizing existing overlapping block models to the sparse and scale-free regimes. We establish asymptotic results characterizing sparsity and degree heterogeneity over time, and develop an approximate inference procedure for recovering time-varying community trajectories. Applications to synthetic and real-world dynamic networks show that the model accurately uncovers evolving community structure and yields interpretable temporal patterns.

stat.ME

Hierarchical additive interaction modelling with Gaussian process prior and its efficient implementation for multidimensional grid data

Additive Gaussian process (GP) models offer flexible tools for modelling complex non-linear relationships and interaction effects among covariates. While most studies have focused on predictive performance, relatively little attention has been given to identifying the underlying interaction structure, which may be of scientific interest in many applications. In practice, the use of additive GP models in this context has been limited by the cubic computational cost and quadratic storage requirements of GP inference. This paper presents a fast hierarchical additive interaction GP model for multi-dimensional grid data. A hierarchical ANOVA decomposition kernel forms the foundation of our model, which incorporate main and interaction effects under the principle of marginality. Kernel centring ensures identifiability and provides a unique, interpretable decomposition of lower- and higher-order effects. For datasets forming a multi-dimensional grid, efficient implementation is achieved by exploiting the Kronecker product structure of the covariance matrix. Our contribution is to extend Kronecker-based computation to handle any interaction structure within the proposed class of hierarchical additive GP models, whereas previous methods were limited to separable or fully saturated cases. The benefits of the proposed approach are demonstrated through simulation studies and an application to high-frequency nitrogen dioxide concentration data in London.

stat.ME

Achieving Fairness with a Simple Ridge Penalty

In this paper we present a general framework for estimating regression models subject to a user-defined level of fairness. We enforce fairness as a model selection step in which we choose the value of a ridge penalty to control the effect of sensitive attributes. We then estimate the parameters of the model conditional on the chosen penalty value. Our proposal is mathematically simple, with a solution that is partly in closed form, and produces estimates of the regression coefficients that are intuitive to interpret as a function of the level of fairness. Furthermore, it is easily extended to generalised linear models, kernelised regression models and other penalties; and it can accommodate multiple definitions of fairness. We compare our approach with the regression model from Komiyama et al. (2018), which implements a provably-optimal linear regression model; and with the fair models from Zafar et al. (2019). We evaluate these approaches empirically on six different data sets, and we find that our proposal provides better goodness of fit and better predictive accuracy for the same level of fairness. In addition, we highlight a source of bias in the original experimental evaluation in Komiyama et al. (2018).

cs.LG

Optimal disclosure risk assessment

Protection against disclosure is a legal and ethical obligation for agencies releasing microdata files for public use. Consider a microdata sample of size $n$ from a finite population of size $\bar{n}=n+λn$, with $λ>0$, such that each record contains two disjoint types of information: identifying categorical information and sensitive information. Any decision about releasing data is supported by the estimation of measures of disclosure risk, which are functionals of the number of sample records with a unique combination of values of identifying variables. The most common measure is arguably the number $τ_{1}$ of sample unique records that are population uniques. In this paper, we first study nonparametric estimation of $τ_{1}$ under the Poisson abundance model for sample records. We introduce a class of linear estimators of $τ_{1}$ that are simple, computationally efficient and scalable to massive datasets, and we give uniform theoretical guarantees for them. In particular, we show that they provably estimate $τ_{1}$ all of the way up to the sampling fraction $(λ+1)^{-1}\propto (\log n)^{-1}$, with vanishing normalized mean-square error (NMSE) for large $n$. We then establish a lower bound for the minimax NMSE for the estimation of $τ_{1}$, which allows us to show that: i) $(λ+1)^{-1}\propto (\log n)^{-1}$ is the smallest possible sampling fraction; ii) estimators' NMSE is near optimal, in the sense of matching the minimax lower bound, for large $n$. This is the main result of our paper, and it provides a precise answer to an open question about the feasibility of nonparametric estimation of $τ_{1}$ under the Poisson abundance model and for a sampling fraction $(λ+1)^{-1}<1/2$.

math.ST

On sparsity, power-law and clustering properties of graphex processes

This paper investigates properties of the class of graphs based on exchangeable point processes. We provide asymptotic expressions for the number of edges, number of nodes and degree distributions, identifying four regimes: (i) a dense regime, (ii) a sparse almost dense regime, (iii) a sparse regime with power-law behaviour, and (iv) an almost extremely sparse regime. We show that under mild assumptions, both the global and local clustering coefficients converge to constants which may or may not be the same. We also derive a central limit theorem for the number of nodes. Finally, we propose a class of models within this framework where one can separately control the latent structure and the global sparsity/power-law properties of the graph.

math.ST