arXiv subjects

Heraldo Rozas

Publications and source records attributed to Heraldo Rozas.

4 recordsLinked to original sources

arXiv2025

A novel Information-Driven Strategy for Optimal Regression Assessment

In Machine Learning (ML), a regression algorithm aims to minimize a loss function based on data. An assessment method in this context seeks to quantify the discrepancy between the optimal response for an input-output system and the estimate produced by a learned predictive model (the student). Evaluating the quality of a learned regressor remains challenging without access to the true data-generating mechanism, as no data-driven assessment method can ensure the achievability of global optimality. This work introduces the Information Teacher, a novel data-driven framework for evaluating regression algorithms with formal performance guarantees to assess global optimality. Our novel approach builds on estimating the Shannon mutual information (MI) between the input variables and the residuals and applies to a broad class of additive noise models. Through numerical experiments, we confirm that the Information Teacher is capable of detecting global optimality, which is aligned with the condition of zero estimation error with respect to the -- inaccessible, in practice -- true model, working as a surrogate measure of the ground truth assessment loss and offering a principled alternative to conventional empirical performance metrics.

stat.ML↗

arXiv2025

FDR-SVM: A Federated Distributionally Robust Support Vector Machine via a Mixture of Wasserstein Balls Ambiguity Set

We study a federated classification problem over a network of multiple clients and a central server, in which each client's local data remains private and is subject to uncertainty in both the features and labels. To address these uncertainties, we develop a novel Federated Distributionally Robust Support Vector Machine (FDR-SVM), robustifying the classification boundary against perturbations in local data distributions. Specifically, the data at each client is governed by a unique true distribution that is unknown. To handle this heterogeneity, we develop a novel Mixture of Wasserstein Balls (MoWB) ambiguity set, naturally extending the classical Wasserstein ball to the federated setting. We then establish theoretical guarantees for our proposed MoWB, deriving an out-of-sample performance bound and showing that its design preserves the separability of the FDR-SVM optimization problem. Next, we rigorously derive two algorithms that solve the FDR-SVM problem and analyze their convergence behavior as well as their worst-case time complexity. We evaluate our algorithms on industrial data and various UCI datasets, whereby we demonstrate that they frequently outperform existing state-of-the-art approaches.

cs.LG↗

arXiv2025

Data-driven joint optimization of maintenance and spare parts provisioning: A distributionally robust approach

This paper investigates the joint optimization of condition-based maintenance and spare provisioning, incorporating insights obtained from sensor data. Prognostic models estimate components' remaining lifetime distributions (RLDs), which are integrated into an optimization model to coordinate maintenance and spare provisioning. The existing literature addressing this problem assumes that prognostic models provide accurate estimates of RLDs, thereby allowing a direct adoption of Stochastic Programming or Markov Decision Process methodologies. Nevertheless, this assumption often does not hold in practice since the estimated distributions can be inaccurate due to noisy sensors or scarcity of training data. To tackle this issue, we develop a Distributionally Robust Chance Constrained (DRCC) formulation considering general discrepancy-based ambiguity sets that capture potential distribution perturbations of the estimated RLDs. The proposed formulation admits a Mixed-Integer Linear Programming (MILP) reformulation, where explicit formulas are provided to simplify the general discrepancy-based ambiguity sets. Finally, for the numerical illustration, we test a type-$\infty$ Wasserstein ambiguity set and derive closed-form expressions for the parameters of the MILP reformulation. The efficacy of our methodology is showcased in a wind turbine case study, where the proposed DRCC formulation outperforms other benchmarks based on stochastic programming and robust optimization.

math.OC↗

arXiv2024

Wasserstein Distributionally Robust Multiclass Support Vector Machine

We study the problem of multiclass classification for settings where data features $\mathbf{x}$ and their labels $\mathbf{y}$ are uncertain. We identify that distributionally robust one-vs-all (OVA) classifiers often struggle in settings with imbalanced data. To address this issue, we use Wasserstein distributionally robust optimization to develop a robust version of the multiclass support vector machine (SVM) characterized by the Crammer-Singer (CS) loss. First, we prove that the CS loss is bounded from above by a Lipschitz continuous function for all $\mathbf{x} \in \mathcal{X}$ and $\mathbf{y} \in \mathcal{Y}$, then we exploit strong duality results to express the dual of the worst-case risk problem, and we show that the worst-case risk minimization problem admits a tractable convex reformulation due to the regularity of the CS loss. Moreover, we develop a kernel version of our proposed model to account for nonlinear class separation, and we show that it admits a tractable convex upper bound. We also propose a projected subgradient method algorithm for a special case of our proposed linear model to improve scalability. Our numerical experiments demonstrate that our model outperforms state-of-the art OVA models in settings where the training data is highly imbalanced. We also show through experiments on popular real-world datasets that our proposed model often outperforms its regularized counterpart as the first accounts for uncertain labels unlike the latter.

cs.LG↗