Searcharxiv⌕ Search

arXiv subjects

Renato De Leone

Publications and source records attributed to Renato De Leone.

5 recordsLinked to original sources

A Robust Twin Parametric Margin Support Vector Machine for Multiclass Classification

In this paper, we introduce novel Twin Parametric Margin Support Vector Machine (TPMSVM) models designed to address multiclass classification tasks under feature uncertainty. To handle data perturbations, we construct bounded-by-norm uncertainty set around each training observation and derive the robust counterparts of the deterministic models using robust optimization techniques. To capture complex data structure, we explore both linear and kernel-induced classifiers, providing computationally tractable reformulations of the resulting robust models. Additionally, we propose two alternatives for the final decision function, enhancing models' flexibility. Finally, we validate the effectiveness of the proposed robust multiclass TPMSVM methodology on real-world datasets, showing the good performance of the approach in the presence of uncertainty.

cs.LG↗

Comparison of High-Dimensional Bayesian Optimization Algorithms on BBOB

Bayesian Optimization (BO) is a class of black-box, surrogate-based heuristics that can efficiently optimize problems that are expensive to evaluate, and hence admit only small evaluation budgets. BO is particularly popular for solving numerical optimization problems in industry, where the evaluation of objective functions often relies on time-consuming simulations or physical experiments. However, many industrial problems depend on a large number of parameters. This poses a challenge for BO algorithms, whose performance is often reported to suffer when the dimension grows beyond 15 variables. Although many new algorithms have been proposed to address this problem, it is not well understood which one is the best for which optimization scenario. In this work, we compare five state-of-the-art high-dimensional BO algorithms, with vanilla BO and CMA-ES on the 24 BBOB functions of the COCO environment at increasing dimensionality, ranging from 10 to 60 variables. Our results confirm the superiority of BO over CMA-ES for limited evaluation budgets and suggest that the most promising approach to improve BO is the use of trust regions. However, we also observe significant performance differences for different function landscapes and budget exploitation phases, indicating improvement potential, e.g., through hybridization of algorithmic components.

cs.LG↗

BinarySDG: binary sensor data generation with R

The scarcity of Smart Home data is still a pretty big problem, and in a world where the size of a dataset can often make the difference between a poor performance and a good performance for problems related to machine learning projects, this needs to be resolved. But whereas the problem of retrieving real data can't really be resolved, as most of the time the process of installing sensors and retrieving data can be found to be really expensive and time-consuming, we need to find a faster and easier solution, which is where synthetic data comes in. Here we propose BinarySDG (Binary Synthetic Data Generator) as a flexible and easy way to generate synthetic data for binary sensors.

cs.OH↗

Electre Tri-Machine Learning Approach to the Record Linkage Problem

In this short paper, the Electre Tri-Machine Learning Method, generally used to solve ordinal classification problems, is proposed for solving the Record Linkage problem. Preliminary experimental results show that, using the Electre Tri method, high accuracy can be achieved and more than 99% of the matches and nonmatches were correctly identified by the procedure.

stat.ML↗

The use of Grossone in Mathematical Programming and Operations Research

The concepts of infinity and infinitesimal in mathematics date back to anciens Greek and have always attracted great attention. Very recently, a new methodology has been proposed by Sergeyev for performing calculations with infinite and infinitesimal quantities, by introducing an infinite unit of measure expressed by the numeral grossone. An important characteristic of this novel approach is its attention to numerical aspects. In this paper we will present some possible applications and use of grossone in Operations Research and Mathematical Programming. In particular, we will show how the use of grossone can be beneficial in anti--cycling procedure for the well-known simplex method for solving Linear Programming Problems and in defining exact differentiable Penalty Functions in Nonlinear Programming.

math.OC↗