SearcharxivSearch

arXiv subjects

Lucia Pezzetti

Publications and source records attributed to Lucia Pezzetti.

2 recordsLinked to original sources

Bounded Linear Programs for Data-Driven Optimal Control via Moment-Matching

Linear programming (LP) formulations offer a conceptually elegant approach to infinite-horizon, model-free nonlinear optimal control in continuous spaces. However, in addition to the curse of dimensionality, their practical use is limited by the difficulty of consistently obtaining bounded solutions. In this work, we use moment-matching techniques to derive sufficient boundedness conditions in terms of the available dataset and the cost vector of the LP. Moreover, we discuss practical design methods for nonlinear systems and polynomial features.

math.OC

Function-Space MCMC for Bayesian Wide Neural Networks

Bayesian Neural Networks represent a fascinating confluence of deep learning and probabilistic reasoning, offering a compelling framework for understanding uncertainty in complex predictive models. In this paper, we investigate the use of the preconditioned Crank-Nicolson algorithm and its Langevin version to sample from a reparametrised posterior distribution of the neural network's weights, as the widths grow larger. In addition to being robust in the infinite-dimensional setting, we prove that the acceptance probabilities of the proposed algorithms approach 1 as the width of the network increases, independently of any stepsize tuning. Moreover, we examine and compare how the mixing speeds of the underdamped Langevin Monte Carlo, the preconditioned Crank-Nicolson and the preconditioned Crank-Nicolson Langevin samplers are influenced by changes in the network width in some real-world cases. Our findings suggest that, in wide Bayesian Neural Networks configurations, the preconditioned Crank-Nicolson algorithm allows for a scalable and more efficient sampling of the reparametrised posterior distribution, as also evidenced by a higher effective sample size and improved diagnostic results compared with the other analysed algorithms.

cs.LG