Searcharxiv⌕ Search

arXiv subjects

Lorenzo Pareschi

Publications and source records attributed to Lorenzo Pareschi.

At least 73 records · Page 4Linked to original sources

Consensus-Based Optimization on the Sphere: Convergence to Global Minimizers and Machine Learning

We investigate the implementation of a new stochastic Kuramoto-Vicsek-type model for global optimization of nonconvex functions on the sphere. This model belongs to the class of Consensus-Based Optimization. In fact, particles move on the sphere driven by a drift towards an instantaneous consensus point, which is computed as a convex combination of particle locations, weighted by the cost function according to Laplace's principle, and it represents an approximation to a global minimizer. The dynamics is further perturbed by a random vector field to favor exploration, whose variance is a function of the distance of the particles to the consensus point. In particular, as soon as the consensus is reached the stochastic component vanishes. The main results of this paper are about the proof of convergence of the numerical scheme to global minimizers provided conditions of well-preparation of the initial datum. The proof combines previous results of mean-field limit with a novel asymptotic analysis, and classical convergence results of numerical methods for SDE. We present several numerical experiments, which show that the algorithm proposed in the present paper scales well with the dimension and is extremely versatile. To quantify the performances of the new approach, we show that the algorithm is able to perform essentially as good as ad hoc state of the art methods in challenging problems in signal processing and machine learning, namely the phase retrieval problem and the robust subspace detection.

cs.LG↗

A bi-fidelity stochastic collocation method for transport equations with diffusive scaling and multi-dimensional random inputs

In this paper, we consider the development of efficient numerical methods for linear transport equations with random parameters and under the diffusive scaling. We extend to the present case the bi-fidelity stochastic collocation method introduced in [33,50,51]. For the high-fidelity transport model, the asymptotic-preserving scheme [29] is used for each stochastic sample. We employ the simple two-velocity Goldstein-Taylor equation as low-fidelity model to accelerate the convergence of the uncertainty quantification process. The choice is motivated by the fact that both models, high fidelity and low fidelity, share the same diffusion limit. Speed-up is achieved by proper selection of the collocation points and relative approximation of the high-fidelity solution. Extensive numerical experiments are conducted to show the efficiency and accuracy of the proposed method, even in non diffusive regimes, with empirical error bound estimations as studied in [16].

math.NA↗

On the construction of conservative semi-Lagrangian IMEX advection schemes for multiscale time dependent PDEs

This article is devoted to the construction of a new class of semi-Lagrangian (SL) schemes with implicit-explicit (IMEX) Runge-Kutta (RK) time stepping for PDEs involving multiple space-time scales. The semi-Lagrangian (SL) approach fully couples the space and time discretization, thus making the use of RK strategies particularly difficult to be combined with. First, a simple scalar advection-diffusion equation is considered as a prototype PDE for the development of a high order formulation of the semi-Lagrangian IMEX algorithms. The advection part of the PDE is discretized explicitly at the aid of a SL technique, while an implicit discretization is employed for the diffusion terms. Second, the SL-IMEX approach is extended to deal with hyperbolic systems with multiple scales, including balance laws, that involve shock waves and other discontinuities. A novel SL technique is proposed, which is based on the integration of the governing equations over the space-time control volume which arises from the motion of each grid point. High order of accuracy is ensured by the usage of IMEX RK schemes combined with a Cauchy-Kowalevskaya procedure that provides a predictor solution within each space-time element. The one-dimensional shallow water equations (SWE) are chosen to validate the new conservative SL-IMEX schemes, where convection and pressure fluxes are treated explicitly and implicitly, respectively. The asymptotic-preserving (AP) property of the novel schemes is also studied considering a relaxation PDE system for the SWE. A large suite of convergence studies for both the non-conservative and the conservative version of the novel class of methods demonstrates that the formal order of accuracy is achieved and numerical evidences about the conservation property are shown. The AP property for the corresponding relaxation system is also investigated.

math.NA↗

Spatial spread of COVID-19 outbreak in Italy using multiscale kinetic transport equations with uncertainty

In this paper we introduce a space-dependent multiscale model to describe the spatial spread of an infectious disease under uncertain data with particular interest in simulating the onset of the COVID-19 epidemic in Italy. While virus transmission is ruled by a SEIAR type compartmental model, within our approach the population is given by a sum of commuters moving on a extra-urban scale and non commuters interacting only on the smaller urban scale. A transport dynamic of the commuter population at large spatial scales, based on kinetic equations, is coupled with a diffusion model for non commuters at the urban scale. Thanks to a suitable scaling limit, the kinetic transport model used to describe the dynamics of commuters, within a given urban area coincides with the diffusion equations that characterize the movement of non-commuting individuals. Because of the high uncertainty in the data reported in the early phase of the epidemic, the presence of random inputs in both the initial data and the epidemic parameters is included in the model. A robust numerical method is designed to deal with the presence of multiple scales and the uncertainty quantification process. In our simulations, we considered a realistic geographical domain, describing the Lombardy region, in which the size of the cities, the number of infected individuals, the average number of daily commuters moving from one city to another, and the epidemic aspects are taken into account through a calibration of the model parameters based on the actual available data. The results show that the model is able to describe correctly the main features of the spatial expansion of the first wave of COVID-19 in northern Italy.

q-bio.PE↗

Modelling lockdown measures in epidemic outbreaks using selective socio-economic containment with uncertainty

After the introduction of drastic containment measures aimed at stopping the epidemic contagion from SARS-CoV2, many governments have adopted a strategy based on a periodic relaxation of such measures in the face of a severe economic crisis caused by lockdowns. Assessing the impact of such openings in relation to the risk of a resumption of the spread of the disease is an extremely difficult problem due to the many unknowns concerning the actual number of people infected, the actual reproduction number and infection fatality rate of the disease. In this work, starting from a compartmental model with a social structure and stochastic inputs, we derive models with multiple feedback controls depending on the social activities that allow to assess the impact of a selective relaxation of the containment measures in the presence of uncertain data. Specific contact patterns in the home, work, school and other locations have been considered. Results from different scenarios concerning the first wave of the epidemic in some major countries, including Germany, France, Italy, Spain, the United Kingdom and the United States, are presented and discussed.

q-bio.PE↗

Hyperbolic compartmental models for epidemic spread on networks with uncertain data: application to the emergence of Covid-19 in Italy

The importance of spatial networks in the spread of an epidemic is an essential aspect in modeling the dynamics of an infectious disease. Additionally, any realistic data-driven model must take into account the large uncertainty in the values reported by official sources, such as the amount of infectious individuals. In this paper we address the above aspects through a hyperbolic compartmental model on networks, in which nodes identify locations of interest, such as cities or regions, and arcs represent the ensemble of main mobility paths. The model describes the spatial movement and interactions of a population partitioned, from an epidemiological point of view, on the basis of an extended compartmental structure and divided into commuters, moving on a suburban scale, and non-commuters, acting on an urban scale. Through a diffusive rescaling, the model allows us to recover classical diffusion equations related to commuting dynamics. The numerical solution of the resulting multiscale hyperbolic system with uncertainty is then tackled using a stochastic collocation approach in combination with a finite-volume IMEX method. The ability of the model to correctly describe the spatial heterogeneity underlying the spread of an epidemic in a realistic city network is confirmed with a study of the outbreak of COVID-19 in Italy and its spread in the Lombardy Region.

q-bio.PE↗

Moment preserving Fourier-Galerkin spectral methods and application to the Boltzmann equation

Spectral methods, thanks to the high accuracy and the possibility of using fast algorithms, represent an effective way to approximate collisional kinetic equations in kinetic theory. On the other hand, the loss of some local invariants can lead to the wrong long time behavior of the numerical solution. We introduce in this paper a novel Fourier-Galerkin spectral method that improves the classical spectral method by making it conservative on the moments of the approximated distribution, without sacrificing its spectral accuracy or the possibility of using fast algorithms. The method is derived directly using a constrained best approximation in the space of trigonometric polynomials and can be applied to a wide class of problems where preservation of moments is essential. We then apply the new spectral method to the evaluation of the Boltzmann collision term, and prove spectral consistency and stability of the resulting Fourier-Galerkin approximation scheme. Various numerical experiments illustrate the theoretical findings.

math.NA↗

Anisotropic Diffusion in Consensus-based Optimization on the Sphere

In this paper we are concerned with the global minimization of a possibly non-smooth and non-convex objective function constrained on the unit hypersphere by means of a multi-agent derivative-free method. The proposed algorithm falls into the class of the recently introduced Consensus-Based Optimization. In fact, agents move on the sphere driven by a drift towards an instantaneous consensus point, which is computed as a convex combination of agent locations, weighted by the cost function according to Laplaces principle, and it represents an approximation to a global minimizer. The dynamics is further perturbed by an anisotropic random vector field to favor exploration. The main results of this paper are about the proof of convergence of the numerical scheme to global minimizers provided conditions of well-preparation of the initial datum. The proof of convergence combines a mean-field limit result with a novel asymptotic analysis, and classical convergence results of numerical methods for SDE. The main innovation with respect to previous work is the introduction of an anisotropic stochastic term, which allows us to ensure the independence of the parameters of the algorithm from the dimension and to scale the method to work in very high dimension. We present several numerical experiments, which show that the algorithm proposed in the present paper is extremely versatile and outperforms previous formulations with isotropic stochastic noise.

math.OC↗

Mean-field control variate methods for kinetic equations with uncertainties and applications to socio-economic sciences

In this paper, we extend a recently introduced multi-fidelity control variate for the uncertainty quantification of the Boltzmann equation to the case of kinetic models arising in the study of multiagent systems. For these phenomena, where the effect of uncertainties is particularly evident, several models have been developed whose equilibrium states are typically unknown. In particular, we aim to develop efficient numerical methods based on solving the kinetic equations in the phase space by Direct Simulation Monte Carlo (DSMC) coupled to a Monte Carlo sampling in the random space. To this end, exploiting the knowledge of the corresponding mean-field approximation we develop novel mean-field Control Variate (MFCV) methods that are able to strongly reduce the variance of the standard Monte Carlo sampling method in the random space. We verify these observations with several numerical examples based on classical models , including wealth exchanges and opinion formation model for collective phenomena.

math.NA↗

Uncertainty quantification of viscoelastic parameters in arterial hemodynamics with the a-FSI blood flow model

This work aims at identifying and quantifying uncertainties related to elastic and viscoelastic parameters, which characterize the arterial wall behavior, in one-dimensional modeling of the human arterial hemodynamics. The chosen uncertain parameters are modeled as random Gaussian-distributed variables, making stochastic the system of governing equations. The proposed methodology is initially validated on a model equation, presenting a thorough convergence study which confirms the spectral accuracy of the stochastic collocation method and the second-order accuracy of the IMEX finite volume scheme chosen to solve the mathematical model. Then, univariate and multivariate uncertain quantification analyses are applied to the a-FSI blood flow model, concerning baseline and patient-specific single-artery test cases. A different sensitivity is depicted when comparing the variability of flow rate and velocity waveforms to the variability of pressure and area, the latter ones resulting much more sensitive to the parametric uncertainties underlying the mechanical characterization of vessel walls. Simulations performed considering both the simple elastic and the more realistic viscoelastic constitutive law show that the great uncertainty of the viscosity parameter plays a major role in the prediction of pressure waveforms, enlarging the confidence interval of this variable. In-vivo recorded patient-specific pressure data falls within the confidence interval of the output obtained with the proposed methodology and expectations of the computed pressures are comparable to the recorded waveforms.

physics.flu-dyn↗

Modeling and simulating the spatial spread of an epidemic through multiscale kinetic transport equations

In this work we propose a novel space-dependent multiscale model for the spread of infectious diseases in a two-dimensional spatial context on realistic geographical scenarios. The model couples a system of kinetic transport equations describing a population of commuters moving on a large scale (extra-urban) with a system of diffusion equations characterizing the non commuting population acting over a small scale (urban). The modeling approach permits to avoid unrealistic effects of traditional diffusion models in epidemiology, like infinite propagation speed on large scales and mass migration dynamics. A construction based on the transport formalism of kinetic theory allows to give a clear model interpretation to the interactions between infected and susceptible in compartmental space-dependent models. In addition, in a suitable scaling limit, our approach permits to couple the two populations through a consistent diffusion model acting at the urban scale. A discretization of the system based on finite volumes on unstructured grids, combined with an asymptotic preserving method in time, shows that the model is able to describe correctly the main features of the spatial expansion of an epidemic. An application to the initial spread of COVID-19 is finally presented.

math.NA↗

From particle swarm optimization to consensus based optimization: stochastic modeling and mean-field limit

In this paper we consider a continuous description based on stochastic differential equations of the popular particle swarm optimization (PSO) process for solving global optimization problems and derive in the large particle limit the corresponding mean-field approximation based on Vlasov-Fokker-Planck-type equations. The disadvantage of memory effects induced by the need to store the local best position is overcome by the introduction of an additional differential equation describing the evolution of the local best. A regularization process for the global best permits to formally derive the respective mean-field description. Subsequently, in the small inertia limit, we compute the related macroscopic hydrodynamic equations that clarify the link with the recently introduced consensus based optimization (CBO) methods. Several numerical examples illustrate the mean field process, the small inertia limit and the potential of this general class of global optimization methods.

math.NA↗

Hyperbolic models for the spread of epidemics on networks: kinetic description and numerical methods

We consider the development of hyperbolic transport models for the propagation in space of an epidemic phenomenon described by a classical compartmental dynamics. The model is based on a kinetic description at discrete velocities of the spatial movement and interactions of a population of susceptible, infected and recovered individuals. Thanks to this, the unphysical feature of instantaneous diffusive effects, which is typical of parabolic models, is removed. In particular, we formally show how such reaction-diffusion models are recovered in an appropriate diffusive limit. The kinetic transport model is therefore considered within a spatial network, characterizing different places such as villages, cities, countries, etc. The transmission conditions in the nodes are analyzed and defined. Finally, the model is solved numerically on the network through a finite-volume IMEX method able to maintain the consistency with the diffusive limit without restrictions due to the scaling parameters. Several numerical tests for simple epidemic network structures are reported and confirm the ability of the model to correctly describe the spread of an epidemic.

physics.soc-ph↗

Consensus-Based Optimization on Hypersurfaces: Well-Posedness and Mean-Field Limit

We introduce a new stochastic differential model for global optimization of nonconvex functions on compact hypersurfaces. The model is inspired by the stochastic Kuramoto-Vicsek system and belongs to the class of Consensus-Based Optimization methods. In fact, particles move on the hypersurface driven by a drift towards an instantaneous consensus point, computed as a convex combination of the particle locations weighted by the cost function according to Laplace's principle. The consensus point represents an approximation to a global minimizer. The dynamics is further perturbed by a random vector field to favor exploration, whose variance is a function of the distance of the particles to the consensus point. In particular, as soon as the consensus is reached, then the stochastic component vanishes. In this paper, we study the well-posedness of the model and we derive rigorously its mean-field approximation for large particle limit.

math.AP↗

On the stability of equilibrium preserving spectral methods for the homogeneous Boltzmann equation

Spectral methods, thanks to the high accuracy and the possibility to use fast algorithms, represent an effective way to approximate the Boltzmann collision operator. On the other hand, the loss of some local invariants leads to the wrong long time behavior. A way to overcome this drawback, without sacrificing spectral accuracy, has been proposed recently with the construction of equilibrium preserving spectral methods. Despite the ability to capture the steady state with arbitrary accuracy, the theoretical properties of the method have never been studied in details. In this paper, using the perturbation argument developed by Filbet and Mouhot for the homogeneous Boltzmann equation, we prove stability, convergence and spectrally accurate long time behavior of the equilibrium preserving approach.

math.NA↗

Monte Carlo stochastic Galerkin methods for the Boltzmann equation with uncertainties: space-homogeneous case

In this paper we propose a novel numerical approach for the Boltzmann equation with uncertainties. The method combines the efficiency of classical direct simulation Monte Carlo (DSMC) schemes in the phase space together with the accuracy of stochastic Galerkin (sG) methods in the random space. This hybrid formulation makes it possible to construct methods that preserve the main physical properties of the solution along with spectral accuracy in the random space. The schemes are developed and analyzed in the case of space homogeneous problems as these contain the main numerical difficulties. Several test cases are reported, both in the Maxwell and in the variable hard sphere (VHS) framework, and confirm the properties and performance of the new methods.

math.NA↗

High order pressure-based semi-implicit IMEX schemes for the 3D Navier-Stokes equations at all Mach numbers

This article aims at developing a high order pressure-based solver for the solution of the 3D compressible Navier-Stokes system at all Mach numbers. We propose a cell-centered discretization of the governing equations that splits the fluxes into a fast and a slow scale part, that are treated implicitly and explicitly, respectively. A novel semi-implicit discretization is proposed for the kinetic energy as well as the enthalpy fluxes in the energy equation, hence avoiding any need of iterative solvers. The implicit discretization yields an elliptic equation on the pressure that can be solved for both ideal gas and general equation of state (EOS). A nested Newton method is used to solve the mildly nonlinear system for the pressure in case of nonlinear EOS. High order in time is granted by implicit-explicit (IMEX) time stepping, whereas a novel CWENO technique efficiently implemented in a dimension-by-dimension manner is developed for achieving high order in space for the discretization of explicit convective and viscous fluxes. A quadrature-free finite volume solver is then derived for the high order approximation of numerical fluxes. Central schemes with no dissipation of suitable order of accuracy are finally employed for the numerical approximation of the implicit terms. Consequently, the CFL-type stability condition on the maximum admissible time step is based only on the fluid velocity and not on the sound speed, so that the novel schemes work uniformly for all Mach numbers. Convergence and robustness of the proposed method are assessed through a wide set of benchmark problems involving low and high Mach number regimes, as well as inviscid and viscous flows.

math.NA↗

Uncertainty quantification for the BGK model of the Boltzmann equation using multilevel variance reduced Monte Carlo methods

We propose a control variate multilevel Monte Carlo method for the kinetic BGK model of the Boltzmann equation subject to random inputs. The method combines a multilevel Monte Carlo technique with the computation of the optimal control variate multipliers derived from local or global variance minimization problems. Consistency and convergence analysis for the method equipped with a second-order positivity-preserving and asymptotic-preserving scheme in space and time is also performed. Various numerical examples confirm that the optimized multilevel Monte Carlo method outperforms the classical multilevel Monte Carlo method especially for problems with discontinuities.

math.NA↗