arXiv subjects

Mattia Zorzi

Publications and source records attributed to Mattia Zorzi.

At least 55 records · Page 3Linked to original sources

arXiv2019

Learning Quasi-Kronecker Product Graphical Models

We consider the problem of learning graphical models where the support of the concentration matrix can be decomposed as a Kronecker product. We propose a method that uses the Bayesian hierarchical learning modeling approach. Thanks to the particular structure of the graph, we use a the number of hyperparameters which is small compared to the number of nodes in the graphical model. In this way, we avoid overfitting in the estimation of the hyperparameters. Finally, we test the effectiveness of the proposed method by a numerical example.

math.OC↗

arXiv2019

Robust Identification of "Sparse Plus Low-rank" Graphical Models: An Optimization Approach

Motivated by graphical models, we consider the "Sparse Plus Low-rank" decomposition of a positive definite concentration matrix -- the inverse of the covariance matrix. This is a classical problem for which a rich theory and numerical algorithms have been developed. It appears, however, that the results rapidly degrade when, as it happens in practice, the covariance matrix must be estimated from the observed data and is therefore affected by a certain degree of uncertainty. We discuss this problem and propose an alternative optimization approach that appears to be suitable to deal with robustness issues in the "Sparse Plus Low-rank" decomposition problem.The variational analysis of this optimization problem is carried over and discussed.

math.OC↗

arXiv2018

Derivative-free online learning of inverse dynamics models

This paper discusses online algorithms for inverse dynamics modelling in robotics. Several model classes including rigid body dynamics (RBD) models, data-driven models and semiparametric models (which are a combination of the previous two classes) are placed in a common framework. While model classes used in the literature typically exploit joint velocities and accelerations, which need to be approximated resorting to numerical differentiation schemes, in this paper a new `derivative-free' framework is proposed that does not require this preprocessing step. An extensive experimental study with real data from the right arm of the iCub robot is presented, comparing different model classes and estimation procedures, showing that the proposed `derivative-free' methods outperform existing methodologies.

cs.LG↗

arXiv2018

A Scalable Strategy for the Identification of Latent-variable Graphical Models

In this paper we propose an identification method for latent-variable graphical models associated to autoregressive (AR) Gaussian stationary processes. The identification procedure exploits the approximation of AR processes through stationary reciprocal processes thus benefiting of the numerical advantages of dealing with block-circulant matrices. These advantages become more and more significant as the order of the process gets large. We show how the identification can be cast in a regularized convex program and we present numerical examples that compares the performances of the proposed method with the existing ones.

math.OC↗

arXiv2018

Factor Models with Real Data: a Robust Estimation of the Number of Factors

Factor models are a very efficient way to describe high dimensional vectors of data in terms of a small number of common relevant factors. This problem, which is of fundamental importance in many disciplines, is usually reformulated in mathematical terms as follows. We are given the covariance matrix Sigma of the available data. Sigma must be additively decomposed as the sum of two positive semidefinite matrices D and L: D | that accounts for the idiosyncratic noise affecting the knowledge of each component of the available vector of data | must be diagonal and L must have the smallest possible rank in order to describe the available data in terms of the smallest possible number of independent factors. In practice, however, the matrix Sigma is never known and therefore it must be estimated from the data so that only an approximation of Sigma is actually available. This paper discusses the issues that arise from this uncertainty and provides a strategy to deal with the problem of robustly estimating the number of factors.

math.OC↗

arXiv2018

Identification of Sparse Reciprocal Graphical Models

In this paper we propose an identification procedure of a sparse graphical model associated to a Gaussian stationary stochastic process. The identification paradigm exploits the approximation of autoregressive processes through reciprocal processes in order to improve the robustness of the identification algorithm, especially when the order of the autoregressive process becomes large. We show that the proposed paradigm leads to a regularized, circulant matrix completion problem whose solution only requires computations of the eigenvalues of matrices of dimension equal to the dimension of the process.

math.OC↗

arXiv2018

An alternating minimization algorithm for Factor Analysis

The problem of decomposing a given covariance matrix as the sum of a positive semi-definite matrix of given rank and a positive semi-definite diagonal matrix, is considered. We present a projection-type algorithm to address this problem. This algorithm appears to perform extremely well and is extremely fast even when the given covariance matrix has a very large dimension. The effectiveness of the algorithm is assessed through simulation studies and by applications to three real datasets that are considered as benchmark for the problem. A local convergence analysis of the algorithm is also presented.

math.OC↗

arXiv2018

On the coupling of Model Predictive Control and Robust Kalman Filtering

Model Predictive Control (MPC) represents nowadays one of the main methods employed for process control in industry. Its strong suits comprise a simple algorithm based on a straightforward formulation and the flexibility to deal with constraints. On the other hand it can be questioned its robustness regarding model uncertainties and external noises. Thus, a lot of efforts have been spent in the past years into the search of methods to address these shortcomings. In this paper we propose a robust MPC controller which stems from the idea of adding robustness in the prediction phase of the algorithm while leaving the core of MPC untouched. More precisely, we consider a robust Kalman filter that has been recently introduced and we further extend its usability to feedback control systems. Overall the proposed control algorithm allows to maintain all of the advantages of MPC with an additional improvement in performance and without any drawbacks in terms of computational complexity. To test the actual reliability of the algorithm we apply it to control a servomechanism system characterized by nonlinear dynamics.

math.OC↗

arXiv2018

Robust Kalman Filtering: Asymptotic Analysis of the Least Favorable Model

We consider a robust filtering problem where the robust filter is designed according to the least favorable model belonging to a ball about the nominal model. In this approach, the ball radius specifies the modeling error tolerance and the least favorable model is computed by performing a Riccati-like backward recursion. We show that this recursion converges provided that the tolerance is sufficiently small.

math.OC↗

arXiv2018

The role of noise modeling in the estimation of resting-state brain effective connectivity

Causal relations among neuronal populations of the brain are studied through the so-called effective connectivity (EC) network. The latter is estimated from EEG or fMRI measurements, by inverting a generative model of the corresponding data. It is clear that the goodness of the estimated network heavily depends on the underlying modeling assumptions. In this present paper we consider the EC estimation problem using fMRI data in resting-state condition. Specifically, we investigate on how to model endogenous fluctuations driving the neuronal activity.

eess.SY↗

arXiv2017

Factor analysis with finite data

Factor analysis aims to describe high dimensional random vectors by means of a small number of unknown common factors. In mathematical terms, it is required to decompose the covariance matrix $Σ$ of the random vector as the sum of a diagonal matrix $D$ | accounting for the idiosyncratic noise in the data | and a low rank matrix $R$ | accounting for the variance of the common factors | in such a way that the rank of $R$ is as small as possible so that the number of common factors is minimal. In practice, however, the matrix $Σ$ is unknown and must be replaced by its estimate, i.e. the sample covariance, which comes from a finite amount of data. This paper provides a strategy to account for the uncertainty in the estimation of $Σ$ in the factor analysis problem.

math.OC↗

arXiv2017

Convergence analysis of a family of robust Kalman filters based on the contraction principle

In this paper we analyze the convergence of a family of robust Kalman filters. For each filter of this family the model uncertainty is tuned according to the so called tolerance parameter. Assuming that the corresponding state-space model is reachable and observable, we show that the corresponding Riccati-like mapping is strictly contractive provided that the tolerance is sufficiently small, accordingly the filter converges.

math.OC↗

arXiv2017

On the Robustness of the Bayes and Wiener Estimators under Model Uncertainty

This paper deals with the robust estimation problem of a signal given noisy observations. We assume that the actual statistics of the signal and observations belong to a ball about the nominal statistics. This ball is formed by placing a bound on the Tau-divergence family between the actual and the nominal statistics. Then, the robust estimator is obtained by minimizing the mean square error according to the least favorable statistics in that ball. Therefore, we obtain a divergence family-based minimax approach to robust estimation. We show in the case that the signal and observations have no dynamics, the Bayes estimator is the optimal solution. Moreover, in the dynamic case, the optimal offline estimator is the noncausal Wiener filter.

math.OC↗

arXiv2017

Estimating effective connectivity in linear brain network models

Contemporary neuroscience has embraced network science to study the complex and self-organized structure of the human brain; one of the main outstanding issues is that of inferring from measure data, chiefly functional Magnetic Resonance Imaging (fMRI), the so-called effective connectivity in brain networks, that is the existing interactions among neuronal populations. This inverse problem is complicated by the fact that the BOLD (Blood Oxygenation Level Dependent) signal measured by fMRI represent a dynamic and nonlinear transformation (the hemodynamic response) of neuronal activity. In this paper, we consider resting state (rs) fMRI data; building upon a linear population model of the BOLD signal and a stochastic linear DCM model, the model parameters are estimated through an EM-type iterative procedure, which alternately estimates the neuronal activity by means of the Rauch-Tung-Striebel (RTS) smoother, updates the connections among neuronal states and refines the parameters of the hemodynamic model; sparsity in the interconnection structure is favoured using an iteratively reweighting scheme. Experimental results using rs-fMRI data are shown demonstrating the effectiveness of our approach and comparison with state of the art routines (SPM12 toolbox) is provided.

math.OC↗

arXiv2017

The Harmonic Analysis of Kernel Functions

Kernel-based methods have been recently introduced for linear system identification as an alternative to parametric prediction error methods. Adopting the Bayesian perspective, the impulse response is modeled as a non-stationary Gaussian process with zero mean and with a certain kernel (i.e. covariance) function. Choosing the kernel is one of the most challenging and important issues. In the present paper we introduce the harmonic analysis of this non-stationary process, and argue that this is an important tool which helps in designing such kernel. Furthermore, this analysis suggests also an effective way to approximate the kernel, which allows to reduce the computational burden of the identification procedure.

math.OC↗

arXiv2017

Model Predictive Control meets robust Kalman filtering

Model Predictive Control (MPC) is the principal control technique used in industrial applications. Although it offers distinguishable qualities that make it ideal for industrial applications, it can be questioned its robustness regarding model uncertainties and external noises. In this paper we propose a robust MPC controller that merges the simplicity in the design of MPC with added robustness. In particular, our control system stems from the idea of adding robustness in the prediction phase of the algorithm through a specific robust Kalman filter recently introduced. Notably, the overall result is an algorithm very similar to classic MPC but that also provides the user with the possibility to tune the robustness of the control. To test the ability of the controller to deal with errors in modeling, we consider a servomechanism system characterized by nonlinear dynamics.

math.OC↗

arXiv2016

Robust Kalman Filtering under Model Perturbations

We consider a family of divergence-based minimax approaches to perform robust filtering. The mismodeling budget, or tolerance, is specified at each time increment of the model. More precisely, all possible model increments belong to a ball which is formed by placing a bound on the Tau-divergence family between the actual and the nominal model increment. Then, the robust filter is obtained by minimizing the mean square error according to the least favorable model in that ball. It turns out that the solution is a family of Kalman like filters. Their gain matrix is updated according to a risk sensitive like iteration where the risk sensitivity parameter is now time varying. As a consequence, we also extend the risk sensitive filter to a family of risk sensitive like filters according to the Tau-divergence family.

math.OC↗

arXiv2016

Sparse plus Low rank Network Identification: A Nonparametric Approach

Modeling and identification of high-dimensional stochastic processes is ubiquitous in many fields. In particular, there is a growing interest in modeling stochastic processes with simple and interpretable structures. In many applications, such as econometrics and biomedical sciences, it seems natural to describe each component of that stochastic process in terms of few factor variables, which are not accessible for observation, and possibly of few other components of the stochastic process. These relations can be encoded in graphical way via a structured dynamic network, referred to as "sparse plus low-rank (S+L) network" hereafter. The problem of finding the S+L network as well as the dynamic model can be posed as a system identification problem. In this paper, we introduce two new nonparametric methods to identify dynamic models for stochastic processes described by a S+L network. These methods take inspiration from regularized estimators based on recently introduced kernels (e.g. "stable spline", "tuned-correlated" etc.). Numerical examples show the benefit to introduce the S+L structure in the identification procedure.

math.OC↗