Searcharxiv⌕ Search

arXiv subjects

Mattia Zorzi

Publications and source records attributed to Mattia Zorzi.

At least 37 records · Page 2Linked to original sources

A second-order generalization of TC and DC kernels

Kernel-based methods have been successfully introduced in system identification to estimate the impulse response of a linear system. Adopting the Bayesian viewpoint, the impulse response is modeled as a zero mean Gaussian process whose covariance function (kernel) is estimated from the data. The most popular kernels used in system identification are the tuned-correlated (TC), the diagonal-correlated (DC) and the stable spline (SS) kernel. TC and DC kernels admit a closed form factorization of the inverse. The SS kernel induces more smoothness than TC and DC on the estimated impulse response, however, the aforementioned property does not hold in this case. In this paper we propose a second-order extension of the TC and DC kernel which induces more smoothness than TC and DC, respectively, on the impulse response and a generalized-correlated kernel which incorporates the TC and DC kernels and their second order extensions. Moreover, these generalizations admit a closed form factorization of the inverse and thus they allow to design efficient algorithms for the search of the optimal kernel hyperparameters. We also show how to use this idea to develop higher oder extensions. Interestingly, these new kernels belong to the family of the so called exponentially convex local stationary kernels: such a property allows to immediately analyze the frequency properties induced on the estimated impulse response by these kernels.

math.OC↗

M$^2$-Spectral Estimation: A Flexible Approach Ensuring Rational Solutions

This paper concerns a spectral estimation problem for multivariate (i.e., vector-valued) signals defined on a multidimensional domain, abbreviated as M$^2$. The problem is posed as solving a finite number of trigonometric moment equations for a nonnegative matricial measure, which is well known as the \emph{covariance extension problem} in the literature of systems and control. This inverse problem and its various generalizations have been extensively studied in the past three decades, and they find applications in diverse fields such as modeling and system identification, signal and image processing, robust control, circuit theory, etc. In this paper, we address the challenging M$^2$ version of the problem, and elaborate on a solution technique via convex optimization with the $τ$-divergence family. As a major contribution of this work, we show that by properly choosing the parameter of the divergence index, the optimal spectrum is a rational function, that is, the solution is a spectral density which can be represented by a finite-dimensional system, as desired in many practical applications.

math.OC↗

Robust Kalman Filtering Under Model Uncertainty: the Case of Degenerate Densities

We consider a robust state space filtering problem in the case that the transition probability density is unknown and possibly degenerate. The resulting robust filter has a Kalman-like structure and solves a minimax game: the nature selects the least favorable model in a prescribed ambiguity set which also contains non-Gaussian probability densities, while the other player designs the optimum filter for the least favorable model. It turns out that the resulting robust filter is characterized by a Riccati-like iteration evolving on the cone of the positive semidefinite matrices. Moreover, we study the convergence of such iteration in the case that the nominal model is with constant parameters on the basis of the contraction analysis in the same spirit of Bougerol. Finally, some numerical examples show that the proposed filter outperforms the standard Kalman filter.

math.OC↗

A Robust Approach to ARMA Factor Modeling

This paper deals with the dynamic factor analysis problem for an ARMA process. To robustly estimate the number of factors, we construct a confidence region centered in a finite sample estimate of the underlying model which contains the true model with a prescribed probability. In this confidence region, the problem, formulated as a rank minimization of a suitable spectral density, is efficiently approximated via a trace norm convex relaxation. The latter is addressed by resorting to the Lagrange duality theory, which allows to prove the existence of solutions. Finally, a numerical algorithm to solve the dual problem is presented. The effectiveness of the proposed estimator is assessed through simulation studies both with synthetic and real data.

stat.ME↗

Optimal Transport between Gaussian random fields

We consider the optimal transport problem between zero mean Gaussian stationary random fields both in the aperiodic and periodic case. We show that the solution corresponds to a weighted Hellinger distance between the multivariate and multidimensional power spectral densities of the random fields. Then, we show that such a distance defines a geodesic, which depends on the weight function, on the manifold of the multivariate and multidimensional power spectral densities.

math.OC↗

Learning the tuned liquid damper dynamics by means of a robust EKF

The tuned liquid dampers (TLD) technology is a feasible and cost-effective seismic design. In order to improve its efficiency it is fundamental to find accurate models describing their dynamic. A TLD system can be modeled through the Housner model and its parameters can be estimated by solving a nonlinear state estimation problem. We propose a robust extended Kalman filter which alleviates the model discretization and the fact that the noise process is not known. We test the effectiveness of the proposed approach by using some experimental data corresponding to two classical seismic waves, namely the El Centro wave and the Hachinohe wave.

math.OC↗

Optimal Transport between Gaussian Stationary Processes

We consider the optimal transport problem between multivariate Gaussian stationary stochastic processes. The transportation effort is the variance of the filtered discrepancy process. The main contribution of this technical note is to show that the corresponding solution leads to a weighted Hellinger distance between multivariate power spectral densities. Then, we propose a spectral estimation approach in the case of indirect measurements which is based on this distance.

math.OC↗

M$^2$-Spectral Estimation: A Relative Entropy Approach

This paper deals with M$^2$-signals, namely multivariate (or vector-valued) signals defined over a multidimensional domain. In particular, we propose an optimization technique to solve the covariance extension problem for stationary random vector fields. The multidimensional Itakura-Saito distance is employed as an optimization criterion to select the solution among the spectra satisfying a finite number of moment constraints. In order to avoid technicalities that may happen on the boundary of the feasible set, we deal with the discrete version of the problem where the multidimensional integrals are approximated by Riemann sums. The spectrum solution is also discrete, which occurs naturally when the underlying random field is periodic. We show that a solution to the discrete problem exists, is unique and depends smoothly on the problem data. Therefore, we have a well-posed problem whose solution can be tuned in a smooth manner. Finally, we have applied our theory to the target parameter estimation problem in an integrated system of automotive modules. Simulation results show that our spectral estimator has promising performance.

math.OC↗

Learning AR factor models

We face the factor analysis problem using a particular class of auto-regressive processes. We propose an approximate moment matching approach to estimate the number of factors as well as the parameters of the model. This algorithm alternates a step of factor analysis and a step of AR dynamics estimation. Some simulation studies show the effectiveness of the proposed estimator.

math.OC↗

Low-rank Kalman filtering under model uncertainty

We consider a robust filtering problem where the nominal state space model is not reachable and different from the actual one. We propose a robust Kalman filter which solves a dynamic game: one player selects the least-favorable model in a given ambiguity set, while the other player designs the optimum filter for the least-favorable model. It turns out that the robust filter is governed by a low-rank risk sensitive-like Riccati equation. Finally, simulation results show the effectiveness of the proposed filter.

math.OC↗

Link Prediction: A Graphical Model Approach

We consider the problem of link prediction in networks whose edge structure may vary (sufficiently slowly) over time. This problem, with applications in many important areas including social networks, has two main variants: the first, known as positive link prediction or PLP consists in estimating the appearance of a link in the network. The second, known as negative link prediction or NLP consists in estimating the disappearance of a link in the network. We propose a data-driven approach to estimate the appearance/disappearance of edges. Our solution is based on a regularized optimization problem for which we prove existence and uniqueness of the optimal solution.

math.OC↗

A new kernel-based approach for spectral estimation

The paper addresses the problem to estimate the power spectral density of an ARMA zero mean Gaussian process. We propose a kernel based maximum entropy spectral estimator. The latter searches the optimal spectrum over a class of high order autoregressive models while the penalty term induced by the kernel matrix promotes regularity and exponential decay to zero of the impulse response of the corresponding one-step ahead predictor. Moreover, the proposed method also provides a minimum phase spectral factor of the process. Numerical experiments showed the effectiveness of the proposed method.

math.OC↗

Data-driven Link Prediction over Graphical Models

The positive link prediction (PLP) problem is formulated in a system identification framework: we consider dynamic graphical models for auto-regressive moving-average (ARMA) Gaussian random processes. For the identification of the parameters, we model our network on two different time scales: a quicker one, over which we assume that the process representing the dynamics of the agents can be considered to be stationary, and a slower one in which the model parameters may vary. The latter accounts for the possible appearance of new edges. The identification problem is cast into an optimization framework which can be seen as a generalization of the existing methods for the identification of ARMA graphical models. We prove the existence and uniqueness of the solution of such an optimization problem and we propose a procedure to compute numerically this solution. Simulations testing the performances of our method are provided.

math.OC↗

Autoregressive Identification of Kronecker Graphical Models

We address the problem to estimate a Kronecker graphical model corresponding to an autoregressive Gaussian stochastic process. The latter is completely described by the power spectral density function whose inverse has support which admits a Kronecker product decomposition. We propose a Bayesian approach to estimate such a model. We test the effectiveness of the proposed method by some numerical experiments. We also apply the procedure to urban pollution monitoring data.

math.OC↗

Distributed Kalman Filtering under Model Uncertainty

We study the problem of distributed Kalman filtering for sensor networks in the presence of model uncertainty. More precisely, we assume that the actual state-space model belongs to a ball, in the Kullback-Leibler topology, about the nominal state-space model and whose radius reflects the mismatch modeling budget allowed for each time step. We propose a distributed Kalman filter with diffusion step which is robust with respect to the aforementioned model uncertainty. Moreover, we derive the corresponding least favorable performance. Finally, we check the effectiveness of the proposed algorithm in the presence of uncertainty through a numerical example.

math.OC↗

Fusion of Sensors Data in Automotive Radar Systems: A Spectral Estimation Approach

To accurately estimate locations and velocities of surrounding targets (cars) is crucial for advanced driver assistance systems based on radar sensors. In this paper we derive methods for fusing data from multiple radar sensors in order to improve the accuracy and robustness of such estimates. First we pose the target estimation problem as a multivariate multidimensional spectral estimation problem. The problem is multivariate since each radar sensor gives rise to a measurement channel. Then we investigate how the use of the cross-spectra affects target estimates. We see that the use of the magnitude of the cross-spectrum significantly improves the accuracy of the target estimates, whereas an attempt to compensate the phase lag of the cross-spectrum only gives marginal improvement. This paper may be viewed as a first step towards applying high-resolution methods that builds on multidimensional multivariate spectral estimation for sensor fusion.

eess.SP↗

Empirical Bayesian Learning in AR Graphical Models

We address the problem of learning graphical models which correspond to high dimensional autoregressive stationary stochastic processes. A graphical model describes the conditional dependence relations among the components of a stochastic process and represents an important tool in many fields. We propose an empirical Bayes estimator of sparse autoregressive graphical models and latent-variable autoregressive graphical models. Numerical experiments show the benefit to take this Bayesian perspective for learning these types of graphical models.

math.OC↗