SearcharxivSearch

arXiv subjects

Yunmin Zhu

Publications and source records attributed to Yunmin Zhu.

11 recordsLinked to original sources

Koopman Lifting with Certified Error Bounds for Joint Inference in Nonlinear Networks

Jointly inferring latent node states and unknown network topology in nonlinear graphical dynamical systems is a fundamental yet largely unsolved problem, where the mutual entanglement of continuous states and discrete structure renders accurate recovery of either quantity critically dependent on the other. We propose \textbf{Koopman-GKFA} (Koopman Group-sparse Kalman Filter--ADMM), a unified framework that lifts nonlinear network dynamics into an approximately linear system via Koopman operator embedding with a separable node-wise dictionary, enabling optimal linear filtering for state estimation and provably convergent convex optimization for topology inference. Three theoretical contributions underpin the framework: (i)~a \emph{structural homomorphism lemma} proving that, under a separable-dictionary condition, block sparsity of the lifted coupling operator is isomorphic to the graph topology, providing the rigorous foundation for group-sparse regularization; (ii)~a block-structured group-sparse ADMM topology subproblem with certified linear convergence, extended by an exponential forgetting factor to track time-varying topologies; and (iii)~a \emph{three-term certified mean-squared error bound} that decomposes total estimation error into Koopman truncation, observation noise, and topology residual components, with monotone consistency established as the dictionary dimension grows. Extensive experiments on synthetic benchmarks (Kuramoto oscillators, Hill-kinetics gene-regulatory networks) and real-world datasets (NGSIM US-101, DREAM4) demonstrate that Koopman-GKFA consistently outperforms EKF-, UKF-, and particle-filter-based joint estimators in both state estimation and topology recovery, while exhibiting polynomial computational scaling and strong robustness in high-dimensional nonlinear settings.

math.OC

Seamless Tracking of Group Targets and Ungrouped Targets Using Belief Propagation

This paper considers the problem of tracking a large-scale number of group targets. Usually, multi-target in most tracking scenarios are assumed to have independent motion and are well-separated. However, for group target tracking (GTT), the targets within groups are closely spaced and move in a coordinated manner, the groups can split or merge, and the numbers of targets in groups may be large, which lead to more challenging data association, filtering and computation problems. Within the belief propagation (BP) framework, we propose a scalable group target belief propagation (GTBP) method by jointly inferring target existence variables, group structure, data association and target states. The method can efficiently calculate the approximations of the marginal posterior distributions of these variables by performing belief propagation on the devised factor graph. As a consequence, GTBP is capable of capturing the changes in group structure, e.g., group splitting and merging. Furthermore, we model the evolution of targets as the co-action of the group or single-target motions specified by the possible group structures and corresponding probabilities. This flexible modeling enables seamless and simultaneous tracking of multiple group targets and ungrouped targets. Particularly, GTBP has excellent scalability and low computational complexity. It not only maintains the same scalability as BP, i.e., scaling linearly in the number of sensor measurements and quadratically in the number of targets, but also only scales linearly in the number of preserved group partitions. Finally, numerical experiments are presented to demonstrate the effectiveness and scalability of the proposed GTBP method.

cs.LG

Multiple-Source Ellipsoidal Localization Using Acoustic Energy Measurements

In this paper, the multiple-source ellipsoidal localization problem based on acoustic energy measurements is investigated via set-membership estimation theory. When the probability density function of measurement noise is unknown-but-bounded, multiple-source localization is a difficult problem since not only the acoustic energy measurements are complicated nonlinear functions of multiple sources, but also the multiple sources bring about a high-dimensional state estimation problem. First, when the energy parameter and the position of the source are bounded in an interval and a ball respectively, the nonlinear remainder bound of the Taylor series expansion is obtained analytically on-line. Next, based on the separability of the nonlinear measurement function, an efficient estimation procedure is developed. It solves the multiple-source localization problem by using an alternating optimization iterative algorithm, in which the remainder bound needs to be known on-line. For this reason, we first derive the remainder bound analytically. When the energy decay factor is unknown but bounded, an efficient estimation procedure is developed based on interval mathematics. Finally, numerical examples demonstrate the effectiveness of the ellipsoidal localization algorithms for multiple-source localization. In particular, our results show that when the noise is non-Gaussian, the set-membership localization algorithm performs better than the EM localization algorithm.

cs.IT

Dual Set Membership Filter with Minimizing Nonlinear Transformation of Ellipsoid

In this paper, we propose a dual set membership filter for nonlinear dynamic systems with unknown but bounded noises, and it has three distinctive properties. Firstly, the nonlinear system is translated into the linear system by leveraging a semi-infinite programming, rather than linearizing the nonlinear function. In fact, the semi-infinite programming is to find an ellipsoid bounding the nonlinear transformation of an ellipsoid, which aims to compute a tight ellipsoid to cover the state. Secondly, the duality result of the semi-infinite programming is derived by a rigorous analysis, then a first order Frank-Wolfe method is developed to efficiently solve it with a lower computation complexity. Thirdly, the proposed filter can take advantage of the linear set membership filter framework and can work on-line without solving the semidefinite programming problem. Furthermore, we apply the dual set membership filter to a typical scenario of mobile robot localization. Finally, two illustrative examples in the simulations show the advantages and effectiveness of the dual set membership filter.

math.DS

On Equivalence and Computational Efficiency of the Major Relaxation Methods for Minimum Ellipsoid Containing the Intersection of Ellipsoids

This paper investigates the problem on the minimum ellipsoid containing the intersection of multiple ellipsoids, which has been extensively applied to information science, target tracking and data fusion etc. There are three major relaxation methods involving SDP relaxation, S-procedure relaxation and bounding ellipsoid relaxation, which are derived by different ideas or viewpoints. However, it is unclear for the interrelationships among these methods. This paper reveals the equivalence among the three relaxation methods by three stages. Firstly, the SDP relaxation method can be equivalently simplified to a decoupled SDP relaxation method. Secondly, the equivalence between the SDP relaxation method and the S-procedure relaxation method can be obtained by rigorous analysis. Thirdly, we establish the equivalence between the decoupled SDP relaxation method and the bounding ellipsoid relaxation method. Therefore, the three relaxation methods are unified through the decoupled SDP relaxation method. By analysis of the computational complexity, the decoupled SDP relaxation method has the least computational burden among the three methods. The above results are helpful for the research of set-membership filter and distributed estimation fusion. Finally, the performance of each method is evaluated by some typical numerical examples in information fusion and filtering.

math.OC

Set-Membership Information Fusion for Multisensor Nonlinear Dynamic Systems

The set-membership information fusion problem is investigated for general multisensor nonlinear dynamic systems. Compared with linear dynamic systems and point estimation fusion in mean squared error sense, it is a more challenging nonconvex optimization problem. Usually, to solve this problem, people try to find an efficient or heuristic fusion algorithm. It is no doubt that an analytical fusion formula should be much significant for rasing accuracy and reducing computational burden. However, since it is a more complicated than the convex quadratic optimization problem for linear point estimation fusion, it is not easy to get the analytical fusion formula. In order to overcome the difficulty of this problem, two popular fusion architectures are considered: centralized and distributed set-membership information fusion. Firstly, both of them can be converted into a semidefinite programming problem which can be efficiently computed, respectively. Secondly, their analytical solutions can be derived surprisingly by using decoupling technique. It is very interesting that they are quite similar in form to the classic information filter. In the two analytical fusion formulae, the information of each sensor can be clearly characterized, and the knowledge of the correlation among measurement noises across sensors are not required. Finally, multi-algorithm fusion is used to minimize the size of the state bounding ellipsoid by complementary advantages of multiple parallel algorithms. A typical numerical example in target tracking demonstrates the effectiveness of the centralized, distributed, and multi-algorithm set-membership fusion algorithms. In particular, it shows that multi-algorithm fusion performs better than the centralized and distributed fusion.

cs.IT

Monte Carlo Set-Membership Filtering for Nonlinear Dynamic Systems

When underlying probability density functions of nonlinear dynamic systems are unknown, the filtering problem is known to be a challenging problem. This paper attempts to make progress on this problem by proposing a new class of filtering methods in bounded noise setting via set-membership theory and Monte Carlo (boundary) sampling technique, called Monte Carlo set-membership filter. The set-membership prediction and measurement update are derived by recent convex optimization methods based on S-procedure and Schur complement. To guarantee the on-line usage, the nonlinear dynamics are linearized about the current estimate and the remainder terms are then bounded by an optimization ellipsoid, which can be described as a semi-infinite optimization problem. In general, it is an analytically intractable problem when dynamic systems are nonlinear. However, for a typical nonlinear dynamic system in target tracking, we can analytically derive some regular properties for the remainder. Moreover, based on the remainder properties and the inverse function theorem, the semi-infinite optimization problem can be efficiently solved by Monte Carlo boundary sampling technique. Compared with the particle filter, numerical examples show that when the probability density functions of noises are unknown, the performance of the Monte Carlo set-membership filter is better than that of the particle filter.

math.ST

Distributed Detection Fusion via Monte Carlo Importance Sampling

Distributed detection fusion with high-dimension conditionally dependent observations is known to be a challenging problem. When a fusion rule is fixed, this paper attempts to make progress on this problem for the large sensor networks by proposing a new Monte Carlo framework. Through the Monte Carlo importance sampling, we derive a necessary condition for optimal sensor decision rules in the sense of minimizing the approximated Bayesian cost function. Then, a Gauss-Seidel/person-by-person optimization algorithm can be obtained to search the optimal sensor decision rules. It is proved that the discretized algorithm is finitely convergent. The complexity of the new algorithm is $O(LN)$ compared with $O(LN^L)$ of the previous algorithm where $L$ is the number of sensors and $N$ is a constant. Thus, the proposed methods allows us to design the large sensor networks with general high-dimension dependent observations. Furthermore, an interesting result is that, for the fixed AND or OR fusion rules, we can analytically derive the optimal solution in the sense of minimizing the approximated Bayesian cost function. In general, the solution of the Gauss-Seidel algorithm is only local optimal. However, in the new framework, we can prove that the solution of Gauss-Seidel algorithm is same as the analytically optimal solution in the case of the AND or OR fusion rule. The typical examples with dependent observations and large number of sensors are examined under this new framework. The results of numerical examples demonstrate the effectiveness of the new algorithm.

cs.IT

Robust Distributed Maximum Likelihood Estimation with Dependent Quantized Data

In this paper, we consider distributed maximum likelihood estimation (MLE) with dependent quantized data under the assumption that the structure of the joint probability density function (pdf) is known, but it contains unknown deterministic parameters. The parameters may include different vector parameters corresponding to marginal pdfs and parameters that describe dependence of observations across sensors. Since MLE with a single quantizer is sensitive to the choice of thresholds due to the uncertainty of pdf, we concentrate on MLE with multiple groups of quantizers (which can be determined by the use of prior information or some heuristic approaches) to fend off against the risk of a poor/outlier quantizer. The asymptotic efficiency of the MLE scheme with multiple quantizers is proved under some regularity conditions and the asymptotic variance is derived to be the inverse of a weighted linear combination of Fisher information matrices based on multiple different quantizers which can be used to show the robustness of our approach. As an illustrative example, we consider an estimation problem with a bivariate non-Gaussian pdf that has applications in distributed constant false alarm rate (CFAR) detection systems. Simulations show the robustness of the proposed MLE scheme especially when the number of quantized measurements is small.

cs.IT

Distributed Bayesian Detection Under Unknown Observation Statistics

In this paper, distributed Bayesian detection problems with unknown prior probabilities of hypotheses are considered. The sensors obtain observations which are conditionally dependent across sensors and their probability density functions (pdf) are not exactly known. The observations are quantized and are sent to the fusion center. The fusion center fuses the current quantized observations and makes a final decision. It also designs (updated) quantizers to be used at the sensors and the fusion rule based on all previous quantized observations. Information regarding updated quantizers is sent back to the sensors for use at the next time. In this paper, the conditional joint pdf is represented in a parametric form by using the copula framework. The unknown parameters include dependence parameters and marginal parameters. Maximum likelihood estimation (MLE) with feedback based on quantized data is proposed to estimate the unknown parameters. These estimates are iteratively used to refine the quantizers and the fusion rule to improve distributed detection performance by using feedback. Numerical examples show that the new detection method based on MLE with feedback is much better than the usual detection method based on the assumption of conditionally independent observations.

cs.IT

Applications of Random Parameter Matrices Kalman Filtering in Uncertain Observation and Multi-Model Systems

This paper considers the Linear Minimum Variance recursive state estimation for the linear discrete time dynamic system with random state transition and measurement matrices, i.e., random parameter matrices Kalman filtering. It is shown that such system can be converted to a linear dynamic system with deterministic parameter matrices but state-dependent process and measurement noises. It is proved that under mild conditions, the recursive state estimation of this system is still of the form of a modified Kalman filtering. More importantly, this result can be applied to Kalman filtering with intermittent and partial observations as well as randomly variant dynamic systems.

cs.IT