Searcharxiv⌕ Search

arXiv subjects

Tirza Routtenberg

Publications and source records attributed to Tirza Routtenberg.

At least 19 recordsLinked to original sources

EM-KalmanNet: Learned Expectation-Maximization for Adaptive Tracking in Partially Known, Block-Wise Time-Varying State-Space Models

State estimation in partially known state space (SS) models is challenging when the dynamics or observation model varies across short data blocks. Classical model-based approaches, such as the expectation-maximization (EM) Kalman filter, jointly recover the latent states and the unknown model parameters, but rely on linear-Gaussian assumptions that should accurately describe the system and require numerous forward-backward passes. Consequently, their performance and computational efficiency may deteriorate under complex and non-stationary real-world conditions. On the other hand, learned Kalman smoothers are robust to model mismatch yet cannot adapt at inference to unseen model variations without labeled data. In this work, we propose EM-KalmanNet, an AI-aided tracking algorithm for adaptive smoothing in blockwise time-varying SS models. The method unfolds a fixed, small number of EM-like iterations into a trainable architecture: a parameter-aware RTSNet implements a learned E-step conditioned on the current model-parameter estimate, while a lightweight M-Net implements a learned M-step that updates the state-transition or the observation matrix using empirical moments, residuals, and gradient-related statistics. The two modules are shared across the unfolded iterations and are trained offline via a dedicated three-stage procedure. During deployment, the per-block parameter estimate is propagated between consecutive blocks, enabling observation-driven adaptation without labeled online data or knowledge of the noise statistics. Experiments involving linear and nonlinear models, Gaussian and non-Gaussian noise, Lorenz attractor tracking, and acoustic source localization demonstrate that EM-KalmanNet consistently outperforms model-based and data-driven benchmarks while substantially reducing inference latency relative to the EM-KF.

eess.SP↗

Online Learning of Modular Bayesian Deep Receivers: Single-Step Adaptation with Streaming Data

Deep neural network (DNN)-based receivers offer a powerful alternative to classical model-based designs for wireless communication, especially in complex and nonlinear propagation environments. However, their adoption is challenged by the rapid variability of wireless channels, which makes pre-trained static DNN-based receivers ineffective, and by the latency and computational burden of online stochastic gradient descent (SGD)-based learning. In this work, we propose an online learning framework that enables rapid low-complexity adaptation of DNN-based receivers. Our approach is based on two main tenets. First, we cast online learning as Bayesian tracking in parameter space, enabling a single-step adaptation, which deviates from multi-epoch SGD . Second, we focus on modular DNN architectures that enable parallel, online, and localized variational Bayesian updates. Simulations with practical communication channels demonstrate that our proposed online learning framework can maintain a low error rate with markedly reduced update latency and increased robustness to channel dynamics as compared to traditional gradient descent based method.

eess.SP↗

Revisiting the Misspecified Cramér-Rao Bound

Estimation under model misspecification arises in many signal processing problems, where the assumed observation model deviates from the true data-generating mechanism due to errors or simplifications. The misspecified Cramér-Rao bound (MCRB) is a widely recognized mean-squared-error (MSE) lower bound for this case, which has originally been used to describe the asymptotic behavior of the misspecified maximum likelihood (MML) estimator. Despite its widespread use, the MCRB lacks a rigorous characterization of the class of estimators for which it is valid. In this paper, we revisit the theory of parameter estimation under model misspecification and re-examine the foundations of the MCRB. We first demonstrate these limitations and examine a naive version of the MCRB, which relies only on local misspecified unbiasedness. We show that this bound is generally not tight and may be unattainable. To obtain a meaningful bound, we develop a new derivation based on the concept of pointwise equivalent models. By maximizing the naive bound for these models, we recover the classical MCRB, now supported by a constructive derivation, an explicit characterization of the associated estimator class, and an equality condition. This formulation establishes a formal link between local unbiasedness conditions and achievable bounds, offering new insights into the MCRB structure and its relevance to practical estimators. Finally, we define the notion of an efficient misspecified estimator and show that if it exists, it is achieved by the MML estimator.

math.ST↗

Deep Unfolding: Recent Developments, Theory, and Design Guidelines

Optimization methods play a central role in signal processing, serving as the mathematical foundation for inference, estimation, and control. While classical iterative optimization algorithms provide interpretability and theoretical guarantees, they often rely on surrogate objectives, require careful hyperparameter tuning, and exhibit substantial computational latency. Conversely, machine learning (ML ) offers powerful data-driven modeling capabilities but lacks the structure, transparency, and efficiency needed for optimization-driven inference. Deep unfolding has recently emerged as a compelling framework that bridges these two paradigms by systematically transforming iterative optimization algorithms into structured, trainable ML architectures. This article provides a tutorial-style overview of deep unfolding, presenting a unified perspective of methodologies for converting optimization solvers into ML models and highlighting their conceptual, theoretical, and practical implications. We review the foundations of optimization for inference and for learning, introduce four representative design paradigms for deep unfolding, and discuss the distinctive training schemes that arise from their iterative nature. Furthermore, we survey recent theoretical advances that establish convergence and generalization guarantees for unfolded optimizers, and provide comparative qualitative and empirical studies illustrating their relative trade-offs in complexity, interpretability, and robustness.

cs.LG↗

Deep Unfolding with Approximated Computations for Rapid Optimization

Optimization-based solvers play a central role in a wide range of signal processing and communication tasks. However, their applicability in latency-sensitive systems is limited by the sequential nature of iterative methods and the high computational cost per iteration. While deep unfolding has emerged as a powerful paradigm for converting iterative algorithms into learned models that operate with a fixed number of iterations, it does not inherently address the cost of each iteration. In this paper, we introduce a learned optimization framework that jointly tackles iteration count and per-iteration complexity. Our approach is based on unfolding a fixed number of optimization steps, replacing selected iterations with low-complexity approximated computations, and learning extended hyperparameters from data to compensate for the introduced approximations. We demonstrate the effectiveness of our method on two representative problems: (i) hybrid beamforming; and (ii) robust principal component analysis. These fundamental case studies show that our learned approximated optimizers can achieve state-of-the-art performance while reducing computational complexity by over three orders of magnitude. Our results highlight the potential of our approach to enable rapid, interpretable, and efficient decision-making in real-time systems.

eess.SP↗

Leaky Wave Antennas for Next Generation Wireless Applications in sub-THz Frequencies: Current Status and Research Challenges

The ever-growing demand for ultra-high data rates, massive connectivity, and joint communication-sensing capabilities in future wireless networks is driving research into sub-terahertz (sub-THz) communications. While these frequency bands offer abundant spectrum, they also pose severe propagation and hardware design challenges, motivating the search for alternative antenna solutions beyond conventional antenna arrays. Leaky-wave antennas (LWAs) have emerged as a promising candidate for sub-THz systems due to their simple feed structure, low fabrication cost, and inherent angle-frequency coupling, which enables frequency-controlled beamsteering with simple hardware. In this article, we review the fundamentals of the LWA technology, highlight their unique properties, and showcase their potential in multi-user wideband sub-THz wireless communications. We present representative studies demonstrating that LWAs can simultaneously support high-rate multi-user communications and accurate localization using only a single antenna element. Finally, several key open challenges are outlined, spanning algorithm design, signal processing, information theory, standardization, and hardware implementation, that need to be addressed to fully harness LWAs as a cost-effective and scalable enabler of next generations of wireless systems.

eess.SP↗

Weighted Bayesian Cram$\acute{\text{e}}$r-Rao Bound for Mixed-Resolution Parameter Estimation

Mixed-resolution architectures, combining high-resolution (analog) data with coarsely quantized (e.g., 1-bit) data, are widely employed in emerging communication and radar systems to reduce hardware costs and power consumption. However, the use of coarsely quantized data introduces non-trivial tradeoffs in parameter estimation tasks. In this paper, we investigate the derivation of lower bounds for such systems. In particular, we develop the weighted Bayesian Cramer-Rao bound (WBCRB) for the mixed-resolution setting with a general weight function. We demonstrate the special cases of: (i) the classical BCRB; (ii) the WBCRB that is based on the Bayesian Fisher information matrix (BFIM)-Inverse weighting; and (iii) the Aharon-Tabrikian tightest WBCRB with an optimal weight function. Based on the developed WBCRB, we propose a new method to approximate the mean-squared-error (MSE) by partitioning the estimation problem into two regions: (a) where the 1-bit quantized data is informative; and (b) where it is saturated. We apply region-specific WBCRB approximations in these regions to achieve an accurate composite MSE estimate. We derive the bounds and MSE approximation for the linear Gaussian orthonormal (LGO) model, which is commonly used in practical signal processing applications. Our simulation results demonstrate the use of the proposed bounds and approximation method in the LGO model with a scalar unknown parameter. It is shown that the WBCRB outperforms the BCRB, where the BFIM-Inverse weighting version approaches the optimal WBCRB. Moreover, it is shown that the WBCRB-based MSE approximation is tighter and accurately predicts the non-monotonic behavior of the MSE in the presence of quantization errors.

eess.SP↗

Efficient Sampling Allocation Strategies for General Graph-Filter-Based Signal Recovery

Sensor placement plays a crucial role in graph signal recovery in underdetermined systems. In this paper, we present the graph-filtered regularized maximum likelihood (GFR-ML) estimator of graph signals, which integrates general graph filtering with regularization to enhance signal recovery performance under a limited number of sensors. Then, we investigate task-based sampling allocation aimed at minimizing the mean squared error (MSE) of the GFR-ML estimator by wisely choosing sensor placement. Since this MSE depends on the unknown graph signals to be estimated, we propose four cost functions for the optimization of the sampling allocation: the biased Cram$\acute{\text{e}}$r-Rao bound (bCRB), the worst-case MSE (WC-MSE), the Bayesian MSE (BMSE), and the worst-case BMSE (WC-BMSE), where the last two assume a Gaussian prior. We investigate the properties of these cost functions and develop two algorithms for their practical implementation: 1) the straightforward greedy algorithm; and 2) the alternating projection gradient descent (PGD) algorithm that reduces the computational complexity. Simulation results on synthetic and real-world datasets of the IEEE 118-bus power system and the Minnesota road network demonstrate that, in the tested scenarios, the proposed sampling allocation methods reduce the MSE by up to $50\%$ compared to the common sampling methods A-design, E-design, and LR-design. Thus, the proposed methods improve the estimation performance and reduce the required number of measurements in graph signal processing (GSP)-based signal recovery in the case of underdetermined systems.

eess.SP↗

Sparsity-Aware Extended Kalman Filter for Tracking Dynamic Graphs

A broad range of applications involve signals with irregular structures that can be represented as a graph. As the underlying structures can change over time, the tracking dynamic graph topologies from observed signals is a fundamental challenge in graph signal processing (GSP), with applications in various domains, such as power systems, the brain-machine interface, and communication systems. In this paper, we propose a method for tracking dynamic changes in graph topologies. Our approach builds on a representation of the dynamics as a graph-based nonlinear state-space model (SSM), where the observations are graph signals generated through graph filtering, and the underlying evolving topology serves as the latent states. In our formulation, the graph Laplacian matrix is parameterized using the incidence matrix and edge weights, enabling a structured representation of the state. In order to track the evolving topology in the resulting SSM, we develop a sparsity-aware extended Kalman filter (EKF) that integrates $\ell_1$-regularized updates within the filtering process. Furthermore, a dynamic programming scheme to efficiently compute the Jacobian of the graph filter is introduced. Our numerical study demonstrates the ability of the proposed method to accurately track sparse and time-varying graphs under realistic conditions, with highly nonlinear measurements, various noise levels, and different change rates, while maintaining low computational complexity.

eess.SP↗

Wideband THz Multi-User Downlink Communications with Leaky Wave Antennas

Future wireless systems are envisioned to utilize the large spectra available at THz bands for wireless communications. Extremely massive multiple-input multiple-output (MIMO) antennas can be costly and power inefficient for wideband THz communications. An alternative antenna technology, which can achieve low cost and power efficient THz signaling, is based on leaky wave antennas (LWAs). In this paper, we explore the usage of the LWAs for wideband downlink multi-user THz communications. We propose a model for LWA-aided communication systems that faithfully captures the antenna operations. We that LWAs yield frequency-dependent beams, where the equivalent wideband channel induces dependence between angle, frequency, and spectral lobe width. We identify the LWAs inherent frequency-selective beamsteering capabilities as motivating multi-band THz communications that deviate from conventional orthogonal frequency-division, and employ non-identical subbands. Then, we propose an alternating optimization algorithm for jointly optimizing the LWA configuration along with the spectral division and power allocation to maximize the achievable sum-rate. Our numerical results show that a single LWA can generate diverse beampatterns, exhibiting performance comparable to costly fully digital MIMO. Interestingly, we demonstrate that allowing transmission with non-identical subbands leverages the characteristics of LWA-based channels compared to uniform division, yielding improved beamsteering that translate to higher rates.

eess.SP↗

Cramer-Rao Bounds for Laplacian Matrix Estimation

In this paper, we analyze the performance of the estimation of Laplacian matrices under general observation models. Laplacian matrix estimation involves structural constraints, including symmetry and null-space properties, along with matrix sparsity. By exploiting a linear reparametrization that enforces the structural constraints, we derive closed-form matrix expressions for the Cramer-Rao Bound (CRB) specifically tailored to Laplacian matrix estimation. We further extend the derivation to the sparsity-constrained case, introducing two oracle CRBs that incorporate prior information of the support set, i.e. the locations of the nonzero entries in the Laplacian matrix. We examine the properties and order relations between the bounds, and provide the associated Slepian-Bangs formula for the Gaussian case. We demonstrate the use of the new CRBs in three representative applications: (i) topology identification in power systems, (ii) graph filter identification in diffused models, and (iii) precision matrix estimation in Gaussian Markov random fields under Laplacian constraints. The CRBs are evaluated and compared with the mean-squared-errors (MSEs) of the constrained maximum likelihood estimator (CMLE), which integrates both equality and inequality constraints along with sparsity constraints, and of the oracle CMLE, which knows the locations of the nonzero entries of the Laplacian matrix. We perform this analysis for the applications of power system topology identification and graphical LASSO, and demonstrate that the MSEs of the estimators converge to the CRB and oracle CRB, given a sufficient number of measurements.

stat.ML↗

Efficient Recovery of Sparse Graph Signals from Graph Filter Outputs

This paper investigates the recovery of a node-domain sparse graph signal from the output of a graph filter. This problem, which is often referred to as the identification of the source of a diffused sparse graph signal, is seminal in the field of graph signal processing (GSP). Sparse graph signals can be used in the modeling of a variety of real-world applications in networks, such as social, biological, and power systems, and enable various GSP tasks, such as graph signal reconstruction, blind deconvolution, and sampling. In this paper, we assume double sparsity of both the graph signal and the graph topology, as well as a low-order graph filter. We propose three algorithms to reconstruct the support set of the input sparse graph signal from the graph filter output samples, leveraging these assumptions and the generalized information criterion (GIC). First, we describe the graph multiple GIC (GM-GIC) method, which is based on partitioning the dictionary elements (graph filter matrix columns) that capture information on the signal into smaller subsets. Then, the local GICs are computed for each subset and aggregated to make a global decision. Second, inspired by the well-known branch and bound (BNB) approach, we develop the graph-based branch and bound GIC (graph-BNB-GIC), and incorporate a new tractable heuristic bound tailored to the graph and graph filter characteristics. In addition, we propose the graph-based first order correction (GFOC) method, which improves existing sparse recovery methods by iteratively examining potential improvements to the GIC cost function by replacing elements from the estimated support set with elements from their one-hop neighborhood. In addition, we investigate the application of our graph-based sparse recovery methods in blind deconvolution scenarios where the graph filter is unknown.

eess.SP↗

Verifying the Smoothness of Graph Signals: A Graph Signal Processing Approach

Graph signal processing (GSP) deals with the representation, analysis, and processing of structured data, i.e. graph signals that are defined on the vertex set of a generic graph. A crucial prerequisite for applying various GSP and graph neural network (GNN) approaches is that the examined signals are smooth graph signals with respect to the underlying graph, or, equivalently, have low graph total variation (TV). In this paper, we develop GSP-based approaches to verify the validity of the smoothness assumption of given signals (data) and an associated graph. The proposed approaches are based on the representation of network data as the output of a graph filter with a given graph topology. In particular, we develop two smoothness detectors for the graph-filter-output model: 1) the likelihood ratio test (LRT) for known model parameters; and 2) a semi-parametric detector that estimates the graph filter and then validates its smoothness. The properties of the proposed GSP-based detectors are investigated, and some special cases are discussed. The performance of the GSP-based detectors is evaluated using synthetic data, data from the IEEE 14-bus power system, and measurements from a network of light intensity sensors, under different setups. The results demonstrate the effectiveness of the proposed approach and its robustness to different generating models, noise levels, and number of samples.

eess.SP↗

Efficient Graph Laplacian Estimation by Proximal Newton

The Laplacian-constrained Gaussian Markov Random Field (LGMRF) is a common multivariate statistical model for learning a weighted sparse dependency graph from given data. This graph learning problem can be formulated as a maximum likelihood estimation (MLE) of the precision matrix, subject to Laplacian structural constraints, with a sparsity-inducing penalty term. This paper aims to solve this learning problem accurately and efficiently. First, since the commonly used $\ell_1$-norm penalty is inappropriate in this setting and may lead to a complete graph, we employ the nonconvex minimax concave penalty (MCP), which promotes sparse solutions with lower estimation bias. Second, as opposed to existing first-order methods for this problem, we develop a second-order proximal Newton approach to obtain an efficient solver, utilizing several algorithmic features, such as using Conjugate Gradients, preconditioning, and splitting to active/free sets. Numerical experiments demonstrate the advantages of the proposed method in terms of both computational complexity and graph learning accuracy compared to existing methods.

cs.LG↗

Estimation of Complex Valued Laplacian Matrices for Topology Identification in Power Systems

In this paper, we investigate the problem of estimating a complex-valued Laplacian matrix with a focus on its application in the estimation of admittance matrices in power systems. The proposed approach is based on a constrained maximum likelihood estimator (CMLE) of the complex-valued Laplacian, which is formulated as an optimization problem with Laplacian and sparsity constraints. The complex-valued Laplacian is a symmetric, non-Hermitian matrix that exhibits a joint sparsity pattern between its real and imaginary parts. Thus, we present a group-sparse-based penalized log-likelihood approach for the Laplacian estimation. Leveraging the mixed \ell 2,1 norm relaxation of the joint sparsity constraint, we develop a new alternating direction method of multipliers (ADMM) estimation algorithm for the implementation of the CMLE of the Laplacian matrix under a linear Gaussian model. Next, we apply the proposed ADMM algorithms for the problem of estimating the admittance matrix under three commonly used measurement models that stem from Kirchhoff and Ohm laws, each with different assumptions and simplifications: 1) the nonlinear alternating current (AC) model; 2) the decoupled linear power flow (DLPF) model; and 3) the direct current (DC) model. The performance of the ADMM algorithm is evaluated using data from the IEEE 33-bus power system data under different settings. The numerical experiments demonstrate that the proposed algorithm outperforms existing methods in terms of mean-squared-error (MSE) and F-score, thus providing a more accurate recovery of the admittance matrix.

eess.SP↗

Protection Against Graph-Based False Data Injection Attacks on Power Systems

Graph signal processing (GSP) has emerged as a powerful tool for practical network applications, including power system monitoring. Recent research has focused on developing GSP-based methods for state estimation, attack detection, and topology identification using the representation of the power system voltages as smooth graph signals. Within this framework, efficient methods have been developed for detecting false data injection (FDI) attacks, which until now were perceived as non-smooth with respect to the graph Laplacian matrix. Consequently, these methods may not be effective against smooth FDI attacks. In this paper, we propose a graph FDI (GFDI) attack that minimizes the Laplacian-based graph total variation (TV) under practical constraints. We present the GFDI attack as the solution for a non-convex constrained optimization problem. The solution to the GFDI attack problem is obtained through approximating it using $\ell_1$ relaxation. A series of quadratic programming problems that are classified as convex optimization problems are solved to obtain the final solution. We then propose a protection scheme that identifies the minimal set of measurements necessary to constrain the GFDI output to a high graph TV, thereby enabling its detection by existing GSP-based detectors. Our numerical simulations on the IEEE-57 and IEEE-118 bus test cases reveal the potential threat posed by well-designed GSP-based FDI attacks. Moreover, we demonstrate that integrating the proposed protection design with GSP-based detection can lead to significant hardware cost savings compared to previous designs of protection methods against FDI attacks.

eess.SP↗

NUV-DoA: NUV Prior-based Bayesian Sparse Reconstruction with Spatial Filtering for Super-Resolution DoA Estimation

Achieving high-resolution Direction of Arrival (DoA) recovery typically requires high Signal to Noise Ratio (SNR) and a sufficiently large number of snapshots. This paper presents NUV-DoA algorithm, that augments Bayesian sparse reconstruction with spatial filtering for super-resolution DoA estimation. By modeling each direction on the azimuth's grid with the sparsity-promoting normal with unknown variance (NUV) prior, the non-convex optimization problem is reduced to iteratively reweighted least-squares under Gaussian distribution, where the mean of the snapshots is a sufficient statistic. This approach not only simplifies our solution but also accurately detects the DoAs. We utilize a hierarchical approach for interference cancellation in multi-source scenarios. Empirical evaluations show the superiority of NUV-DoA, especially in low SNRs, compared to alternative DoA estimators.

eess.SP↗

GSP-Based MAP Estimation of Graph Signals

In this paper, we consider the problem of recovering random graph signals from nonlinear measurements. We formulate the maximum a-posteriori probability (MAP) estimator, which results in a nonconvex optimization problem. Conventional iterative methods for minimizing nonconvex problems are sensitive to the initialization, have high computational complexity, and do not utilize the underlying graph structure behind the data. In this paper we propose two new estimators that are both based on the Gauss-Newton method: 1) the elementwise graph-frequency-domain MAP (eGFD-MAP) estimator; and 2) the graph signal processing MAP (GSP-MAP) estimator. At each iteration, these estimators are updated by the outputs of two graph filters, with the previous state estimator and the residual as the input graph signals. The eGFD-MAP estimator is an ad-hoc method that minimizes the MAP objective function in the graph frequency domain and neglects mixed-derivatives of different graph frequencies in the Jacobian matrix as well as off-diagonal elements in the covariance matrices. Consequently, it updates the elements of the graph signal independently, which reduces the computational complexity compared to the conventional MAP estimator. The GSP-MAP estimator is based on optimizing the graph filters at each iteration of the Gauss-Newton algorithm. We state conditions under which the eGFD-MAP and GSP- MAP estimators coincide with the MAP estimator, in the case of an observation model with orthogonal graph frequencies. We evaluate the performance of the estimators for nonlinear graph signal recovery tasks with synthetic data and with the real-world problem of state estimation in power systems. These simulations show the advantages of the proposed estimators in terms of computational complexity, mean-squared-error, and robustness to the initialization of the iterative algorithms.

eess.SP↗