arXiv subjects

Michael Fauß

Publications and source records attributed to Michael Fauß.

15 recordsLinked to original sources

arXiv2026

Minimax Optimal Procedures for Joint Detection and Estimation

We investigate the problem of jointly testing a pair of composite hypotheses and, depending on the test result, estimating a random parameter under distributional uncertainties. Specifically, it is assumed that the distribution of the data given the parameter of interest, is subject to uncertainty. Both, a Bayesian formulation and a Neyman-Pearson-like formulation, are considered. It is shown that the optimal policy induces an $f$-similarity that must be maximized to identify the least favorable distributions. Besides the general results, the implementation is investigated using a band-type uncertainty model. For designing the minimax procedures, existing algorithms are modified to increase convergence speed while maintaining numerical stability. The proposed theory is supplemented by numerical results for both formulations.

eess.SP↗

arXiv2024

Asymptotically Optimal Procedures for Sequential Joint Detection and Estimation

We investigate the problem of jointly testing multiple hypotheses and estimating a random parameter of the underlying distribution in a sequential setup. The aim is to jointly infer the true hypothesis and the true parameter while using on average as few samples as possible and keeping the detection and estimation errors below predefined levels. Based on mild assumptions on the underlying model, we propose an asymptotically optimal procedure, i.e., a procedure that becomes optimal when the tolerated detection and estimation error levels tend to zero. The implementation of the resulting asymptotically optimal stopping rule is computationally cheap and, hence, applicable for high-dimensional data. We further propose a projected quasi-Newton method to optimally choose the coefficients that parameterize the instantaneous cost function such that the constraints are fulfilled with equality. The proposed theory is validated by numerical examples.

eess.SP↗

arXiv2021

Minimax Robust Landmine Detection Using Forward-Looking Ground-Penetrating Radar

We propose a robust likelihood-ratio test (LRT) to detect landmines and unexploded ordnance using a forward-looking ground-penetrating radar. Instead of modeling the distributions of the target and clutter returns with parametric families, we construct a band of feasible probability densities under each hypothesis. The LRT is then devised based on the least favorable densities within the bands. This detector is designed to maximize the worst-case performance over all feasible density pairs and, hence, does not require strong assumptions about the clutter and noise distributions. The proposed technique is evaluated using electromagnetic field simulation data of shallow-buried targets. We show that, compared to detectors based on parametric models, robust detectors can lead to significantly reduced false alarm rates, particularly in cases where there is a mismatch between the assumed model and the true distributions.

eess.SP↗

arXiv2021

On Optimal Quantization in Sequential Detection

The problem of designing optimal quantization rules for sequential detectors is investigated. First, it is shown that this task can be solved within the general framework of active sequential detection. Using this approach, the optimal sequential detector and the corresponding quantizer are characterized and their properties are briefly discussed. In particular, it is shown that designing optimal quantization rules requires solving a nonconvex optimization problem, which can lead to issues in terms of computational complexity and numerical stability. Motivated by these difficulties, two performance bounds are proposed that are easier to evaluate than the true performance measures and are potentially tighter than the bounds currently available in the literature. The usefulness of the bounds and the properties of the optimal quantization rules are illustrated with two numerical examples.

cs.IT↗

arXiv2021

Minimax Robust Detection: Classic Results and Recent Advances

This paper provides an overview of results and concepts in minimax robust hypothesis testing for two and multiple hypotheses. It starts with an introduction to the subject, highlighting its connection to other areas of robust statistics and giving a brief recount of the most prominent developments. Subsequently, the minimax principle is introduced and its strengths and limitations are discussed. The first part of the paper focuses on the two-hypothesis case. After briefly reviewing the basics of statistical hypothesis testing, uncertainty sets are introduced as a generic way of modeling distributional uncertainty. The design of minimax detectors is then shown to reduce to the problem of determining a pair of least favorable distributions, and different criteria for their characterization are discussed. Explicit expressions are given for least favorable distributions under three types of uncertainty: $\varepsilon$-contamination, probability density bands, and $f$-divergence balls. Using examples, it is shown how the properties of these least favorable distributions translate to properties of the corresponding minimax detectors. The second part of the paper deals with the problem of robustly testing multiple hypotheses, starting with a discussion of why this is fundamentally different from the binary problem. Sequential detection is then introduced as a technique that enables the design of strictly minimax optimal tests in the multi-hypothesis case. Finally, the usefulness of robust detectors in practice is showcased using the example of ground penetrating radar. The paper concludes with an outlook on robust detection beyond the minimax principle and a brief summary of the presented material.

cs.IT↗

arXiv2021

Bayesian Sequential Joint Detection and Estimation under Multiple Hypotheses

We consider the problem of jointly testing multiple hypotheses and estimating a random parameter of the underlying distribution. This problem is investigated in a sequential setup under mild assumptions on the underlying random process. The optimal method minimizes the expected number of samples while ensuring that the average detection/estimation errors do not exceed a certain level. After converting the constrained problem to an unconstrained one, we characterize the general solution by a non-linear Bellman equation, which is parametrized by a set of cost coefficients. A strong connection between the derivatives of the cost function with respect to the coefficients and the detection/estimation errors of the sequential procedure is derived. Based on this fundamental property, we further show that for suitably chosen cost coefficients the solutions of the constrained and the unconstrained problem coincide. We present two approaches to finding the optimal coefficients. For the first approach, the final optimization problem is converted into a linear program, whereas the second approach solves it with a projected gradient ascent. To illustrate the theoretical results, we consider two problems for which the optimal schemes are designed numerically. Using Monte Carlo simulations, it is validated that the numerical results agree with the theory.

eess.SP↗

arXiv2020

Fading Boundaries: On a Nonparametric Variant of the Kiefer--Weiss Problem

A nonparametric variant of the Kiefer--Weiss problem is proposed and investigated. In analogy to the classical Kiefer--Weiss problem, the objective is to minimize the maximum expected sample size of a sequential test. However, instead of taking the maximum over a parametric family of distributions, it is taken over all distributions defined on the given sample space. Two optimality conditions are stated, one necessary and one sufficient. The latter is based on existing results on a more general minimax problem in sequential detection. These results are specialized and made explicit in this paper. It is shown that the nonparametric Kiefer--Weiss test is distinctly different from its parametric counterpart and admits non-standard, arguably counterintuitive properties. In particular, it can be nontruncated and critically depends on its stopping rules being randomized. These properties are illustrated numerically using the example of coin flipping, that is, testing the success probability of a Bernoulli random variable.

math.ST↗

arXiv2020

A Cramér-Rao Type Bound for Bayesian Risk with Bregman Loss

A general class of Bayesian lower bounds when the underlying loss function is a Bregman divergence is demonstrated. This class can be considered as an extension of the Weinstein--Weiss family of bounds for the mean squared error and relies on finding a variational characterization of Bayesian risk. The approach allows for the derivation of a version of the Cramér--Rao bound that is specific to a given Bregman divergence. The new generalization of the Cramér--Rao bound reduces to the classical one when the loss function is taken to be the Euclidean norm. The effectiveness of the new bound is evaluated in the Poisson noise setting and the Binomial noise setting.

cs.IT↗

arXiv2020

MMSE Bounds Under Kullback-Leibler Divergence Constraints on the Joint Input-Output Distribution

This paper proposes a new family of lower and upper bounds on the minimum mean squared error (MMSE). The key idea is to minimize/maximize the MMSE subject to the constraint that the joint distribution of the input-output statistics lies in a Kullback-Leibler divergence ball centered at some Gaussian reference distribution. Both bounds are tight and are attained by Gaussian distributions whose mean is identical to that of the reference distribution and whose covariance matrix is determined by a scalar parameter that can be obtained by finding the root of a monotonic function. The upper bound corresponds to a minimax optimal estimator and provides performance guarantees under distributional uncertainty. The lower bound provides an alternative to well-known inequalities in estimation theory, such as the Cramér-Rao bound, that is potentially tighter and defined for a larger class of distributions. Examples of applications in signal processing and information theory illustrate the usefulness of the proposed bounds in practice.

cs.IT↗

arXiv2020

Nonparametric Estimation of the Fisher Information and Its Applications

This paper considers the problem of estimation of the Fisher information for location from a random sample of size $n$. First, an estimator proposed by Bhattacharya is revisited and improved convergence rates are derived. Second, a new estimator, termed a clipped estimator, is proposed. Superior upper bounds on the rates of convergence can be shown for the new estimator compared to the Bhattacharya estimator, albeit with different regularity conditions. Third, both of the estimators are evaluated for the practically relevant case of a random variable contaminated by Gaussian noise. Moreover, using Brown's identity, which relates the Fisher information and the minimum mean squared error (MMSE) in Gaussian noise, two corresponding consistent estimators for the MMSE are proposed. Simulation examples for the Bhattacharya estimator and the clipped estimator as well as the MMSE estimators are presented. The examples demonstrate that the clipped estimator can significantly reduce the required sample size to guarantee a specific confidence interval compared to the Bhattacharya estimator.

cs.IT↗

arXiv2020

Distributed Joint Detection and Estimation: A Sequential Approach

We investigate the problem of jointly testing two hypotheses and estimating a random parameter based on data that is observed sequentially by sensors in a distributed network. In particular, we assume the data to be drawn from a Gaussian distribution, whose random mean is to be estimated. Forgoing the need for a fusion center, the processing is performed locally and the sensors interact with their neighbors following the consensus+innovations approach. We design the test at the individual sensors such that the performance measures, namely, error probabilities and mean-squared error, do not exceed pre-defined levels while the average sample number is minimized. After converting the constrained problem to an unconstrained problem and the subsequent reduction to an optimal stopping problem, we solve the latter utilizing dynamic programming. The solution is shown to be characterized by a set of non-linear Bellman equations, parametrized by cost coefficients, which are then determined by linear programming as to fulfill the performance specifications. A numerical example validates the proposed theory.

eess.SP↗

arXiv2020

Tight Bounds on the Weighted Sum of MMSEs with Applications in Distributed Estimation

In this paper, tight upper and lower bounds are derived on the weighted sum of minimum mean-squared errors for additive Gaussian noise channels. The bounds are obtained by constraining the input distribution to be close to a Gaussian reference distribution in terms of the Kullback--Leibler divergence. The distributions that attain these bounds are shown to be Gaussian whose covariance matrices are defined implicitly via systems of matrix equations. Furthermore, the estimators that attain the upper bound are shown to be minimax robust against deviations from the assumed input distribution. The lower bound provides a potentially tighter alternative to well-known inequalities such as the Cramér--Rao lower bound. Numerical examples are provided to verify the theoretical findings of the paper. The results derived in this paper can be used to obtain performance bounds, robustness guarantees, and engineering guidelines for the design of local estimators for distributed estimation problems which commonly arise in wireless communication systems and sensor networks.

cs.IT↗

arXiv2019

Latency Analysis for Sequential Detection in Low-Complexity Binary Radio Systems

We consider the problem of making a quick decision in favor of one of two possible physical signal models while the numerical measurements are acquired by sensing devices featuring minimal digitization complexity. Therefore, the digital data streams available for statistical processing are binary and exhibit temporal and spatial dependencies. To handle the intractable multivariate binary data model, we first consider sequential tests for exponential family distributions. Within this generic probabilistic framework, we identify adaptive approximations for the log-likelihood ratio and the Kullback-Leibler divergence. The results allow designing sequential detectors for binary radio systems and analyzing their average run-time along classical arguments of Wald. In particular, the derived tests exploit the spatio-temporal correlation structure of the analog sensor signals engraved into the binary measurements. As an application, we consider the specification of binary sensing architectures for cognitive radio and GNSS spectrum monitoring where our results characterize the sequential detection latency as a function of the temporal oversampling and the number of antennas. Finally, we evaluate the efficiency of the proposed algorithms and illustrate the accuracy of our analysis via Monte-Carlo simulations.

eess.SP↗

arXiv2018

In a One-Bit Rush: Low-Latency Wireless Spectrum Monitoring with Binary Sensor Arrays

Detecting the presence of a random wireless source with minimum latency utilizing an array of radio sensors is considered. The problem is studied under the constraint that the analog-to-digital conversion at each sensor is restricted to reading the sign of the analog received signal. We formulate the resulting digital signal processing task as a sequential hypothesis test in simple form. To circumvent the intractable probabilistic model of the multivariate binary array data, a reduced model representation within the exponential family in conjunction with a log-likelihood ratio approximation is employed. This approach allows us to design a likelihood-based sequential test and to analyze its analytic performance along Wald's classical arguments. In the context of wireless spectrum monitoring for satellite-based navigation and synchronization systems, we study the achievable processing latency, characterized by the average sample number, as a function of the binary sensors in use. The practical feasibility and potential of the discussed low-complexity sensing and decision-making technology is demonstrated via simulations.

eess.SP↗

arXiv2018

Old Bands, New Tracks---Revisiting the Band Model for Robust Hypothesis Testing

The density band model proposed by Kassam for robust hypothesis testing is revisited in this paper. First, a novel criterion for the general characterization of least favorable distributions is proposed, which unifies existing results. This criterion is then used to derive an implicit definition of the least favorable distributions under band uncertainties. In contrast to the existing solution, it only requires two scalar values to be determined and eliminates the need for case-by-case statements. Based on this definition, a generic fixed-point algorithm is proposed that iteratively calculates the least favorable distributions for arbitrary band specifications. Finally, three different types of robust tests that emerge from band models are discussed and a numerical example is presented to illustrate their potential use in practice.

cs.IT↗