Searcharxiv⌕ Search

arXiv subjects

Frank Werner

Publications and source records attributed to Frank Werner.

At least 37 records · Page 2Linked to original sources

Minimax detection of localized signals in statistical inverse problems

We investigate minimax testing for detecting local signals or linear combinations of such signals when only indirect data is available. Naturally, in the presence of noise, signals that are too small cannot be reliably detected. In a Gaussian white noise model, we discuss upper and lower bounds for the minimal size of the signal such that testing with small error probabilities is possible. In certain situations we are able to characterize the asymptotic minimax detection boundary. Our results are applied to inverse problems such as numerical differentiation, deconvolution and the inversion of the Radon transform.

math.ST↗

On uniqueness and ill-posedness for the deautoconvolution problem in the multi-dimensional case

This paper analyzes the inverse problem of deautoconvolution in the multi-dimensional case with respect to solution uniqueness and ill-posedness. Deautoconvolution means here the reconstruction of a real-valued $L^2$-function with support in the $n$-dimensional unit cube $[0,1]^n$ from observations of its autoconvolution either in the full data case (i.e. on $[0,2]^n$) or in the limited data case (i.e. on $[0,1]^n$). Based on multi-dimensional variants of the Titchmarsh convolution theorem due to Lions and Mikusiński, we prove in the full data case a twofoldness assertion, and in the limited data case uniqueness of non-negative solutions for which the origin belongs to the support. The latter assumption is also shown to be necessary for any uniqueness statement in the limited data case. A glimpse of rate results for regularized solutions completes the paper.

math.NA↗

Deautoconvolution in the two-dimensional case

There is extensive mathematical literature on the inverse problem of deautoconvolution for a function with support in the unit interval $[0,1] \subset \mathbb R$, but little is known about the multidimensional situation. This article tries to fill this gap with analytical and numerical studies on the reconstruction of a real function of two real variables over the unit square from observations of its autoconvolution on $[0,2]^2 \subset \mathbb R^2$ (full data case) or on $[0,1]^2$ (limited data case). In an $L^2$-setting, twofoldness and uniqueness assertions are proven for the deautoconvolution problem in 2D. Moreover, its ill-posedness is characterized and illustrated. Extensive numerical case studies give an overview of the behaviour of stable approximate solutions to the two-dimensional deautoconvolution problem obtained by Tikhonov-type regularization with different penalties and the iteratively regularized Gauss-Newton method.

math.NA↗

Efficiency Evaluation of Banks with Many Branches using a Heuristic Framework and Dynamic Data Envelopment Optimization Approach: A Real Case Study

Evaluating the efficiency of organizations and branches within an organization is a challenging issue for managers. Evaluation criteria allow organizations to rank their internal units, identify their position concerning their competitors, and implement strategies for improvement and development purposes. Among the methods that have been applied in the evaluation of bank branches, non-parametric methods have captured the attention of researchers in recent years. One of the most widely used non-parametric methods is the data envelopment analysis (DEA) which leads to promising results. However, the static DEA approaches do not consider the time in the model. Therefore, this paper uses a dynamic DEA (DDEA) method to evaluate the branches of a private Iranian bank over three years (2017-2019). The results are then compared with static DEA. After ranking the branches, they are clustered using the K-means method. Finally, a comprehensive sensitivity analysis approach is introduced to help the managers to decide about changing variables to shift a branch from one cluster to a more efficient one.

math.OC↗

On a Dynamic Variant of the Iteratively Regularized Gauss-Newton Method with Sequential Data

For numerous parameter and state estimation problems, assimilating new data as they become available can help produce accurate and fast inference of unknown quantities. While most existing algorithms for solving those kind of ill-posed inverse problems can only be used with a single instance of the observed data, in this work we propose a new framework that enables existing algorithms to invert multiple instances of data in a sequential fashion. Specifically we will work with the well-known iteratively regularized Gauss-Newton method (IRGNM), a variational methodology for solving nonlinear inverse problems. We develop a theory of convergence analysis for a proposed dynamic IRGNM algorithm in the presence of Gaussian white noise. We combine this algorithm with the classical IRGNM to deliver a practical (hybrid) algorithm that can invert data sequentially while producing fast estimates. Our work includes the proof of well-definedness of the proposed iterative scheme, as well as various error bounds that rely on standard assumptions for nonlinear inverse problems. We use several numerical experiments to verify our theoretical findings, and to highlight the benefits of incorporating sequential data. The context of the numerical experiments comprises various parameter identification problems including a Darcy flow elliptic PDE example, and that of electrical impedance tomography.

math.NA↗

A multi-objective sustainable planning for a real hazardous waste production problem

A significant amount of hazardous waste generated from health sectors and industrial processes has posed a major threat to human health by causing environmental issues and contamination of air, soil, and water resources. This paper presents a multi-objective mixed-integer nonlinear programming (MINLP) formulation for a sustainable hazardous waste location-routing problem. The location of the facilities and routing decisions for transporting hazardous waste and the waste residue is considered to design a suitable waste collection system. The presented model simultaneously minimizes the total costs of the waste management system, total risks from transportation and facilities, along with CO2 emissions. A real-world case study is presented to illustrate the applicability of the proposed model. To illustrate the significance of sustainability, the results of the original model are compared with the results of the model without considering sustainability. It indicates that, under the condition when sustainability is not taken into account, total cost, transportation, and site risk along with CO2 emission increased, which in turn demonstrated the importance of sustainability. Furthermore, the managerial insights gained from the optimal results would enable the managers to make better decisions in the hazardous waste management system.

math.OC↗

Home health care planning with considering flexible starting/ending points and service features

One of the recently proposed strategies in health systems is providing services to patients at home, improving the service quality, besides reducing the health system costs. In the real world, some services, such as biological tests or blood sampling, force the nurses to start or end his/her route from/at the laboratory instead of the depot, changing the whole optimal planning. The effect of these special service requirements and features has not been considered so far. In this study, a new mathematical model is suggested considering the flexibility of starting/ending places of each nurse's route according to the specific characteristics of each service. Then several sets of problems in various sizes are solved using the proposed model, where the results confirm the efficiency of the proposed approach. In addition, some sensitivity analyses are performed on the parameters of the required features of the services, followed by some managerial insights and directions for future studies.

math.OC↗

Variational Multiscale Nonparametric Regression: Algorithms and Implementation

Many modern statistically efficient methods come with tremendous computational challenges, often leading to large-scale optimisation problems. In this work, we examine such computational issues for recently developed estimation methods in nonparametric regression with a specific view on image denoising. We consider in particular certain variational multiscale estimators which are statistically optimal in minimax sense, yet computationally intensive. Such an estimator is computed as the minimiser of a smoothness functional (e.g., TV norm) over the class of all estimators such that none of its coefficients with respect to a given multiscale dictionary is statistically significant. The so obtained multiscale Nemirowski-Dantzig estimator (MIND) can incorporate any convex smoothness functional and combine it with a proper dictionary including wavelets, curvelets and shearlets. The computation of MIND in general requires to solve a high-dimensional constrained convex optimisation problem with a specific structure of the constraints induced by the statistical multiscale testing criterion. To solve this explicitly, we discuss three different algorithmic approaches: the Chambolle-Pock, ADMM and semismooth Newton algorithms. Algorithmic details and an explicit implementation is presented and the solutions are then compared numerically in a simulation study and on various test images. We thereby recommend the Chambolle-Pock algorithm in most cases for its fast convergence. We stress that our analysis can also be transferred to signal recovery and other denoising problems to recover more general objects whenever it is possible to borrow statistical strength from data patches of similar object structure.

stat.CO↗

What is resolution? A statistical minimax testing perspective on super-resolution microscopy

As a general rule of thumb the resolution of a light microscope (i.e. the ability to discern objects) is predominantly described by the full width at half maximum (FWHM) of its point spread function (psf)---the diameter of the blurring density at half of its maximum. Classical wave optics suggests a linear relationship between FWHM and resolution also manifested in the well known Abbe and Rayleigh criteria, dating back to the end of 19th century. However, during the last two decades conventional light microscopy has undergone a shift from microscopic scales to nanoscales. This increase in resolution comes with the need to incorporate the random nature of observations (light photons) and challenges the classical view of discernability, as we argue in this paper. Instead, we suggest a statistical description of resolution obtained from such random data. Our notion of discernability is based on statistical testing whether one or two objects with the same total intensity are present. For Poisson measurements we get linear dependence of the (minimax) detection boundary on the FWHM, whereas for a homogeneous Gaussian model the dependence of resolution is nonlinear. Hence, at small physical scales modeling by homogeneous gaussians is inadequate, although often implicitly assumed in many reconstruction algorithms. In contrast, the Poisson model and its variance stabilized Gaussian approximation seem to provide a statistically sound description of resolution at the nanoscale. Our theory is also applicable to other imaging setups, such as telescopes.

math.ST↗

On the asymptotical regularization for linear inverse problems in presence of white noise

We interpret steady linear statistical inverse problems as artificial dynamic systems with white noise and introduce a stochastic differential equation (SDE) system where the inverse of the ending time $T$ naturally plays the role of the squared noise level. The time-continuous framework then allows us to apply classical methods from data assimilation, namely the Kalman-Bucy filter and 3DVAR, and to analyze their behaviour as a regularization method for the original problem. Such treatment offers some connections to the famous asymptotical regularization method, which has not yet been analyzed in the context of random noise. We derive error bounds for both methods in terms of the mean-squared error under standard assumptions and discuss commonalities and differences between both approaches. If an additional tuning parameter $α$ for the initial covariance is chosen appropriately in terms of the ending time $T$, one of the proposed methods gains order optimality. Our results extend theoretical findings in the discrete setting given in the recent paper Iglesias et al. (2017). Numerical examples confirm our theoretical results.

math.NA↗

Bump detection in the presence of dependency: Does it ease or does it load?

We provide the asymptotic minimax detection boundary for a bump, i.e. an abrupt change, in the mean function of a stationary Gaussian process. This will be characterized in terms of the asymptotic behavior of the bump length and height as well as the dependency structure of the process. A major finding is that the asymptotic minimax detection boundary is generically determined by the value of its spectral density at zero. Finally, our asymptotic analysis is complemented by non-asymptotic results for AR($p$) processes and confirmed to serve as a good proxy for finite sample scenarios in a simulation study. Our proofs are based on laws of large numbers for non-independent and non-identically distributed arrays of random variables and the asymptotically sharp analysis of the precision matrix of the process.

math.ST↗

Convergence Analysis of (Statistical) Inverse Problems under Conditional Stability Estimates

Conditional stability estimates require additional regularization for obtaining stable approximate solutions if the validity area of such estimates is not completely known. In this context, we consider ill-posed nonlinear inverse problems in Hilbert scales satisfying conditional stability estimates characterized by general concave index functions. For that case, we exploit Tikhonov regularization and provide convergence and convergence rates of regularized solutions for both deterministic and stochastic noise. We further discuss a priori and a posteriori parameter choice rules and illustrate the validity of our assumptions in different model and real world situations.

math.NA↗

Multidimensional multiscale scanning in Exponential Families: Limit theory and statistical consequences

We consider the problem of finding anomalies in a $d$-dimensional field of independent random variables $\{Y_i\}_{i \in \left\{1,...,n\right\}^d}$, each distributed according to a one-dimensional natural exponential family $\mathcal F = \left\{F_θ\right\}_{θ\inΘ}$. Given some baseline parameter $θ_0 \inΘ$, the field is scanned using local likelihood ratio tests to detect from a (large) given system of regions $\mathcal{R}$ those regions $R \subset \left\{1,...,n\right\}^d$ with $θ_i \neq θ_0$ for some $i \in R$. We provide a unified methodology which controls the overall family wise error (FWER) to make a wrong detection at a given error rate. Fundamental to our method is a Gaussian approximation of the distribution of the underlying multiscale test statistic with explicit rate of convergence. From this, we obtain a weak limit theorem which can be seen as a generalized weak invariance principle to non identically distributed data and is of independent interest. Furthermore, we give an asymptotic expansion of the procedures power, which yields minimax optimality in case of Gaussian observations.

math.PR↗

Empirical Risk Minimization as Parameter Choice Rule for General Linear Regularization Methods

We consider the statistical inverse problem to recover $f$ from noisy measurements $Y = Tf + σξ$ where $ξ$ is Gaussian white noise and $T$ a compact operator between Hilbert spaces. Considering general reconstruction methods of the form $\hat f_α= q_α\left(T^*T\right)T^*Y$ with an ordered filter $q_α$, we investigate the choice of the regularization parameter $α$ by minimizing an unbiased estimate of the predictive risk $\mathbb E\left[\Vert Tf - T\hat f_α\Vert^2\right]$. The corresponding parameter $α_{\mathrm{pred}}$ and its usage are well-known in the literature, but oracle inequalities and optimality results in this general setting are unknown. We prove a (generalized) oracle inequality, which relates the direct risk $\mathbb E\left[\Vert f - \hat f_{α_{\mathrm{pred}}}\Vert^2\right]$ with the oracle prediction risk $\inf_{α>0}\mathbb E\left[\Vert Tf - T\hat f_α\Vert^2\right]$. From this oracle inequality we are then able to conclude that the investigated parameter choice rule is of optimal order. Finally we also present numerical simulations, which support the order optimality of the method and the quality of the parameter choice in finite sample situations.

math.NA↗

Multiscale scanning in inverse problems

In this paper we propose a multiscale scanning method to determine active components of a quantity $f$ w.r.t. a dictionary $\mathcal{U}$ from observations $Y$ in an inverse regression model $Y=Tf+ξ$ with linear operator $T$ and general random error $ξ$. To this end, we provide uniform confidence statements for the coefficients $\langle φ, f\rangle$, $φ\in \mathcal U$, under the assumption that $(T^*)^{-1} \left(\mathcal U\right)$ is of wavelet-type. Based on this we obtain a multiple test that allows to identify the active components of $\mathcal{U}$, i.e. $\left\langle f, φ\right\rangle \neq 0$, $φ\in \mathcal U$, at controlled, family-wise error rate. Our results rely on a Gaussian approximation of the underlying multiscale statistic with a novel scale penalty adapted to the ill-posedness of the problem. The scale penalty furthermore ensures weak convergence of the statistic's distribution towards a Gumbel limit under reasonable assumptions. The important special cases of tomography and deconvolution are discussed in detail. Further, the regression case, when $T = \text{id}$ and the dictionary consists of moving windows of various sizes (scales), is included, generalizing previous results for this setting. We show that our method obeys an oracle optimality, i.e. it attains the same asymptotic power as a single-scale testing procedure at the correct scale. Simulations support our theory and we illustrate the potential of the method as an inferential tool for imaging. As a particular application we discuss super-resolution microscopy and analyze experimental STED data to locate single DNA origami.

stat.ME↗

Bump detection in heterogeneous Gaussian regression

We analyze the effect of a heterogeneous variance on bump detection in a Gaussian regression model. To this end we allow for a simultaneous bump in the variance and specify its impact on the difficulty to detect the null signal against a single bump with known signal strength. This is done by calculating lower and upper bounds, both based on the likelihood ratio. Lower and upper bounds together lead to explicit characterizations of the detection boundary in several subregimes depending on the asymptotic behavior of the bump heights in mean and variance. In particular, we explicitly identify those regimes, where the additional information about a simultaneous bump in variance eases the detection problem for the signal. This effect is made explicit in the constant and / or the rate, appearing in the detection boundary. We also discuss the case of an unknown bump height and provide an adaptive test and some upper bounds in that case.

math.ST↗

Convergence Rates for Exponentially Ill-Posed Inverse Problems with Impulsive Noise

This paper is concerned with exponentially ill-posed operator equations with additive impulsive noise on the right hand side, i.e. the noise is large on a small part of the domain and small or zero outside. It is well known that Tikhonov regularization with an $L^1$ data fidelity term outperforms Tikhonov regularization with an $L^2$ fidelity term in this case. This effect has recently been explained and quantified for the case of finitely smoothing operators. Here we extend this analysis to the case of infinitely smoothing forward operators under standard Sobolev smoothness assumptions on the solution, i.e. exponentially ill-posed inverse problems. It turns out that high order polynomial rates of convergence in the size of the support of large noise can be achieved rather than the poor logarithmic convergence rates typical for exponentially ill-posed problems. The main tools of our analysis are Banach spaces of analytic functions and interpolation-type inequalities for such spaces. We discuss two examples, the (periodic) backwards heat equation and an inverse problem in gradiometry.

math.NA↗

Convergence Rates for Inverse Problems with Impulsive Noise

We study inverse problems F(f) = g with perturbed right hand side g^{obs} corrupted by so-called impulsive noise, i.e. noise which is concentrated on a small subset of the domain of definition of g. It is well known that Tikhonov-type regularization with an L^1 data fidelity term yields significantly more accurate results than Tikhonov regularization with classical L^2 data fidelity terms for this type of noise. The purpose of this paper is to provide a convergence analysis explaining this remarkable difference in accuracy. Our error estimates significantly improve previous error estimates for Tikhonov regularization with L^1-fidelity term in the case of impulsive noise. We present numerical results which are in good agreement with the predictions of our analysis.

math.NA↗