SearcharxivSearch

arXiv subjects

Christian Clason

Publications and source records attributed to Christian Clason.

At least 19 recordsLinked to original sources

Variational Analysis in Spectral Decomposition Systems

This work is concerned with variational analysis of so-called spectral functions and spectral sets of matrices that only depend on eigenvalues of the matrix. Based on our previous work [H. T. B\`ui, M. N. B\`ui, and C. Clason, Convex analysis in spectral decomposition systems, arXiv 2503.14981] on convex analysis of such functions, we consider the question in the abstract framework of spectral decomposition systems, which covers a wide range of previously studied settings, including eigenvalue decomposition of Hermitian matrices and singular value decomposition of rectangular matrices, and allows deriving new results in more general settings such as normal decomposition systems and signed singular value decompositions. The main results characterize Fr\'echet and limiting normal cones to spectral sets as well as Fr\'echet, limiting, and Clarke subdifferentials of spectral functions in terms of the reduced functions. For the latter, we also characterize Fr\'echet differentiability. Finally, we obtain a generalization of Lidski\u{\i}'s theorem on the spectrum of additive perturbations of Hermitian matrices to arbitrary spectral decomposition systems.

math.OC

Well-posedness of an optical flow based optimal control formulation for image registration

We consider image registration as an optimal control problem using an optical flow formulation, i.e., we discuss an optimization problem that is governed by a linear hyperbolic transport equation. Requiring Lipschitz continuity of the vector fields that parametrize the transformation leads to an optimization problem in a non-reflexive Banach space. We introduce relaxations of the optimization problem involving smoothed maximum and minimum functions and appropriate Orlicz spaces. To derive well-posedness results for the relaxed optimization problem, we revisit and establish new existence and uniqueness results for the linear hyperbolic transport equations. We further discuss limit considerations with respect to the relaxation parameter and discretizations.

math.OC

Convex Analysis in Spectral Decomposition Systems

This work is concerned with the convex analysis of functions defined on (not necessarily finite-dimensional) Hilbert spaces whose values depend solely on a certain ``spectrum'' of the arguments, a class we term ``spectral functions.'' We propose a notion of a spectral decomposition system which brings together a wide array of settings underlying important applications such as Fourier-phase-invariant functions, mixed-norm regularization, and functions of eigenvalues or (signed) singular values of matrices. We are particularly motivated by algorithmic requirements for evaluating convex analytical objects. Thus, a central contribution is a novel reduced minimization principle that enables the constructive reduction of minimization problems involving spectral functions to those of the simpler associated invariant functions. This result is then leveraged to explicitly evaluate the conjugates, subgradients, and set-valued Bregman proximity operators of spectral functions.

math.OC

Numerical analysis of a nonsmooth quasilinear elliptic control problem: II. Finite element discretization and error estimates

In this paper, we carry out the numerical analysis of a nonsmooth quasilinear elliptic optimal control problem, where the coefficient in the divergence term of the corresponding state equation is not differentiable with respect to the state variable. Despite the lack of differentiability of the nonlinearity in the quasilinear elliptic equation, the corresponding control-to-state operator is of class $C^1$ but not of class $C^2$. Analogously, the discrete control-to-state operators associated with the approximated control problems are proven to be of class $C^1$ only. By using an explicit second-order sufficient optimality condition, we prove a priori error estimates for a variational approximation, a piecewise constant approximation, and a continuous piecewise linear approximation of the continuous optimal control problem. The numerical tests confirm these error estimates.

math.NA

Numerical analysis of a nonsmooth quasilinear elliptic control problem: I. Explicit second-order optimality conditions

In this paper, we derive explicit second-order necessary and sufficient optimality conditions of a local minimizer to an optimal control problem for a quasilinear second-order partial differential equation with a piecewise smooth but not differentiable nonlinearity in the leading term. The key argument rests on the analysis of level sets of the state. Specifically, we show that if a function vanishes on the boundary and its the gradient is different from zero on a level set, then this set decomposes into finitely many closed simple curves. Moreover, the level sets depend continuously on the functions defining these sets. We also prove the continuity of the integrals on the level sets. In particular, Green's first identity is shown to be applicable on an open set determined by two functions with nonvanishing gradients. In the second part to this paper, the explicit sufficient second-order conditions will be used to derive error estimates for a finite-element discretization of the control problem.

math.OC

Nonsmooth Analysis and Optimization

These lecture notes for a graduate course cover generalized derivative concepts useful in deriving necessary optimality conditions and numerical algorithms for nondifferentiable optimization problems in inverse problems, imaging, and PDE-constrained optimization. Treated are convex functions and subdifferentials, Fenchel duality, monotone operators and resolvents, Moreau--Yosida regularization, proximal point and (some) first-order splitting methods, Clarke subdifferentials, and semismooth Newton methods. The required background from functional analysis and calculus of variations is also briefly summarized.

math.OC

Convex relaxation of discrete vector-valued optimization problems

We consider a class of infinite-dimensional optimization problems in which a distributed vector-valued variable should pointwise almost everywhere take values from a given finite set $\mathcal{M}\subset\mathbb{R}^m$. Such hybrid discrete--continuous problems occur in, e.g., topology optimization or medical imaging and are challenging due to their lack of weak lower semicontinuity. To circumvent this difficulty, we introduce as a regularization term a convex integral functional with an integrand that has a polyhedral epigraph with vertices corresponding to the values of $\mathcal{M}$; similar to the $L^1$ norm in sparse regularization, this "vector multibang penalty" promotes solutions with the desired structure while allowing the use of tools from convex optimization for the analysis as well as the numerical solution of the resulting problem. We show well-posedness of the regularized problem and analyze stability properties of its solution in a general setting. We then illustrate the approach for three specific model optimization problems of broader interest: optimal control of the Bloch equation, optimal control of an elastic deformation, and a multimaterial branched transport problem. In the first two cases, we derive explicit characterizations of the penalty and its generalized derivatives for a concrete class of sets $\mathcal{M}$. For the third case, we discuss the algorithmic computation of these derivatives for general sets. These derivatives are then used in a superlinearly convergent semismooth Newton method applied to a sequence of regularized optimization problems. We illustrate the behavior of this approach for the three model problems with numerical examples.

math.OC

Introduction to Finite Element Methods

These lecture notes for a graduate course present an introduction to the mathematical theory of finite element methods for the numerical solution of partial differential equations. Covered are conforming and nonconforming (in particular, discontinuous Galerkin and mixed methods) for elliptic partial differential equations and Galerkin methods for parabolic equations.

math.NA

Regularization of Inverse Problems

These lecture notes for a graduate class present the regularization theory for linear and nonlinear ill-posed operator equations in Hilbert spaces. Covered are the general framework of regularization methods and their analysis via spectral filters as well as the concrete examples of Tikhonov regularization, Landweber iteration, regularization by discretization for linear inverse problems. In the nonlinear setting, Tikhonov regularization and iterative regularization (Landweber, Levenberg-Marquardt, and iteratively regularized Gauß-Newton methods) are discussed. The necessary background from functional analysis is also briefly summarized. The notes end with a brief outlook to statistical inverse problems from both a frequentist and a Bayesian point of view.

math.FA

Optimal control of the principal coefficient in a scalar wave equation

We consider optimal control of the scalar wave equation where the control enters as a coefficient in the principal part. Adding a total variation penalty allows showing existence of optimal controls, which requires continuity results for the coefficient-to-solution mapping for discontinuous coefficients. We additionally consider a so-called "multi-bang" penalty that promotes controls taking on values pointwise almost everywhere from a specified discrete set. Under additional assumptions on the data, we derive an improved regularity result for the state, leading to optimality conditions that can be interpreted in an appropriate pointwise fashion. The numerical solution makes use of a stabilized finite element method and a nonlinear primal-dual proximal splitting algorithm.

math.OC

No-gap second-order optimality conditions for optimal control of a non-smooth quasilinear elliptic equation

This paper deals with second-order optimality conditions for a quasilinear elliptic control problem with a nonlinear coefficient in the principal part that is countably $PC^2$ (continuous and $C^2$ apart from countably many points). We prove that the control-to-state operator is continuously differentiable even though the nonlinear coefficient is non-smooth. This enables us to establish "no-gap" second-order necessary and sufficient optimality conditions in terms of an abstract curvature functional, i. e., for which the sufficient condition only differs from the necessary one in the fact that the inequality is strict. A condition that is equivalent to the second-order sufficient optimality condition and could be useful for error estimates in, e.g., finite element discretizations is also provided.

math.OC

Entropic regularization of continuous optimal transport problems

We analyze continuous optimal transport problems in the so-called Kantorovich form, where we seek a transport plan between two marginals that are probability measures on compact subsets of Euclidean space. We consider the case of regularization with the negative entropy with respect to the Lebesgue measure, which has attracted attention because it can be solved by the very simple Sinkhorn algorithm. We first analyze the regularized problem in the context of classical Fenchel duality and derive a strong duality result for a predual problem in the space of continuous functions. However, this problem may not admit a minimizer, which prevents obtaining primal-dual optimality conditions. We then show that the primal problem is naturally analyzed in the Orlicz space of functions with finite entropy in the sense that the entropically regularized problem admits a minimizer if and only if the marginals have finite entropy. We then derive a dual problem in the corresponding dual space, for which existence can be shown by purely variational arguments and primal-dual optimality conditions can be derived. For marginals that do not have finite entropy, we finally show Gamma-convergence of the regularized problem with smoothed marginals to the original Kantorovich problem.

math.OC

Primal-dual proximal splitting and generalized conjugation in non-smooth non-convex optimization

We demonstrate that difficult non-convex non-smooth optimization problems, such as Nash equilibrium problems and anisotropic as well as isotropic Potts segmentation model, can be written in terms of generalized conjugates of convex functionals. These, in turn, can be formulated as saddle-point problems involving convex non-smooth functionals and a general smooth but non-bilinear coupling term. We then show through detailed convergence analysis that a conceptually straightforward extension of the primal--dual proximal splitting method of Chambolle and Pock is applicable to the solution of such problems. Under sufficient local strong convexity assumptions of the functionals -- but still with a non-bilinear coupling term -- we even demonstrate local linear convergence of the method. We illustrate these theoretical results numerically on the aforementioned example problems.

math.OC

Introduction to Nonsmooth Analysis and Optimization

Functions that are not differentiable in the classical sense have become a central tool in modern mathematical models for imaging, inverse problems, machine learning, and optimal control of differential equations. These models are increasingly formulated in infinite-dimensional function spaces to be independent of problem size and discretization quality. This book presents a unified and rigorous introduction to the infinite-dimensional analysis and algorithmic solution of nonsmooth optimization problems arising from the above-mentioned models, from the necessary theoretical tools of nonsmooth analysis to state-of-the-art algorithms and their convergence and stability analysis.

math.OC

Bouligand-Levenberg-Marquardt iteration for a non-smooth ill-posed inverse problem

In this paper, we consider a modified Levenberg--Marquardt method for solving an ill-posed inverse problem where the forward mapping is not Gâteaux differentiable. By relaxing the standard assumptions for the classical smooth setting, we derive asymptotic stability estimates that are then used to prove the convergence of the proposed method. This method can be applied to an inverse source problem for a non-smooth semilinear elliptic PDE where a Bouligand subdifferential can be used in place of the non-existing Fréchet derivative, and we show that the corresponding Bouligand-Levenberg-Marquardt iteration is an iterative regularization scheme. Numerical examples illustrate the advantage over the corresponding Bouligand-Landweber iteration.

math.NA

Optimal control problems with control complementarity constraints

A special class of optimal control problems with complementarity constraints on the control functions is studied. It is shown that such problems possess optimal solutions whenever the underlying control space is a first-order Sobolev space. After deriving necessary optimality conditions of strong stationarity-type, a penalty method based on the Fischer-Burmeister function is suggested and its theoretical properties are analyzed. Finally, the numerical treatment of the problem is discussed and results of computational experiments are presented.

math.OC

Optimal control of a non-smooth quasilinear elliptic equation

This work is concerned with an optimal control problem governed by a non-smooth quasilinear elliptic equation with a nonlinear coefficient in the principal part that is locally Lipschitz continuous and directionally but not Gâteaux differentiable. This leads to a control-to-state operator that is directionally but not Gâteaux differentiable as well. Based on a suitable regularization scheme, we derive C- and strong stationarity conditions. Under the additional assumption that the nonlinearity is a PC^1 function with countably many points of nondifferentiability, we show that both conditions are equivalent. Furthermore, under this assumption we derive a relaxed optimality system that is amenable to numerical solution using a semi-smooth Newton method. This is illustrated by numerical examples.

math.OC

Acceleration and global convergence of a first-order primal--dual method for nonconvex problems

The primal--dual hybrid gradient method (PDHGM, also known as the Chambolle--Pock method) has proved very successful for convex optimization problems involving linear operators arising in image processing and inverse problems. In this paper, we analyze an extension to nonconvex problems that arise if the operator is nonlinear. Based on the idea of testing, we derive new step length parameter conditions for the convergence in infinite-dimensional Hilbert spaces and provide acceleration rules for suitably (locally and/or partially) monotone problems. Importantly, we prove linear convergence rates as well as global convergence in certain cases. We demonstrate the efficacy of these step length rules for PDE-constrained optimization problems.

math.OC