Searcharxiv⌕ Search
Home/Archive/arXiv

arXiv · 2610.04789

From Inverse Problems to Adjoint Gradients: A Discrete, Implementation-Oriented Tutorial on PDE-Constrained Optimization

Solmaz S. Kia
View original source ↗Read source document ↗Export metadata ↓

Abstract

The adjoint method is a standard approach for computing gradients in PDE-constrained optimization and central to parameter estimation, model calibration, and optimal control. This tutorial presents a discrete, implementation-oriented introduction to the method with an emphasis on conceptual understanding. Starting from an inverse problem governed by a partial differential equation, it develops the corresponding optimization problem and derives the adjoint gradient from the perspective of iterative descent methods. The roles of the state, the parameters, the objective, and the constraint are made explicit, and the adjoint equation is obtained directly from the gradient computation rather than postulated. Particular attention is given to explicit derivations, implementation details, and the connection between the mathematical development and the resulting computational algorithm. The tutorial also examines the influence of discretization on the adjoint construction, explains the origin of the backward-in-time adjoint recursion, and presents practical procedures for gradient verification. A vibrating-string inverse problem serves as a running example, illustrating the complete workflow from model formulation to adjoint-based optimization. The presentation is intended for advanced undergraduate students, graduate students, and practitioners seeking a step-by-step understanding of adjoint gradient computation.

Explore related subjects

math.OCcs.NAmath.NA

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Solmaz S. Kia. 2026-10-03. From Inverse Problems to Adjoint Gradients: A Discrete, Implementation-Oriented Tutorial on PDE-Constrained Optimization. https://arxiv.org/abs/2610.04789

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Multilevel Regularized Newton Methods with Fast Convergence Rates

We introduce new multilevel methods for solving large-scale unconstrained optimization problems. Specifically, the philosophy of multilevel methods is applied to Newton-type methods that regularize the Newton sub-problem using second order information from a coarse (low dimensional) sub-problem. The new \emph{regularized multilevel methods} provably converge from any initialization point and enjoy faster convergence rates than Gradient Descent. In particular, for arbitrary functions with Lipschitz continuous Hessians, we show that their convergence rate interpolates between the rate of Gradient Descent and that of the cubic Newton method. If, additionally, the objective function is assumed to be convex, then the proposed method converges with the fast $\mathcal{O}(k^{-2})$ rate. Hence, since the updates are generated using a \emph{coarse} model in low dimensions, the theoretical results of this paper significantly speed-up the convergence of Newton-type or preconditioned gradient methods in practical applications. Preliminary numerical results suggest that the proposed multilevel algorithms are significantly faster than current state-of-the-art methods.

math.OC↗
arXiv2026

Adaptive Algorithms for Robust Phase Retrieval

This paper considers robust phase retrieval, which can be cast as a nonsmooth and nonconvex optimization problem. We propose two first-order algorithms with adaptive step sizes: the subgradient algorithm (AdaSubGrad) and the inexact proximal linear algorithm (AdaIPL). Our contribution lies in a novel design of adaptive step sizes based on quantiles of the absolute residuals. We analyze local linear convergence of both algorithms across different hyperparameter regimes under i.i.d. centered sub-Gaussian measurements, a stability condition linking the measurement distribution and the corruption level, and an additional uniform small-ball condition. Numerical experiments on synthetic datasets and image recovery also demonstrate that our methods are competitive with existing methods in the literature that utilize predetermined (possibly impractical) step sizes, such as subgradient methods and the inexact proximal linear method.

math.OC↗
arXiv2026

A Simple yet Highly Accurate Prediction-Correction Algorithm for Time-Varying Optimization

This paper proposes a simple yet highly accurate prediction-correction algorithm, SHARP, for unconstrained time-varying optimization problems. Its prediction is based on an extrapolation derived from the Lagrange interpolation of past solutions. Since this extrapolation can be computed without Hessian matrices or even gradients, the computational cost is low. To ensure the stability of the prediction, the algorithm includes an acceptance condition that rejects the prediction when the update is excessively large. The proposed method achieves a tracking error of $O(h^{p})$, where $h$ is the sampling period, assuming that the $p$-th derivative of the target trajectory is bounded and the convergence of the correction step is locally linear. We also prove that the method can track a trajectory of stationary points even if the objective function is non-convex. Numerical experiments demonstrate the high accuracy of the proposed algorithm.

math.OC↗