SearcharxivSearch

arXiv subjects

Guozhi Dong

Publications and source records attributed to Guozhi Dong.

At least 19 recordsLinked to original sources

An FDM-sFEM scheme on time-space manifolds and its superconvergence analysis

We study superconvergent discretization of the Laplace-Beltrami operator on time-space product manifolds with Neumann temporal boundary values, which arise in the context of dynamic optimal transport on general surfaces. We propose a coupled scheme that combines finite difference methods in time with surface finite element methods in space. By establishing a new summation by parts formula and proving the supercloseness of the semi-discrete solution, we derive superconvergence results for the recovered gradient via post-processing techniques. In addition, our geometric error analysis is implemented within a novel framework based on the approximation of the Riemannian metric. Several numerical examples are provided to validate and illustrate the theoretical results.

math.NA

When surface evolution meets Fokker-Planck equation: a novel tangential velocity model for uniform parametrization

A common issue in simulating geometric evolution of surfaces is unexpected clustering of points that may cause numerical instability. We propose a novel artificial tangential velocity method for this matter. The artificial tangential velocity is generated from a surface density field governed by a Fokker-Planck equation to guide the point distribution. A target distribution matching algorithm is developed leveraging the surface Kullback-Leibler divergence of density functions. The numerical method is formulated within a fully meshless framework using the moving least squares approximation, thereby eliminating the need for mesh generation and allowing flexible treatment of unstructured point cloud data. Extensive numerical experiments are conducted to demonstrate the robustness, accuracy, and effectiveness of the proposed approach across a variety of surface evolution problems, including the mean curvature flow.

math.NA

Accelerated gradient flows for large bending deformations of nonlinear plates

In this paper, we propose novel algorithms integrated projection-free techniques with accelerated gradient flows to minimize bending energies for nonlinear plates with non-convex metric constraints. We discuss the stability and constraint consistency in a semi-discrete setting for both bilayer and prestrained plates. The proposed algorithms exhibit substantial improvements in efficiency and accuracy compared to the current state-of-the-art methods based on gradient flows.

math.NA

Dictionary Learning Based Regularization in Quantitative MRI: A Nested Alternating Optimization Framework

In this article, we propose a novel regularization method for a class of nonlinear inverse problems that is inspired by an application in quantitative magnetic resonance imaging (qMRI). The latter is a special instance of a general dynamical image reconstruction technique, wherein a radio-frequency pulse sequence gives rise to a time-discrete physics-based mathematical model which acts as a side constraint in our inverse problem. To enhance reconstruction quality, we employ dictionary learning as a data-adaptive regularizer, capturing complex tissue structures beyond handcrafted priors. For computing a solution of the resulting non-convex and non-smooth optimization problem, we alternate between updating the physical parameters of interest via a Levenberg-Marquardt approach and performing several iterations of a dictionary learning algorithm. This process falls under the category of nested alternating optimization schemes. We develop a general overall algorithmic framework whose convergence theory is not directly available in the literature. Global sub-linear and local strong linear convergence in infinite dimensions under certain regularity conditions for the sub-differentials are investigated based on the Kurdyka-Lojasiewicz inequality. Eventually, numerical experiments demonstrate the practical potential and unresolved challenges of the method.

math.OC

BDF schemes for accelerated gradient flows in projection-free approximation of nonconvex constrained variational minimization

We propose novel algorithms combining accelerated gradient flows with linearized projection-free treatments of non-convex constraints and BDF pseudo-temporal discretization for quadratic energy minimization. A general framework is developed to analyze constraint violations in such projection-free techniques for quadratic constraints. This analysis proves to be universal to all projection-free iterative methods, and constraint error bounds depend solely on iterate regularity. For BDF-k(k=1,2,3,4), we derive both unconditional and conditional high-order constraint violation estimates for accelerated gradient flows using our framework. We further discover a new family of BDF-k accelerated gradient methods achieving modified energy stability for arbitrary positive integer k. Numerical experiments validate our theoretical results and demonstrate superior efficiency and accuracy compared to existing gradient flow approaches.

math.NA

Second-order flows for approaching stationary points of a class of non-convex energies via convex-splitting schemes

This paper contributes to the exploration of a recently introduced computational paradigm known as second-order flows, which are characterized by novel dissipative hyperbolic partial differential equations extending accelerated gradient flows to energy functionals defined on Sobolev spaces, and exhibiting significant performance particularly for the minimization of non-convex energies. Our approach hinges upon convex-splitting schemes, a tool which is not only pivotal for clarifying the well-posedness of second-order flows, but also yields a versatile array of robust numerical schemes through temporal (and spatial) discretization. We prove the convergence to stationary points of such schemes in the semi-discrete setting. Further, we establish their convergence to time-continuous solutions as the timestep tends to zero. Finally, these algorithms undergo thorough testing and validation in approaching stationary points of representative non-convex variational models in scientific computing.

math.NA

Superconvergence of differential structure for finite element methods on perturbed surface meshes

Superconvergence of differential structure on discretized surfaces is studied in this paper. The newly introduced geometric supercloseness provides us with a fundamental tool to prove the superconvergence of gradient recovery on deviated surfaces. An algorithmic framework for gradient recovery without exact geometric information is introduced. Several numerical examples are documented to validate the theoretical results.

math.NA

Discontinuous Galerkin methods for the Laplace-Beltrami operator on point cloud

This paper is dedicated to the development of numerical analysis for high-order methods solving partial differential equations on scattered point clouds. We build a novel geometric error analysis framework by estimating the error in the approximation of the Riemann metric tensor. The innovative framework serves as a fundamental tool for analyzing discontinuous Galerkin methods applied to the Laplace-Beltrami operator on possibly discontinuous geometry. We provide numerical examples on patchy surfaces reconstructed from point clouds to support our theoretical findings.

math.NA

A class of second-order geometric quasilinear hyperbolic PDEs and their application in imaging science

Motivated by important applications in image processing, we study a class of second-order geometric quasilinear hyperbolic partial differential equations (PDEs). This is inspired by the recent development of second-order damping systems associated to gradient flows for energy decaying. In numerical computations, it turns out that the second-order methods are superior to their first-order counter-parts. We concentrate on (i) a damped second-order total variation flow for e.g., image denoising, and (ii) a damped second-order mean curvature flow for level sets of scalar functions. The latter is connected to a non-convex variational model capable of correcting displacement errors in image data (e.g. dejittering). For the former equation, we prove the existence and uniqueness of the solution and its long time behavior, and provide an analytical solution given some simple initial datum. For the latter, we draw a connection between the equation and some second-order geometric PDEs evolving the hypersurfaces, and show the existence and uniqueness of the solution for a regularized version of the equation. Finally, some numerical comparison of the solution behavior for the new equations with first-order flows are presented.

math.AP

Gradient enhanced ADMM Algorithm for dynamic optimal transport on surfaces

A gradient enhanced ADMM algorithm for optimal transport on general surfaces is proposed in this paper. Based on Benamou and Brenier's dynamical formulation, we combine gradient recovery techniques on surfaces with the ADMM algorithm, not only improving the computational accuracy, but also providing a novel method to deal with dual variables in the algorithm. This method avoids the use of stagger grids, has better accuracy and is more robust comparing to other averaging techniques.

math.NA

Data-driven methods for quantitative imaging

In the field of quantitative imaging, the image information at a pixel or voxel in an underlying domain entails crucial information about the imaged matter. This is particularly important in medical imaging applications, such as quantitative Magnetic Resonance Imaging (qMRI), where quantitative maps of biophysical parameters can characterize the imaged tissue and thus lead to more accurate diagnoses. Such quantitative values can also be useful in subsequent, automatized classification tasks in order to discriminate normal from abnormal tissue, for instance. The accurate reconstruction of these quantitative maps is typically achieved by solving two coupled inverse problems which involve a (forward) measurement operator, typically ill-posed, and a physical process that links the wanted quantitative parameters to the reconstructed qualitative image, given some underlying measurement data. In this review, by considering qMRI as a prototypical application, we provide a mathematically-oriented overview on how data-driven approaches can be employed in these inverse problems eventually improving the reconstruction of the associated quantitative maps.

math.OC

Second-order flows for computing the ground states of rotating Bose-Einstein condensates

Second-order flows in this paper refer to some artificial evolutionary differential equations involving second-order time derivatives distinguished from gradient flows which are considered to be first-order flows. This is a popular topic due to the recent advances of inertial dynamics with damping in convex optimization. Mathematically, the ground state of a rotating Bose-Einstein condensate (BEC) can be modeled as a minimizer of the Gross-Pitaevskii energy functional with angular momentum rotational term under the normalization constraint. We introduce two types of second-order flows as energy minimization strategies for this constrained non-convex optimization problem, in order to approach the ground state. The proposed artificial dynamics are novel second-order nonlinear hyperbolic partial differential equations with dissipation. Several numerical discretization schemes are discussed, including explicit and semi-implicit methods for temporal discretization, combined with a Fourier pseudospectral method for spatial discretization. These provide us a series of efficient and robust algorithms for computing the ground states of rotating BECs. Particularly, the newly developed algorithms turn out to be superior to the state-of-the-art numerical methods based on the gradient flow. In comparison with the gradient flow type approaches: When explicit temporal discretization strategies are adopted, the proposed methods allow for larger stable time step sizes; While for semi-implicit discretization, using the same step size, a much smaller number of iterations are needed for the proposed methods to reach the stopping criterion, and every time step encounters almost the same computational complexity. Rich and detailed numerical examples are documented for verification and comparison.

math.NA

First-order conditions for the optimal control of learning-informed nonsmooth PDEs

In this paper we study the optimal control of a class of semilinear elliptic partial differential equations which have nonlinear constituents that are only accessible by data and are approximated by nonsmooth ReLU neural networks. The optimal control problem is studied in detail. In particular, the existence and uniqueness of the state equation are shown, and continuity as well as directional differentiability properties of the corresponding control-to-state map are established. Based on approximation capabilities of the pertinent networks, we address fundamental questions regarding approximating properties of the learning-informed control-to-state map and the solution of the corresponding optimal control problem. Finally, several stationarity conditions are derived based on different notions of generalized differentiability.

math.OC

A descent algorithm for the optimal control of ReLU neural network informed PDEs based on approximate directional derivatives

We propose and analyze a numerical algorithm for solving a class of optimal control problems for learning-informed semilinear partial differential equations. The latter is a class of PDEs with constituents that are in principle unknown and are approximated by nonsmooth ReLU neural networks. We first show that a direct smoothing of the ReLU network with the aim to make use of classical numerical solvers can have certain disadvantages, namely potentially introducing multiple solutions for the corresponding state equation. This motivates us to devise a numerical algorithm that treats directly the nonsmooth optimal control problem, by employing a descent algorithm inspired by a bundle-free method. Several numerical examples are provided and the efficiency of the algorithm is shown.

math.OC

A Parallel Technique for Multi-objective Bayesian Global Optimization: Using a Batch Selection of Probability of Improvement

Bayesian global optimization (BGO) is an efficient surrogate-assisted technique for problems involving expensive evaluations. A parallel technique can be used to parallelly evaluate the true-expensive objective functions in one iteration to boost the execution time. An effective and straightforward approach is to design an acquisition function that can evaluate the performance of a bath of multiple solutions, instead of a single point/solution, in one iteration. This paper proposes five alternatives of \emph{Probability of Improvement} (PoI) with multiple points in a batch (q-PoI) for multi-objective Bayesian global optimization (MOBGO), taking the covariance among multiple points into account. Both exact computational formulas and the Monte Carlo approximation algorithms for all proposed q-PoIs are provided. Based on the distribution of the multiple points relevant to the Pareto-front, the position-dependent behavior of the five q-PoIs is investigated. Moreover, the five q-PoIs are compared with the other nine state-of-the-art and recently proposed batch MOBGO algorithms on twenty bio-objective benchmarks. The empirical experiments on different variety of benchmarks are conducted to demonstrate the effectiveness of two greedy q-PoIs ($\kpoi_{\mbox{best}}$ and $\kpoi_{\mbox{all}}$) on low-dimensional problems and the effectiveness of two explorative q-PoIs ($\kpoi_{\mbox{one}}$ and $\kpoi_{\mbox{worst}}$) on high-dimensional problems with difficult-to-approximate Pareto front boundaries.

cs.AI

Convergence Rates of First and Higher Order Dynamics for Solving Linear Ill-posed Problems

Recently, there has been a great interest in analysing dynamical flows, where the stationary limit is the minimiser of a convex energy. Particular flows of great interest have been continuous limits of Nesterov's algorithm and the Fast Iterative Shrinkage-Thresholding Algorithm (FISTA), respectively. In this paper we approach the solutions of linear ill-posed problems by dynamical flows. Because the squared norm of the residuum of a linear operator equation is a convex functional, the theoretical results from convex analysis for energy minimising flows are applicable. We prove that the proposed flows for minimising the residuum of a linear operator equation are optimal regularisation methods and that they provide optimal convergence rates for the regularised solutions. In particular we show that in comparison to convex analysis results the rates can be significantly higher, which is possible by constraining the investigations to the particular convex energy functional, which is the squared norm of the residuum.

math.OC

Optimization with learning-informed differential equation constraints and its applications

Inspired by applications in optimal control of semilinear elliptic partial differential equations and physics-integrated imaging, differential equation constrained optimization problems with constituents that are only accessible through data-driven techniques are studied. A particular focus is on the analysis and on numerical methods for problems with machine-learned components. For a rather general context, an error analysis is provided, and particular properties resulting from artificial neural network based approximations are addressed. Moreover, for each of the two inspiring applications analytical details are presented and numerical results are provided.

math.OC

Quantitative Magnetic Resonance Imaging: From Fingerprinting to Integrated Physics-Based Models

Quantitative magnetic resonance imaging (qMRI) is concerned with estimating (in physical units) values of magnetic and tissue parameters e.g., relaxation times $T_1$, $T_2$, or proton density $ρ$. Recently in [Ma et al., Nature, 2013], Magnetic Resonance Fingerprinting (MRF) was introduced as a technique being capable of simultaneously recovering such quantitative parameters by using a two step procedure: (i) given a probe, a series of magnetization maps are computed and then (ii) matched to (quantitative) parameters with the help of a pre-computed dictionary which is related to the Bloch manifold. In this paper, we first put MRF and its variants into a perspective with optimization and inverse problems to gain mathematical insights concerning identifiability of parameters under noise and interpretation in terms of optimizers. Motivated by the fact that the Bloch manifold is non-convex and that the accuracy of the MRF-type algorithms is limited by the "discretization size" of the dictionary, a novel physics-based method for qMRI is proposed. In contrast to the conventional two step method, our model is dictionary-free and is rather governed by a single non-linear equation, which is studied analytically. This non-linear equation is efficiently solved via robustified Newton-type methods. The effectiveness of the new method for noisy and undersampled data is shown both analytically and via extensive numerical examples for which also improvement over MRF and its variants is documented.

math.OC