SearcharxivSearch

arXiv subjects

Chunlin Wu

Publications and source records attributed to Chunlin Wu.

At least 19 recordsLinked to original sources

Bimaterial Eshelby's inclusion problem for polyhedra

This paper presents the closed-form Eshelby's tensor for an arbitrarily oriented polyhedral inclusion in a bimaterial domain under general uniform eigenstrain. Existing bimaterial solutions are mainly restricted to special inclusion shapes or dilatational eigenstrains, because the bimaterial Green's function contains two Boussinesq's displacement potentials in addition to the harmonic and biharmonic potentials in Kelvin's solution. This paper derives the missing domain integrals of the two Boussinesq's potentials by reducing the volume integrals to surface and elementary line integrals. The formulae provide the complete elastic and thermoelastic bimaterial Eshelby's tensors, which are verified against analytical solutions for spherical and cuboidal inclusions parallel to the bimaterial interface, and finite element results of an inclined cuboid. Singularity analysis demonstrates that the interface-related contribution remains regular when the inclusion is separated from the bimaterial interface, while additional logarithmic singularities arise when an edge or vertex touches the interface without increasing the dominant singularity order.

math-ph

A Cone-Constrained Bilinear Decomposition for Total Scaled-Gradient Variation Models

The total scaled-gradient variation (TSGV) regularizer, derived from sparse modeling of piecewise-linear structures, has been shown to preserve edges and corners in image restoration. However, its highly nonconvex and nonlinear nature poses severe computational challenges, as existing methods often suffer from parameter sensitivity or lack convergence guarantees. To overcome this, we propose a tailored bilinear decomposition that decouples the nonlinear weighted gradient in the TSGV regularizer. This approach yields an equivalent optimization problem governed by cone or sphere constraints, depending on the chosen scaling function. In particular, the cone constraint plays a central role in characterizing edge- and corner-preserving behavior. We solve this reformulation using the alternating minimization method (AMM) equipped with a majorization--minimization strategy, ensuring a monotonic decrease in energy without step-size tuning. Furthermore, we provide a geometric interpretation of the edge-preserving properties of these constraints by analyzing their asymptotic behavior near image singularities. We establish the global convergence of the proposed method to a critical point within the Kurdyka--{\L}ojasiewicz framework. Extensive numerical experiments on Gaussian denoising and non-line-of-sight (NLOS) imaging show that the proposed method achieves PSNR and SSIM competitive with or superior to representative variational methods, especially at high noise levels, and improves the structural reconstruction under dense and sparse scanning.

cs.CV

From Score Learning to Discretized Sampling: An End-to-End Generalization Analysis of Diffusion Models

Despite the empirical success of score-based diffusion models, a complete theoretical understanding of how finite-sample learning, network parameterization, and numerical discretization jointly dictate generative quality remains underdeveloped. Existing sampling analyses often evaluate the generative performance conditional on an oracle score or a pre-specified error threshold. In this work, we establish a unified convergence and generalization framework for score-based diffusion models parameterized by practical ResNet-type architectures. We analyze the generalization and convergence properties from the practical finite-sample, discrete-time learning problem of the score function to the ideal continuous-time, population-level objective. Based on the generalization result of the learning problem of score function, we analyze the sampling process induced by the learned score function and provide an end-to-end total variation distance estimate for the generated terminal distribution. This estimate explicitly decomposes the overall generative error into four interpretable components: the truncation error of the forward process, the reverse-time discretization error, the generalization error incorporating both finite data and forward-time discretization, and the training optimization gap. Our results quantitatively characterize how the training sample size, temporal discretization grids, and optimization accuracy jointly control the final fidelity of samples generated by diffusion models.

cs.LG

Deep-layer limit and stability analysis of the basic forward-backward-splitting induced network (II): learning problems

Deep unfolding neural networks derived from iterative optimization schemes and numerical ordinary/partial differential equations (ODEs/PDEs) have attracted much attention in data science over the last decade. Therein, numerous important network architectures were constructed from the basic forward-backward-splitting (FBS) algorithm. In this paper, we continue our research on the most basic FBS-induced network, an architecture unrolled from the original FBS algorithm by incorporating direct parameter relaxations. Following the difference/differential inclusion formulations in our previous forward system analyses, we here consider some theoretical aspects of corresponding learning problems. Under some mild assumptions, we establish a general convergence property of the training problem of the basic FBS-induced network to the learning problem of the deep-layer limit system, implying a $\Gamma$-convergence argument showing that any cluster point of the optimal learning parameters for the network is a solution to the learning problem of the deep-layer limit system. A qualitative analysis of perturbation stabilities of these learning problems is also presented. A simple numerical experiment is conducted to validate our main general convergence result.

cs.LG

Nonlocal thermal Willis coupling in laminated conductors

Building on Willis' homogenization framework, recent work has revealed that heterogeneous conductors exhibit macroscopic thermal bianisotropy, in which the macroscopic heat flux and entropy are nonlocally coupled to both temperature and temperature gradient. Existing numerical examples, however, are limited to the subwavelength regime. Here, we provide the first explicit demonstration of this spatial nonlocality by computing the effective kernels of a periodic laminate using three independent homogenization methods. The three approaches yield consistent nonlocal cross-coupling terms, clarifying the roles of spatial asymmetry and averaging choice. We also calculate the corresponding thermal impedance and show that it is direction-dependent, highlighting a physical signature of thermal bianisotropy relevant to thermal metamaterials.

math-ph

On the Generalization Behavior of Deep Residual Networks From a Dynamical System Perspective

Deep neural networks (DNNs) have significantly advanced machine learning, with model depth playing a central role in their successes. The dynamical system modeling approach has recently emerged as a powerful framework, offering new mathematical insights into the structure and learning behavior of DNNs. In this work, we establish generalization error bounds for both discrete- and continuous-time residual networks (ResNets) by combining Rademacher complexity, flow maps of dynamical systems, and the convergence behavior of ResNets in the deep-layer limit. The resulting bounds are of order $O(1/\sqrt{S})$ with respect to the number of training samples $S$, and include a structure-dependent negative term, yielding depth-uniform and asymptotic generalization bounds under milder assumptions. These findings provide a unified understanding of generalization across both discrete- and continuous-time ResNets, helping to close the gap in both the order of sample complexity and assumptions between the discrete- and continuous-time settings.

cs.LG

Transient thermal analysis of a bi-layered composites with the dual-reciprocity inclusion-based boundary element method

This paper proposes a single-domain dual-reciprocity inclusion-based boundary element method (DR-iBEM) for a three-dimensional fully bonded bi-layered composite embedded with ellipsoidal inhomogeneities under transient/harmonic thermal loads. The heat equation is interpreted as a static one containing time- and frequency-dependent nonhomogeneous source terms, which is similar to eigen-fields but is transformed into a boundary integral by the dual-reciprocity method. Using the steady-state bimaterial Green's function, boundary integral equations are proposed to take into account continuity conditions of temperature and heat flux, which avoids setting up any continuity equations at the bimaterial interface. Eigen-temperature-gradients and eigen-heat-source are introduced to simulate the material mismatch in thermal conductivity and heat capacity, respectively. The DR-iBEM algorithm is particularly suitable for investigating the transient and harmonic thermal behaviors of bi-layered composites and is verified by the finite element method (FEM). Numerical comparison with the FEM demonstrates its robustness and accuracy. The method has been applied to a functionally graded material as a bimaterial with graded particle distributions, where particle size and gradation effects are evaluated.

math.NA

Generalized Eshelby's inclusion and inhomogeneity problems for transient heat transfer

Eshelby's inclusion problems have been generalized to arbitrary shape of polygonal, polyhedral, and ellipsoidal inclusions embedded in an infinite isotropic domain under transient heat transfer, and Eshelby's tensors have been analytically derived to evaluate disturbed thermal fields caused by inclusions with a polynomial-form eigen-field. Transformed coordinates are applied to arbitrarily shaped inclusions for domain integrals of transient fundamental solutions. This formulation is for general transient heat transfer, and it can recover classic Eshelby's tensor for the ellipsoidal subdomain with explicit expression for the spherical domain in the steady state, Michelitsch's solution in the harmonic state, and recent solution in the transient state. The formulae for a polyhedral inclusion is verified by comparison to closed-form solutions of a spherical inclusion when the sphere is divided into many polyhedrons. The discontinuity of domain integrals for Eshelby's tensor are investigated the temporal effects are elaborated. The generalized formulation for Eshelby's problems enables the simulation and modeling of particulate composites containing inhomogeneities of various shapes for steady-state, harmonic and transient heat transfer in both two- and three-dimensional space through the equivalent inclusion method.

math-ph

Mathematical Modeling and Convergence Analysis of Deep Neural Networks with Dense Layer Connectivities in Deep Learning

In deep learning, dense layer connectivity has become a key design principle in deep neural networks (DNNs), enabling efficient information flow and strong performance across a range of applications. In this work, we model densely connected DNNs mathematically and analyze their learning problems in the deep-layer limit. For a broad applicability, we present our analysis in a framework setting of DNNs with densely connected layers and general non-local feature transformations (with local feature transformations as special cases) within layers, which is called dense non-local (DNL) framework and includes standard DenseNets and variants as special examples. In this formulation, the densely connected networks are modeled as nonlinear integral equations, in contrast to the ordinary differential equation viewpoint commonly adopted in prior works. We study the associated training problems from an optimal control perspective and prove convergence results from the network learning problem to its continuous-time counterpart. In particular, we show the convergence of optimal values and the subsequence convergence of minimizers, using a piecewise linear extension and $Γ$-convergence analysis. Our results provide a mathematical foundation for understanding densely connected DNNs and further suggest that such architectures can offer stability of training deep models.

cs.LG

Singularities at the vertex of connected angular inhomogeneities under thermal and elastic loading

This paper investigates the singularities at the vertex of multiply connected angular inhomogeneities for heat conduction and elastic deformation. With the aid of Eshelby's equivalent inclusion method (EIM), each inhomogeneity is simulated as an equivalent inclusion, exhibiting the same material properties as the matrix but containing a continuously distributed eigen-field with potential singularities at the vertices and edge lines. Specifically, the eigen-temperature-gradient (ETG) and eigenstrain are utilized to simulate material mismatch of thermal conductivity and stiffness, respectively. Using the separation of variables, the eigen-fields can be formulated in terms of distance to vertices and opening angles, and disturbed thermal/elastic fields are evaluated by domain integrals of Green's function multiplied by eigen-fields, which form Fredholm's integral equation of the second kind. The boundary value problem is reduced to solve for eigenvalues, which are used to determine the order of singularity. The present solution is versatile - by placing two identical inhomogeneities together, it recovers the classic solutions for a single wedge in a bimaterial media or infinite domain. The general and analytical formulae take full consideration of interactions of multiple inhomogeneities and reveal the effects of opening angles and material properties on the thermal and elastic singularities.

math-ph

A fast iterative thresholding and support-and-scale shrinking algorithm (fits3) for non-lipschitz group sparse optimization (i): the case of least-squares fidelity

We consider to design a new efficient and easy-to-implement algorithm to solve a general group sparse optimization model with a class of non-convex non-Lipschitz regularizations, named as fast iterative thresholding and support-and-scale shrinking algorithm (FITS3). In this paper we focus on the case of a least-squares fidelity. FITS3 is designed from a lower bound theory of such models and by integrating thresholding operation, linearization and extrapolation techniques. The FITS3 has two advantages. Firstly, it is quite efficient and especially suitable for large-scale problems, because it adopts support-and-scale shrinking and does not need to solve any linear or nonlinear system. For two important special cases, the FITS3 contains only simple calculations like matrix-vector multiplication and soft thresholding. Secondly, the FITS3 algorithm has a sequence convergence guarantee under proper assumptions. The numerical experiments and comparisons to recent existing non-Lipschitz group recovery algorithms demonstrate that, the proposed FITS3 achieves similar recovery accuracies, but costs only around a half of the CPU time by the second fastest compared algorithm for median or large-scale problems.

math.OC

$\ell_1$DecNet+: A new architecture framework by $\ell_1$ decomposition and iteration unfolding for sparse feature segmentation

$\ell_1$ based sparse regularization plays a central role in compressive sensing and image processing. In this paper, we propose $\ell_1$DecNet, as an unfolded network derived from a variational decomposition model incorporating $\ell_1$ related sparse regularization and solved by scaled alternating direction method of multipliers (ADMM). $\ell_1$DecNet effectively decomposes an input image into a sparse feature and a learned dense feature, and thus helps the subsequent sparse feature related operations. Based on this, we develop $\ell_1$DecNet+, a learnable architecture framework consisting of our $\ell_1$DecNet and a segmentation module which operates over extracted sparse features instead of original images. This architecture combines well the benefits of mathematical modeling and data-driven approaches. To our best knowledge, this is the first study to incorporate mathematical image prior into feature extraction in segmentation network structures. Moreover, our $\ell_1$DecNet+ framework can be easily extended to 3D case. We evaluate the effectiveness of $\ell_1$DecNet+ on two commonly encountered sparse segmentation tasks: retinal vessel segmentation in medical image processing and pavement crack detection in industrial abnormality identification. Experimental results on different datasets demonstrate that, our $\ell_1$DecNet+ architecture with various lightweight segmentation modules can achieve equal or better performance than their enlarged versions respectively. This leads to especially practical advantages on resource-limited devices.

eess.IV

On anisotropic non-Lipschitz restoration model: lower bound theory and convergent algorithm

For nonconvex and nonsmooth restoration models, the lower bound theory reveals their good edge recovery ability, and related analysis can help to design convergent algorithms. Existing such discussions are focused on isotropic regularization models, or only the lower bound theory of anisotropic model with a quadratic fidelity. In this paper, we consider a general image recovery model with a non-Lipschitz anisotropic composite regularization term and an $\ell_q$ norm ($1\leq q<+\infty$) data fidelity term. We establish the lower bound theory for the anisotropic model with an $\ell_1$ fidelity, which applies to impulsive noise removal problems. For the general case with $1\leq q<+\infty$, a support inclusion analysis is provided. To solve this non-Lipschitz composite minimization model, we are then motivated to introduce a support shrinking strategy in the iterative algorithm and relax the support constraint to a thresholding support constraint, which is more computationally practical. The objective function at each iteration is also linearized to construct a strongly convex subproblem. To make the algorithm more implementable, we compute an approximation solution to this subproblem at each iteration, but not exactly solve it. The global convergence result of the proposed inexact iterative thresholding and support shrinking algorithm with proximal linearization is established. The experiments on image restoration and two stage image segmentation demonstrate the effectiveness of the proposed algorithm.

math.NA

A fast method for simultaneous reconstruction and segmentation in X-ray CT application

In this paper, we propose a fast method for simultaneous reconstruction and segmentation (SRS) in X-ray computed tomography (CT). Our work is based on the SRS model where Bayes' rule and the maximum a posteriori (MAP) are used on hidden Markov measure field model (HMMFM). The original method leads to a logarithmic-summation (log-sum) term, which is non-separable to the classification index. The minimization problem in the model was solved by using constrained gradient descend method, Frank-Wolfe algorithm, which is very time-consuming especially when dealing with large-scale CT problems. The starting point of this paper is the commutativity of log-sum operations, where the log-sum problem could be transformed into a sum-log problem by introducing an auxiliary variable. The corresponding sum-log problem for the SRS model is separable. After applying alternating minimization method, this problem turns into several easy-to-solve convex sub-problems. In the paper, we also study an improved model by adding Tikhonov regularization, and give some convergence results. Experimental results demonstrate that the proposed algorithms could produce comparable results with the original SRS method with much less CPU time.

cs.CV

Effective two-stage image segmentation: a new non-Lipschitz decomposition approach with convergent algorithm

Image segmentation is an important median level vision topic. Accurate and efficient multiphase segmentation for images with intensity inhomogeneity is still a great challenge. We present a new two-stage multiphase segmentation method trying to tackle this, where the key is to compute an inhomogeneity-free approximate image. For this, we propose to use a new non-Lipschitz variational decomposition model in the first stage. The minimization problem is solved by an iterative support shrinking algorithm, with a global convergence guarantee and a lower bound theory of the image gradient of the iterative sequence. The latter indicates that the generated approximate image (inhomogeneity-corrected component) is with very neat edges and suitable for the following thresholding operation. In the second stage, the segmentation is done by applying a widely-used simple thresholding technique to the piecewise constant approximation. Numerical experiments indicate good convergence properties and effectiveness of our method in multiphase segmentation for either clean or noisy homogeneous and inhomogeneous images. Both visual and quantitative comparisons with some state-of-the-art approaches demonstrate the performance advantages of our non-Lipschitz based method.

math.OC

Every critical point of an L0 composite minimization problem is a local minimizer

Nowadays, L0 optimization model has shown its superiority when pursuing sparsity in many areas. For this nonconvex problem, most of the algorithms can only converge to one of its critical points. In this paper, we consider a general L0 regularized minimization problem, where the L0 ''norm'' is composited with a continuous map. Under some mild assumptions, we show that every critical point of this problem is a local minimizer, which improves the convergence results of existing algorithms. Surprisingly, this conclusion does not hold for low rank minimization, a natural matrix extension of L0 ''norm'' of a vector.

math.OC

An iterative support shrinking algorithm for $\ell_{p}$-$\ell_{q}$ minimization

We present an iterative support shrinking algorithm for $\ell_{p}$-$\ell_{q}$ minimization~($0 <p < 1 \leq q < \infty $). This algorithm guarantees the nonexpensiveness of the signal support set and can be easily implemented after being proximally linearized. The subproblem can be very efficiently solved due to its convexity and reducing size along iteration. We prove that the iterates of the algorithm globally converge to a stationary point of the $\ell_{p}$-$\ell_{q}$ objective function. In addition, we show a lower bound theory for the iteration sequence, which is more practical than the lower bound results for local minimizers in the literature.

math.NA