Searcharxiv⌕ Search

arXiv subjects

Jian-Guo Liu

Publications and source records attributed to Jian-Guo Liu.

At least 109 records · Page 6Linked to original sources

Large time behaviors of upwind schemes by jump processes

We revisit the traditional upwind schemes for linear conservation laws in the viewpoint of jump processes, allowing studying upwind schemes using probabilistic tools. In particular, for Fokker-Planck equations on $\mathbb{R}$, in the case of weak confinement, we show that the solution of upwind scheme converges to a stationary solution. In the case of strong confinement, using a discrete Poincaré inequality, we prove that the $O(h)$ numeric error under $\ell^1$ norm is uniform in time, and establish the uniform exponential convergence to the steady states. Compared with the traditional results of exponential convergence of upwind schemes, our result is in the whole space without boundary. We also establish similar results on torus for which the stationary solution of the scheme does not have detailed balance. This work shows an interesting connection between standard numerical methods and time continuous Markov chains, and could motivate better understanding of numerical analysis for conservation laws.

math.NA↗

Some compactness criteria for weak solutions of time fractional PDEs

The Aubin-Lions lemma and its variants play crucial roles for the existence of weak solutions of nonlinear evolutionary PDEs. In this paper, we aim to develop some compactness criteria that are analogies of the Aubin--Lions lemma for the existence of weak solutions to time fractional PDEs. We first define the weak Caputo derivatives of order $γ\in (0,1)$ for functions valued in general Banach spaces, consistent with the traditional definition if the space is $\mathbb{R}^d$ and functions are absolutely continuous. Based on a Volterra type integral form, we establish some time regularity estimates of the functions provided that the weak Caputo derivatives are in certain spaces. The compactness criteria are then established using the time regularity estimates. The existence of weak solutions for a special case of time fractional compressible Navier-Stokes equations with constant density and time fractional Keller-Segel equations in $\mathbb{R}^2$ are then proved as model problems. This work provides a framework for studying weak solutions of nonlinear time fractional PDEs.

math.FA↗

Gradient flow approach to an exponential thin film equation: global existence and latent singularity

In this work, we study a fourth order exponential equation, $u_t=Δe^{-Δu},$ derived from thin film growth on crystal surface in multiple space dimensions. We use the gradient flow method in metric space to characterize the latent singularity in global strong solution, which is intrinsic due to high degeneration. We define a suitable functional, which reveals where the singularity happens, and then prove the variational inequality solution under very weak assumptions for initial data. Moreover, the existence of global strong solution is established with regular initial data.

math.AP↗

A vicinal surface model for epitaxial growth with logarithmic free energy

We study a continuum model for solid films that arises from the modeling of one-dimensional step flows on a vicinal surface in the attachment-detachment-limited regime. The resulting nonlinear partial differential equation, $u_t = -u^2(u^3+αu)_{hhhh}$, gives the evolution for the surface slope $u$ as a function of the local height $h$ in a monotone step train. Subject to periodic boundary conditions and positive initial conditions, we prove the existence, uniqueness and positivity of global strong solutions to this PDE using two Lyapunov energy functions. The long time behavior of $u$ converging to a constant that only depends on the initial data is also investigated both analytically and numerically.

math.AP↗

A generalized definition of Caputo derivatives and its application to fractional ODEs

We extend in this paper the definition of Caputo derivatives of order in $(0,1)$ to a certain class of locally integrable functions using a convolution group. Our strategy is to define a fractional calculus for a certain class of distributions using the convolution group. When acting on causal functions, this fractional calculus agrees with the traditional Riemann-Liouville definition for $t>0$ but includes some singularities at $t=0$ so that the group property holds. Then, making use of this fractional calculus, we introduce the generalized definition of Caputo derivatives. The new definition is consistent with various definitions in literature while reveals the underlying group structure. Since the new definition is valid for a class of locally integrable functions that can blow up in finite time, it provides a framework for solutions to fractional ODEs and fractional PDEs with very weak conditions. The underlying group property makes many properties of Caputo derivatives natural. In particular, it allows us to de-convolve the fractional differential equations to integral equations with completely monotone kernels, which then enables us to prove the general Grönwall inequality (or comparison principle) with the most general conditions. This then provides the essential tools for {\it a priori} energy estimates of fractional PDEs. Some other fundamental results for fractional ODEs are also established within this frame under very weak conditions.

math.CA↗

Data clustering based on Langevin annealing with a self-consistent potential

This paper introduces a novel data clustering algorithm based on Langevin dynamics, where the associated potential is constructed directly from the data. To introduce a self-consistent potential, we adopt the potential model from the established Quantum Clustering method. The first step is to use a radial basis function to construct a density distribution from the data. A potential function is then constructed such that this density distribution is the ground state solution to the time-independent Schrodinger equation. The second step is to use this potential function with the Langevin dynamics at sub-critical temperature to avoid ergodicity. The Langevin equations take a classical Gibbs distribution as the invariant measure, where the peaks of the distribution coincide with minima of the potential surface. The time dynamics of individual data points lead to different metastable states, which are interpreted as cluster centers. Clustering is therefore achieved when subsets of the data aggregate - as a result of the Langevin dynamics for a moderate period of time - in the neighborhood of a particular potential minimum. While the data points are pushed towards potential minima by the potential gradient, Brownian motion allows them to effectively tunnel through local potential barriers and escape saddle points into locations of the potential surface otherwise forbidden. The algorithm's feasibility is first established based on several illustrating examples and theoretical analyses, followed by a stricter evaluation using a standard benchmark dataset.

physics.comp-ph↗

Least action principles for incompressible flows and geodesics between shapes

As V. I. Arnold observed in the 1960s, the Euler equations of incompressible fluid flow correspond formally to geodesic equations in a group of volume-preserving diffeomorphisms. Working in an Eulerian framework, we study incompressible flows of shapes as critical paths for action (kinetic energy) along transport paths constrained to have characteristic-function densities. The formal geodesic equations for this problem are Euler equations for incompressible, inviscid potential flow of fluid with zero pressure and surface tension on the free boundary. The problem of minimizing this action exhibits an instability associated with microdroplet formation, with the following outcomes: Any two shapes of equal volume can be approximately connected by an Euler spray---a countable superposition of ellipsoidal geodesics. The infimum of the action is the Wasserstein distance squared, and is almost never attained except in dimension 1. Every Wasserstein geodesic between bounded densities of compact support provides a solution of the (compressible) pressureless Euler system that is a weak limit of (incompressible) Euler sprays. Each such Wasserstein geodesic is also the unique minimizer of a relaxed least-action principle for a two-fluid mixture theory corresponding to incompressible fluid mixed with vacuum.

math.AP↗

Online learning in optical tomography: a stochastic approach

We study the inverse problem of radiative transfer equation (RTE) using stochastic gradient descent method (SGD) in this paper. Mathematically, optical tomography amounts to recovering the optical parameters in RTE using the incoming-outgoing pair of light intensity. We formulate it as a PDE-constraint optimization problem, where the mismatch of computed and measured outgoing data is minimized with same initial data and RTE constraint. The memory and computation cost it requires, however, is typically prohibitive, especially in high dimensional space. Smart iterative solvers that only use partial information in each step is called for thereafter. Stochastic gradient descent method is an online learning algorithm that randomly selects data for minimizing the mismatch. It requires minimum memory and computation, and advances fast, therefore perfectly serves the purpose. In this paper we formulate the problem, in both nonlinear and its linearized setting, apply SGD algorithm and analyze the convergence performance.

math.OC↗

Global stability for solutions to the exponential PDE describing epitaxial growth

In this paper we prove the global existence, uniqueness, optimal large time decay rates, and uniform gain of analyticity for the exponential PDE $h_t=Δe^{-Δh}$ in the whole space $\mathbb{R}^d_x$. We assume the initial data is of medium size in the critical Wiener algebra $Δh \in A(\mathbb{R}^d)$. This exponential PDE was derived in (Krug, Dobbs, and Majaniemi in 1995) and more recently in (Marzuola and Weare 2013).

math.AP↗

A note on one-dimensional time fractional ODEs

In this note, we prove or re-prove several important results regarding one dimensional time fractional ODEs following our previous work \cite{fllx17}. Here we use the definition of Caputo derivative proposed in \cite{liliu17frac1,liliu2017} based on a convolution group. In particular, we establish generalized comparison principles consistent with the new definition of Caputo derivatives. In addition, we establish the full asymptotic behaviors of the solutions for $D_c^γu=Au^p$. Lastly, we provide a simplified proof for the strict monotonicity and stability in initial values for the time fractional differential equations with weak assumptions.

math.CA↗

Cauchy problems for Keller-Segel type time-space fractional diffusion equation

This paper investigates Cauchy problems for nonlinear fractional time-space generalized Keller-Segel equation $^c_0D_t^βρ+(-\triangle)^{\fracα{2}}ρ+\nabla\cdot(ρB(ρ))=0$, where Caputo derivative $^c_0D_t^βρ$ models memory effects in time, fractional Laplacian $(-\triangle)^{\fracα{2}}ρ$ represents Lévy diffusion and $B(ρ)=-s_{n,γ}\int_{R^n}\frac{x-y}{|x-y|^{n-γ+2}}ρ(y)dy $ is the general potential with a singular kernel which takes into account the long rang interaction. We first establish $L^r-L^q$ estimates and weighted estimates of the fundamental solutions $(P(x,t), Y(x,t))$ (or equivalently, the solution operators $(S_α^β(t), T_α^β(t))$). Then, we prove the existence and uniqueness of the mild solutions when initial data are in $L^p$ spaces, or the weighted spaces. Similar to Keller-Segel equations, if the initial data are small in critical space $L^{p_c}(\mathbb{R}^n)$ ($p_c=\frac{n}{α+γ-2}$), we construct the global existence. Furthermore, we prove the $L^1$ integrability and integral preservation when the initial data are in $L^1(\mathbb{R}^n)\cap L^p(\mathbb{R}^n)$ or $L^1(\mathbb{R}^n)\cap L^{p_c}(\mathbb{R}^n)$. Finally, some important properties of the mild solutions including the nonnegativity preservation, mass conservation and blowup behaviors are established.

math.AP↗

Maximal monotone operator theory and its applications to thin film equation in epitaxial growth on vicinal surface

In this work we consider $$ w_t=[(w_{hh}+c_0)^{-3}]_{hh},\qquad w(0)=w^0, $$ which is derived from a thin film equation for epitaxial growth on vicinal surface. We formulate the problem as the gradient flow of a suitably-defined convex functional in a non-reflexive space. Then by restricting it to a Hilbert space and proving the uniqueness of its sub-differential, we can apply the classical maximal monotone operator theory. The mathematical difficulty is due to the fact that $w_{hh}$ can appear as a positive Radon measure. We prove the existence of a global strong solution. In particular, the equation holds almost everywhere when $w_{hh}$ is replaced by its absolutely continuous part.

math.AP↗

On the diffusion approximation of nonconvex stochastic gradient descent

We study the Stochastic Gradient Descent (SGD) method in nonconvex optimization problems from the point of view of approximating diffusion processes. We prove rigorously that the diffusion process can approximate the SGD algorithm weakly using the weak form of master equation for probability evolution. In the small step size regime and the presence of omnidirectional noise, our weak approximating diffusion process suggests the following dynamics for the SGD iteration starting from a local minimizer (resp.~saddle point): it escapes in a number of iterations exponentially (resp.~almost linearly) dependent on the inverse stepsize. The results are obtained using the theory for random perturbations of dynamical systems (theory of large deviations for local minimizers and theory of exiting for unstable stationary points). In addition, we discuss the effects of batch size for the deep neural networks, and we find that small batch size is helpful for SGD algorithms to escape unstable stationary points and sharp minimizers. Our theory indicates that one should increase the batch size at later stage for the SGD to be trapped in flat minimizers for better generalization.

stat.ML↗

Analysis and computation of some tumor growth models with nutrient: from cell density models to free boundary dynamics

In this paper, we study the tumor growth equation along with various models for the nutrient component, including the \emph{in vitro} model and the \emph{in vivo} model. At the cell density level, the spatial availability of the tumor density $n$ is governed by the Darcy law via the pressure $p(n)=n^γ$. For finite $γ$, we prove some a priori estimates of the tumor growth model, such as boundedness of the nutrient density, and non-negativity and growth estimate of the tumor density. As $γ\rightarrow \infty$, the cell density models formally converge to Hele-Shaw flow models, which determine the free boundary dynamics of the tumor tissue in the incompressible limit. We derive several analytical solutions to the Hele-Shaw flow models, which serve as benchmark solutions to the geometric motion of tumor front propagation. Finally, we apply a conservative and positivity preserving numerical scheme to the cell density models, with numerical results verifying the link between cell density models and the free boundary dynamical models.

math.AP↗

Semi-groups of stochastic gradient descent and online principal component analysis: properties and diffusion approximations

We study the Markov semigroups for two important algorithms from machine learning: stochastic gradient descent (SGD) and online principal component analysis (PCA). We investigate the effects of small jumps on the properties of the semi-groups. Properties including regularity preserving, $L^{\infty}$ contraction are discussed. These semigroups are the dual of the semigroups for evolution of probability, while the latter are $L^{1}$ contracting and positivity preserving. Using these properties, we show that stochastic differential equations (SDEs) in $\mathbb{R}^d$ (on the sphere $\mathbb{S}^{d-1}$) can be used to approximate SGD (online PCA) weakly. These SDEs may be used to provide some insights of the behaviors of these algorithms.

math.PR↗

Partial regularity of weak solutions to a PDE system with cubic nonlinearity

In this paper we investigate regularity properties of weak solutions to a PDE system that arises in the study of biological transport networks. The system consists of a possibly singular elliptic equation for the scalar pressure of the underlying biological network coupled to a diffusion equation for the conductance vector of the network. There are several different types of nonlinearities in the system. Of particular mathematical interest is a term that is a polynomial function of solutions and their partial derivatives and this polynomial function has degree three. That is, the system contains a cubic nonlinearity. Only weak solutions to the system have been shown to exist. The regularity theory for the system remains fundamentally incomplete. In particular, it is not known whether or not weak solutions develop singularities. In this paper we obtain a partial regularity theorem, which gives an estimate for the parabolic Hausdorff dimension of the set of possible singular points.

math.AP↗

On the best constant for Gagliardo-Nirenberg interpolation inequalities

In this paper we derive the best constant for the following Gagliardo-Nirenberg interpolation inequality \begin{eqnarray*} \|u\|_{L^{m+1}}\leq C_{q,m,p} \|u\|^{1-θ}_{L^{q+1}}\|\nabla u\|^θ_{L^p},\quad θ=\frac{pd(m-q)}{(m+1)[d(p-q-1)+p(q+1)]}, \end{eqnarray*} where parameters $q,m,p$ respectively belong to the following two ranges: (i) $p>d\geq 1$, $q\geq0$ and $m=\infty$. That shows $L^{\infty}$-type Gagliardo-Nirenberg interpolation inequality. (ii) $p>\max\{1,\frac{2d}{d+2}\}$, $0\leq q<σ-1$, and $q 0$, $λ>0$ and $x_{0}\in \mathbb{R}^d$. In particular, for the case $m=+\infty$, the generalized Lane-Emden equation becomes a Thomas-Fermi type equation. For $q=0,~m=\infty$ or $d=1$, $u_{c,m}$ are closed form solutions expressed in term of the incomplete Beta functions. Moreover, we show that $u_{c,m}\to u_{c,\infty}$ and $C_{q,m,p}\to C_{q,\infty,p}$ as $m\to +\infty$ for $d=1$.

math.AP↗

$p$-Euler equations and $p$-Navier-Stokes equations

We propose in this work new systems of equations which we call $p$-Euler equations and $p$-Navier-Stokes equations. $p$-Euler equations are derived as the Euler-Lagrange equations for the action represented by the Benamou-Brenier characterization of Wasserstein-$p$ distances, with incompressibility constraint. $p$-Euler equations have similar structures with the usual Euler equations but the `momentum' is the signed ($p-1$)-th power of the velocity. In the 2D case, the $p$-Euler equations have streamfunction-vorticity formulation, where the vorticity is given by the $p$-Laplacian of the streamfunction. By adding diffusion presented by $γ$-Laplacian of the velocity, we obtain what we call $p$-Navier-Stokes equations. If $γ=p$, the {\it a priori} energy estimates for the velocity and momentum have dual symmetries. Using these energy estimates and a time-shift estimate, we show the global existence of weak solutions for the $p$-Navier-Stokes equations in $\mathbb{R}^d$ for $γ=p$ and $p\ge d\ge 2$ through a compactness criterion.

math.AP↗