SearcharxivSearch

arXiv subjects

Koichi Taniguchi

Publications and source records attributed to Koichi Taniguchi.

At least 19 recordsLinked to original sources

Generalization Error Bounds for Picard-Type Operator Learning in Nonlinear Parabolic PDEs

Operator learning for partial differential equations (PDEs) aims to learn solution operators on infinite-dimensional function spaces from finite-resolution data. In this setting, it is important for the learned model to be discretization-invariant, or resolution-robust, and to reflect PDE-specific structure. It is therefore natural to ask how such structure should be encoded in the model architecture, hypothesis class, or learning procedure. In this paper, we study operator learning for solution operators of nonlinear parabolic PDEs based on Duhamel--Picard iteration. We formulate Picard iteration as an abstract state-transition model and present a theoretical framework for Picard-type operator learning. We derive implementation-agnostic generalization error bounds that separate the implementation error from the estimation error associated with the abstract state-transition model induced by Picard iteration. A key consequence is that increasing the Picard depth reduces the Picard truncation error without causing an unbounded growth of the entropy-based estimation error. We also extend the analysis to long-time prediction by rolling out the same learned local model over successive time blocks. Finally, we illustrate the theory for nonlinear heat equations on the torus using a Picard-type Fourier neural operator as a concrete implementation.

cs.LG

Asymptotically self-similar global solutions for Hardy-H\'enon parabolic equations

We construct asymptotically self-similar global solutions to the Hardy-H\'enon parabolic equation $\partial_t u - \Delta u = \pm |x|^{\gamma} |u|^{\alpha-1} u$, $\alpha>1$, $\gamma \in \mathbb{R}$ for a large class of initial data belonging to weighted Lorentz spaces. The solution may be asymptotic to a self-similar solution of the linear heat equation or to a self-similar solution to the Hardy-H\'enon parabolic equation depending on the speed of decay of the initial data at infinity. The asymptotic results are new for the H\'enon case $\gamma>0$. We also prove the stability of the asymptotic profiles. Our approach applies for $\gamma> -\min(2,d)$ and unifies the cases $\gamma>0$, $\gamma=0$ and $-\min(2,d)<\gamma<0$. For complex-valued initial data, a more intricate asymptotic behaviors can be shown; if either one of the real part or the imaginary part of the initial data has a faster spatial decay, then the solution exhibits a combined Nonlinear-"Modified Linear" asymptotic behavior, which is completely new even for the Fujita case $\gamma=0$. In Appendix, we show the non-existence of local positive solutions for supercritical initial data.

math.AP

Quantitative Approximation for Neural Operators in Nonlinear Parabolic Equations

Neural operators serve as universal approximators for general continuous operators. In this paper, we derive the approximation rate of solution operators for the nonlinear parabolic partial differential equations (PDEs), contributing to the quantitative approximation theorem for solution operators of nonlinear PDEs. Our results show that neural operators can efficiently approximate these solution operators without the exponential growth in model complexity, thus strengthening the theoretical foundation of neural operators. A key insight in our proof is to transfer PDEs into the corresponding integral equations via Duahamel's principle, and to leverage the similarity between neural operators and Picard's iteration, a classical algorithm for solving PDEs. This approach is potentially generalizable beyond parabolic PDEs to a range of other equations, including the Navier-Stokes equation, nonlinear Schr\"odinger equations and nonlinear wave equations, which can be solved by Picard's iteration.

cs.LG

Reservoir computing with the Kuramoto model

Reservoir computing aims to achieve high-performance and low-cost machine learning with a dynamical system as a reservoir. However, in general, there are almost no theoretical guidelines for its high-performance or optimality. Therefore, this paper aims to propose the new concept {\it the edge of bifurcation} for designing a high-performance reservoir, and provide a mathematical justification for it. This concept is a generalization of the famous criterion {\it the edge of chaos}. For this purpose, this paper focuses on the reservoir computing with the Kuramoto model and theoretically reveals its approximation ability. The main result provides an explicit expression of the dynamics of the Kuramoto reservoir by using the order parameters. Thus, the output of the reservoir computing is expressed as a linear combination of the order parameters. As a corollary, sufficient conditions on hyperparameters are obtained so that the set of the order parameters gives the complete basis of the Lebesgue space. This implies that the Kuramoto reservoir has a universal approximation property. Furthermore, the edge of bifurcation is also discussed from the viewpoint of its approximation ability. It is numerically demonstrated by prediction tasks.

math.DS

Endpoint Strichartz estimates for the Schrödinger equation on an exterior domain

The purpose in this paper is to prove end point Strichartz estimates for the Schrödinger equation in the exterior domain of a generic non-trapping obstacle in the case $n \geq 3.$ In the case $n=2$ we have the same range of Strichartz estimates as in the free case. In this version we corrected some misprints from the previous one.

math.AP

Unconditional uniqueness and non-uniqueness for Hardy-Hénon parabolic equations

We study the problems of uniqueness for Hardy-Hénon parabolic equations, which are semilinear heat equations with the singular potential (Hardy type) or the increasing potential (Hénon type) in the nonlinear term. To deal with the Hardy-Hénon type nonlinearities, we employ weighted Lorentz spaces as solution spaces. We prove unconditional uniqueness and non-uniqueness, and we establish uniqueness criterion for Hardy-Hénon parabolic equations in the weighted Lorentz spaces. The results extend the previous works on the Fujita equation and Hardy equations in Lebesgue spaces.

math.AP

Weighted Trudinger-Moser inequalities in the subcritical Sobolev spaces and their applications

We study boundedness, optimality and attainability of Trudinger-Moser type maximization problems in the radial and the subcritical homogeneous Sobolev spaces $\dot{W}^{1,p}_{0, \text{rad}}(B_R^N)\,(p<N)$. Our results give a revision of an error in \cite[Theorem C]{HL}. Also, our inequality converges to the original Trudinger-Moser inequality as $p \nearrow N$ including optimal exponent and concentration limit. Finally, we consider an application of our inequality to elliptic problems with exponential nonlinearity.

math.AP

Global existence and asymptotic behavior for semilinear damped wave equations on measure spaces

This paper is concerned with the semilinear damped wave equation on a measure space with a self-adjoint operator, instead of the standard Laplace operator. Under a certain decay estimate on the corresponding heat semigroup, we establish the linear estimates which generalize the so-called Matsumura estimates, and prove the small data global existence of solutions to the damped wave equation based on the linear estimates. Our approach is based on a direct spectral analysis analogous to the Fourier analysis. The self-adjoint operators treated in this paper include some important examples such as the Laplace operators on Euclidean spaces, the Dirichlet Laplacian on an arbitrary open set, the Robin Laplacian on an exterior domain, the Schrödinger operator, the elliptic operator, the Laplacian on Sierpinski gasket, and the fractional Laplacian.

math.AP

Lifespan estimates for semilinear damped wave equation in a two-dimensional exterior domain

Lifespan estimates for semilinear damped wave equations of the form $\partial_t^2u-Δu+\partial_tu=|u|^p$ in a two dimensional exterior domain endowed with the Dirichlet boundary condition are dealt with. For the critical case of the semilinear heat equation $\partial_tv-Δv=v^2$ with the Dirichlet boundary condition and the initial condition $v(0)=\varepsilon f$, the corresponding lifespan can be estimated from below and above by $\exp(\exp(C\varepsilon^{-1}))$ with different constants $C$. This paper clarifies that the same estimates hold even for the critical semilinear damped wave equation in the exterior of the unit ball under the restriction of radial symmetry. To achieve this result, a new technique to control $L^1$-type norm and a new Gagliardo--Nirenberg type estimate with logarithmic weight are introduced.

math.AP

Boundedness of composition operators on higher order Besov spaces in one dimension

This paper aims to characterize boundedness of composition operators on Besov spaces $B^s_{p,q}$ of higher order derivatives $s>1+1/p$ on the one-dimensional Euclidean space. In contrast to the lower order case $0 1$. We prove a relation between the composition operators and pointwise multipliers of Besov spaces, and effectively use the characterizations of the pointwise multipliers. As a result, we obtain necessary and sufficient conditions for the boundedness of composition operators for general $p$, $q$, and $s$ such that $1 1+1/p$. In this paper, we treat, as a map that induces the composition operator, not only a homeomorphism on the real line but also a continuous map whose number of elements of inverse images at any one point is bounded above. We also show a similar characterization of the boundedness of composition operators on Sobolev spaces.

math.FA

Theoretical Error Analysis of Entropy Approximation for Gaussian Mixtures

Gaussian mixture distributions are commonly employed to represent general probability distributions. Despite the importance of using Gaussian mixtures for uncertainty estimation, the entropy of a Gaussian mixture cannot be calculated analytically. In this paper, we study the approximate entropy represented as the sum of the entropies of unimodal Gaussian distributions with mixing coefficients. This approximation is easy to calculate analytically regardless of dimension, but there is a lack of theoretical guarantees. We theoretically analyze the approximation error between the true and the approximate entropy to reveal when this approximation works effectively. This error is essentially controlled by how far apart each Gaussian component of the Gaussian mixture is. To measure such separation, we introduce the ratios of the distances between the means to the sum of the variances of each Gaussian component of the Gaussian mixture, and we reveal that the error converges to zero as the ratios tend to infinity. In addition, the probabilistic estimate indicates that this convergence situation is more likely to occur in higher-dimensional spaces. Therefore, our results provide a guarantee that this approximation works well for high-dimensional problems, such as neural networks that involve a large number of parameters.

stat.ML

Spectral Pruning for Recurrent Neural Networks

Recurrent neural networks (RNNs) are a class of neural networks used in sequential tasks. However, in general, RNNs have a large number of parameters and involve enormous computational costs by repeating the recurrent structures in many time steps. As a method to overcome this difficulty, RNN pruning has attracted increasing attention in recent years, and it brings us benefits in terms of the reduction of computational cost as the time step progresses. However, most existing methods of RNN pruning are heuristic. The purpose of this paper is to study the theoretical scheme for RNN pruning method. We propose an appropriate pruning algorithm for RNNs inspired by "spectral pruning", and provide the generalization error bounds for compressed RNNs. We also provide numerical experiments to demonstrate our theoretical results and show the effectiveness of our pruning method compared with existing methods.

stat.ML

Well-posedness and global dynamics for the critical Hardy-Sobolev parabolic equation

We study the Cauchy problem for the semilinear heat equation with the singular potential, called the Hardy-Sobolev parabolic equation, in the energy space. The aim of this paper is to determine a necessary and sufficient condition on initial data below or at the ground state, under which the behavior of solutions is completely dichotomized. More precisely, the solution exists globally in time and its energy decays to zero in time, or it blows up in finite or infinite time. The result on the dichotomy for the corresponding Dirichlet problem is also shown as a by-product via comparison principle.

math.AP

Optimal well-posedness and forward self-similar solution for the Hardy-Hénon parabolic equation in critical weighted Lebesgue spaces

The Cauchy problem for the Hardy-Hénon parabolic equation is studied in the critical and subcritical regime in weighted Lebesgue spaces on the Euclidean space $\mathbb{R}^d$. Well-posedness for singular initial data and existence of non-radial forward self-similar solution of the problem are previously shown only for the Hardy and Fujita cases ($γ\le 0$) in earlier works. The weighted spaces enable us to treat the potential $|x|^γ$ as an increase or decrease of the weight, thereby we can prove well-posedness to the problem for all $γ$ with $-\min\{2,d\}<γ$ including the Hénon case ($γ>0$). As a byproduct of the well-posedness, the self-similar solutions to the problem are also constructed for all $γ$ without restrictions. A non-existence result of local solution for supercritical data is also shown. Therefore our critical exponent $s_c$ turns out to be optimal in regards to the solvability.

math.AP

Global well-posedness, dissipation and blow up for semilinear heat equations in energy spaces associated with self-adjoint operators

The purpose in this paper is to determine the global behavior of solutions to the initial-boundary value problems for energy-subcritical and critical semilinear heat equations by initial data with lower energy than the mountain pass level in energy spaces associated with self-adjoint operators satisfying Gaussian upper bounds. Our self-adjoint operators include the Dirichlet Laplacian on an open set, Robin Laplacian on an exterior domain, and Schrödinger operators, etc.

math.AP

Bilinear estimates in Besov spaces generated by the Dirichlet Laplacian

The purpose of this paper is to establish bilinear estimates in Besov spaces generated by the Dirichlet Laplacian on a domain of Euclidian spaces. These estimates are proved by using the gradient estimates for heat semigroup together with the Bony paraproduct formula and the boundedness of spectral multipliers.

math.FA

Gradient estimates and their optimality for heat equation in an exterior domain

This paper is devoted to the study of gradient estimates for the Dirichlet problem of the heat equation in the exterior domain of a compact set. Our results describe the time decay rates of the derivatives of solutions to the Dirichlet problem. Applications of these estimates to bilinear type commutator estimates for Laplace operator with Dirichlet boundary condition in exterior domain are discussed too.

math.AP

Besov spaces generated by the Neumann Laplacian

The purpose of this paper is to give a definition and prove the fundamental properties of Besov spaces generated by the Neumann Laplacian. As a by-product of these results, the fractional Leibniz rule in these Besov spaces is obtained.

math.FA