SearcharxivSearch

arXiv subjects

Mingtao Xia

Publications and source records attributed to Mingtao Xia.

At least 19 recordsLinked to original sources

A Local Sinkhorn Framework for Conditional Distribution Reconstruction of Multidimensional Random Fields

In this paper, we propose a local Sinkhorn divergence framework for conditional distribution reconstruction of multidimensional random fields. By utilizing the debiased Sinkhorn divergence, our proposed approach develops a differentiable and computationally efficient local distribution matching objective to train stochastic neural networks (SNNs). Furthermore, we establish theoretical generalization error estimates for our local Sinkhorn divergence framework, which explicitly characterizes the trade-off between approximation bias and statistical efficiency controlled by the regularization parameter and reveals how our proposed local Sinkhorn divergence loss function can be efficiently applied to learning multidimensional random field models. The proposed framework provides a scalable alternative to exact local optimal transport for conditional distribution reconstruction, offering a practical compromise between geometric fidelity, statistical efficiency, and computational scalability for uncertainty quantification and probabilistic scientific machine learning. Through various numerical examples, we compare our proposed local Sinkhorn divergence framework with other loss functions to train SNNs and with other machine-learning-based uncertainty quantification frameworks, demonstrating that the proposed local Sinkhorn divergence framework achieves an effective balance between reconstruction accuracy and computational efficiency while maintaining good scalability for multidimensional stochastic systems.

cs.LG

Hierarchical RBF-KAN and RBF-SKAN Architectures for Multidimensional Function Approximation and Random Field Learning

In this manuscript, we propose and analyze hierarchical Kolmogorov--Arnold neural network architectures employing radial basis functions as activation functions for approximating deterministic functions and random field models. Specifically, we develop a hierarchical radial-basis-function Kolmogorov--Arnold network (hierarchical RBF-KAN) for multidimensional deterministic function approximation and a hierarchical radial-basis-function stochastic Kolmogorov--Arnold network (hierarchical RBF-SKAN) for random field learning. From a theoretical perspective, we establish universal approximation results for both architectures. In particular, we derive quantitative approximation estimates for the hierarchical RBF-KAN, showing that the proposed framework has the potential to partially alleviate the curse of dimensionality in learning high-dimensional functions by reducing the effective dimensionality of the approximation problem. Furthermore, we show that the hierarchical RBF-SKAN can approximate random field models under the Wasserstein-2 metric. Empirically, we show that our proposed radial-basis-function-based neural network structure could effectively learn multivariate functions and random field models.

cs.LG

An adaptive radial basis function approach for efficiently solving multidimensional spatiotemporal integrodifferential equations

In this work, we propose an adaptive radial basis function (RBF) approach for the efficient solution of multidimensional spatiotemporal integrodifferential equations. Our approach can automatically adjust the shape of RBFs and provide an easy-to-implement and mesh-free approach for solving spatiotemporal equations. Specifically, we analyze how the proposed method mitigates the curse of dimensionality by adaptively adjusting the scales and centers of the radial basis functions when the solution is spatially anisotropic. Through a range of numerical examples, we demonstrate the effectiveness of our approach for solving multidimensional spatiotemporal integrodifferential equations.

math.NA

Efficient reconstruction of multidimensional random field models with heterogeneous data using stochastic neural networks

In this paper, we analyze the scalability of a recent Wasserstein-distance approach for training stochastic neural networks (SNNs) to reconstruct multidimensional random field models. We prove a generalization error bound for reconstructing multidimensional random field models on training stochastic neural networks with a limited number of training data. Our results indicate that when noise is heterogeneous across dimensions, the convergence rate of the generalization error may not depend explicitly on the model's dimensionality, partially alleviating the "curse of dimensionality" for learning multidimensional random field models from a finite number of data points. Additionally, we improve the previous Wasserstein-distance SNN training approach and showcase the robustness of the SNN. Through numerical experiments on different multidimensional uncertainty quantification tasks, we show that our Wasserstein-distance approach can successfully train stochastic neural networks to learn multidimensional uncertainty models.

cs.LG

A generalized Wasserstein-2 distance approach for efficient reconstruction of random field models using stochastic neural networks

In this work, we propose a novel generalized Wasserstein-2 distance approach for efficiently training stochastic neural networks to reconstruct random field models, where the target random variable comprises both continuous and categorical components. We prove that a stochastic neural network can approximate random field models under a Wasserstein-2 distance metric under nonrestrictive conditions. Furthermore, this stochastic neural network can be efficiently trained by minimizing our proposed generalized local squared Wasserstein-2 loss function. We showcase the effectiveness of our proposed approach in various uncertainty quantification tasks, including classification, reconstructing the distribution of mixed random variables, and learning complex noisy dynamical systems from spatiotemporal data.

cs.LG

Reconstructing Noisy Gene Regulation Dynamics Using Extrinsic-Noise-Driven Neural Stochastic Differential Equations

Proper regulation of cell signaling and gene expression is crucial for maintaining cellular function, development, and adaptation to environmental changes. Reaction dynamics in cell populations is often noisy because of (i) inherent stochasticity of intracellular biochemical reactions (``intrinsic noise'') and (ii) heterogeneity of cellular states across different cells that are influenced by external factors (``extrinsic noise''). In this work, we introduce an extrinsic-noise-driven neural stochastic differential equation (END-nSDE) framework that utilizes the Wasserstein distance to accurately reconstruct SDEs from trajectory data from a heterogeneous population of cells (extrinsic noise). We demonstrate the effectiveness of our approach using both simulated and experimental data from three different systems in cell biology: (i) circadian rhythms, (ii) RPA-DNA binding dynamics, and (iii) NF$κ$B signaling process. Our END-nSDE reconstruction method can model how cellular heterogeneity (extrinsic noise) modulates reaction dynamics in the presence of intrinsic noise. It also outperforms existing time-series analysis methods such as recurrent neural networks (RNNs) and long short-term memory networks (LSTMs). By inferring cellular heterogeneities from data, our END-nSDE reconstruction method can reproduce noisy dynamics observed in experiments. In summary, the reconstruction method we propose offers a useful surrogate modeling approach for complex biophysical processes, where high-fidelity mechanistic models may be impractical.

q-bio.QM

A new local time-decoupled squared Wasserstein-2 method for training stochastic neural networks to reconstruct uncertain parameters in dynamical systems

In this work, we propose and analyze a new local time-decoupled squared Wasserstein-2 method for reconstructing the distribution of unknown parameters in dynamical systems. Specifically, we show that a stochastic neural network model, which can be effectively trained by minimizing our proposed local time-decoupled squared Wasserstein-2 loss function, is an effective model for approximating the distribution of uncertain model parameters in dynamical systems. Through several numerical examples, we showcase the effectiveness of our proposed method in reconstructing the distribution of parameters in different dynamical systems.

cs.LG

Solar Wind Structures from the Gaussianity of Magnetic Magnitude

One of the primary science objectives of Parker Solar Probe (PSP) is to determine the structures and dynamics of the plasma and magnetic fields at the sources of the solar wind. However, establishing the connection between {\it in situ} measurements and structures and dynamics in the solar atmosphere is challenging: most of the magnetic footpoint mapping techniques have significant uncertainties in the source localization of a plasma parcel observed {\it in situ}, and the PSP plasma measurements suffer from a limited field of view. Therefore it is of interest to investigate whether {\it in situ} measurements can be used on their own to identify streams originating from the same structures in the corona more finely than the well known fast wind-coronal hole, slow wind-elsewhere distinction. Here we develop a novel time series visualization method \textcolor{red}{(time-frequency representation or TFR)} named Gaussianity Scalogram. Utilizing this method, by analyzing the magnetic magnitude data from both PSP and Ulysses, we successfully identify {\it in situ} structures that are possible remnants of solar atmospheric and magnetic structures spanning more than seven orders of magnitude, from years to seconds, including polar and mid-latitude coronal holes, as well as structures compatible with super-granulation , ``jetlets'' and ``picoflares''. \textcolor{red}{Furthermore, computer simulations of Alfvénic turbulence successfully reproduce the Gaussianization of the magnetic magnitude for locally homogeneous structures.} Building upon these discoveries, the Gaussianity Scalogram can help future studies to reveal the fractal-like fine structures in the solar wind time series from both PSP and decades-old data archive.

physics.space-ph

A local squared Wasserstein-2 method for efficient reconstruction of models with uncertainty

In this paper, we propose a local squared Wasserstein-2 (W_2) method to solve the inverse problem of reconstructing models with uncertain latent variables or parameters. A key advantage of our approach is that it does not require prior information on the distribution of the latent variables or parameters in the underlying models. Instead, our method can efficiently reconstruct the distributions of the output associated with different inputs based on empirical distributions of observation data. We demonstrate the effectiveness of our proposed method across several uncertainty quantification (UQ) tasks, including linear regression with coefficient uncertainty, training neural networks with weight uncertainty, and reconstructing ordinary differential equations (ODEs) with a latent random variable.

stat.ML

An efficient Wasserstein-distance approach for reconstructing jump-diffusion processes using parameterized neural networks

We analyze the Wasserstein distance ($W$-distance) between two probability distributions associated with two multidimensional jump-diffusion processes. Specifically, we analyze a temporally decoupled squared $W_2$-distance, which provides both upper and lower bounds associated with the discrepancies in the drift, diffusion, and jump amplitude functions between the two jump-diffusion processes. Then, we propose a temporally decoupled squared $W_2$-distance method for efficiently reconstructing unknown jump-diffusion processes from data using parameterized neural networks. We further show its performance can be enhanced by utilizing prior information on the drift function of the jump-diffusion process. The effectiveness of our proposed reconstruction method is demonstrated across several examples and applications.

stat.ML

Adaptive Hyperbolic-cross-space Mapped Jacobi Method on Unbounded Domains with Applications to Solving Multidimensional Spatiotemporal Integrodifferential Equations

In this paper, we develop a new adaptive hyperbolic-cross-space mapped Jacobi (AHMJ) method for solving multidimensional spatiotemporal integrodifferential equations in unbounded domains. By devising adaptive techniques for sparse mapped Jacobi spectral expansions defined in a hyperbolic cross space, our proposed AHMJ method can efficiently solve various spatiotemporal integrodifferential equations such as the anomalous diffusion model with reduced numbers of basis functions. Our analysis of the AHMJ method gives a uniform upper error bound for solving a class of spatiotemporal integrodifferential equations, leading to effective error control.

math.NA

Overcompensation of transient and permanent death rate increases in age-structured models with cannibalistic interactions

There has been renewed interest in understanding the mathematical structure of ecological population models that lead to overcompensation, the process by which a population recovers to a higher level after suffering a permanent increase in predation or harvesting. Here, we apply a recently formulated kinetic population theory to formally construct an age-structured single-species population model that includes a cannibalistic interaction in which older individuals prey on younger ones. Depending on the age-dependent structure of this interaction, our model can exhibit transient or steady-state overcompensation of an increased death rate as well as oscillations of the total population, both phenomena that have been observed in ecological systems. Analytic and numerical analysis of our model reveals sufficient conditions for overcompensation and oscillations. We also show how our structured population partial integrodifferential equation (PIDE) model can be reduced to coupled ODE models representing piecewise constant parameter domains, providing additional mathematical insight into the emergence of overcompensation.

q-bio.PE

Kinetic theories of state- and generation-dependent cell populations

We formulate a general, high-dimensional kinetic theory describing the internal state (such as gene expression or protein levels) of cells in a stochastically evolving population. The resolution of our kinetic theory also allows one to track subpopulations associated with each generation. Both intrinsic noise of the cell's internal attribute and randomness in a cell's division times (demographic stochasticity) are fundamental to the development of our model. Based on this general framework, we are able to marginalize the high-dimensional kinetic PDEs in a number of different ways to derive equations that describe the dynamics of marginalized or "macroscopic" quantities such as structured population densities, moments of generation-dependent cellular states, and moments of the total population. We also show how nonlinear "interaction" terms in lower-dimensional integrodifferential equations can arise from high-dimensional linear kinetic models that contain rate parameters of a cell (birth and death rates) that depend on variables associated with other cells, generating couplings in the dynamics. Our analysis provides a general, more complete mathematical framework that resolves the coevolution of cell populations and cell states. The approach may be tailored for studying, e.g., gene expression in developing tissues, or other more general particle systems which exhibit Brownian noise in individual attributes and population-level demographic noise.

q-bio.PE

Squared Wasserstein-2 Distance for Efficient Reconstruction of Stochastic Differential Equations

We provide an analysis of the squared Wasserstein-2 ($W_2$) distance between two probability distributions associated with two stochastic differential equations (SDEs). Based on this analysis, we propose the use of a squared $W_2$ distance-based loss functions in the \textit{reconstruction} of SDEs from noisy data. To demonstrate the practicality of our Wasserstein distance-based loss functions, we performed numerical experiments that demonstrate the efficiency of our method in reconstructing SDEs that arise across a number of applications.

math.PR

A Spectral Approach for Learning Spatiotemporal Neural Differential Equations

Rapidly developing machine learning methods has stimulated research interest in computationally reconstructing differential equations (DEs) from observational data which may provide additional insight into underlying causative mechanisms. In this paper, we propose a novel neural-ODE based method that uses spectral expansions in space to learn spatiotemporal DEs. The major advantage of our spectral neural DE learning approach is that it does not rely on spatial discretization, thus allowing the target spatiotemporal equations to contain long range, nonlocal spatial interactions that act on unbounded spatial domains. Our spectral approach is shown to be as accurate as some of the latest machine learning approaches for learning PDEs operating on bounded domains. By developing a spectral framework for learning both PDEs and integro-differential equations, we extend machine learning methods to apply to unbounded DEs and a larger class of problems.

cs.LG

Spectrally Adapted Physics-Informed Neural Networks for Solving Unbounded Domain Problems

Solving analytically intractable partial differential equations (PDEs) that involve at least one variable defined on an unbounded domain arises in numerous physical applications. Accurately solving unbounded domain PDEs requires efficient numerical methods that can resolve the dependence of the PDE on the unbounded variable over at least several orders of magnitude. We propose a solution to such problems by combining two classes of numerical methods: (i) adaptive spectral methods and (ii) physics-informed neural networks (PINNs). The numerical approach that we develop takes advantage of the ability of physics-informed neural networks to easily implement high-order numerical schemes to efficiently solve PDEs and extrapolate numerical solutions at any point in space and time. We then show how recently introduced adaptive techniques for spectral methods can be integrated into PINN-based PDE solvers to obtain numerical solutions of unbounded domain problems that cannot be efficiently approximated by standard PINNs. Through a number of examples, we demonstrate the advantages of the proposed spectrally adapted PINNs in solving PDEs and estimating model parameters from noisy observations in unbounded domains.

cs.LG

Adaptive Hermite Spectral Methods in Unbounded Domains

Recently, new adaptive techniques were developed that greatly improved the efficiency of solving PDEs using spectral methods. These adaptive spectral techniques are especially suited for accurately solving problems in unbounded domains and require the monitoring and dynamic adjustment of three key tunable parameters: the scaling factor, the displacement of the basis functions, and the spectral expansion order. There have been few analyses of numerical methods for unbounded domain problems. Specifically, there is no analysis of adaptive spectral methods to provide insight into how to increase efficiency and accuracy through dynamical adjustment of parameters. In this paper, we perform the first numerical analysis of the adaptive spectral method using generalized Hermite functions in both one- and multi-dimensional problems. Our analysis reveals why adaptive spectral methods work well when a "frequency indicator" of the numerical solution is controlled. We then investigate how the implementation of the adaptive spectral methods affects numerical results, thereby providing guidelines for the proper tuning of parameters. Finally, we further improve performance by extending the adaptive methods to allow bidirectional basis function translation, and the prospect of carrying out similar numerical analysis to solving PDEs arising from realistic difficult-to-solve unbounded models with adaptive spectral methods is also briefly discussed.

math.NA

Controlling epidemics through optimal allocation of test kits and vaccine doses across networks

Efficient testing and vaccination protocols are critical aspects of epidemic management. To study the optimal allocation of limited testing and vaccination resources in a heterogeneous contact network of interacting susceptible, recovered, and infected individuals, we present a degree-based testing and vaccination model for which we use control-theoretic methods to derive optimal testing and vaccination policies. Within our framework, we find that optimal intervention policies first target high-degree nodes before shifting to lower-degree nodes in a time-dependent manner. Using such optimal policies, it is possible to delay outbreaks and reduce incidence rates to a greater extent than uniform and reinforcement-learning-based interventions, particularly on certain scale-free networks.

q-bio.PE