SearcharxivSearch

arXiv subjects

Wuyue Yang

Publications and source records attributed to Wuyue Yang.

12 recordsLinked to original sources

Incorporating Continuous Dependence Qualifies Physics-Informed Neural Networks for Operator Learning

Physics-informed neural networks (PINNs) have been proven as a promising way for solving various partial differential equations, especially high-dimensional ones and those with irregular boundaries. However, their capabilities in real applications are highly restricted by their poor generalization performance. Inspired by the rigorous mathematical statements on the well-posedness of PDEs, we develop a novel extension of PINNs by incorporating the additional information on the continuous dependence of PDE solutions with respect to parameters and initial/boundary values (abbreviated as cd-PINN). Extensive numerical experiments demonstrate that, with limited labeled data, cd-PINN achieves 1-3 orders of magnitude lower in test MSE than DeepONet and FNO. Therefore, incorporating the continuous dependence of PDE solutions provides a simple way for qualifying PINNs for operator learning.

math.DS

Mathematical model of tumor-macrophage interactions: Elucidating the tumor-driven macrophage phenotype reprogramming

The interplay between tumor cells and macrophages plays a central regulatory role in cancer progression. In this study, we developed a mathematical model that incorporates tumor cells, M1 type macrophages, M2 type macrophages and an M3 type macrophage population characterized by dual phenotypic features. First, we analyzed the fundamental mathematical properties of the model and derived the conditions under which the system attains a tumor free stable state or a coexistence state of tumor and immune cells. Second, global sensitivity analysis revealed that key parameters governing macrophage polarization and intercellular communication vary dynamically during tumor development. Bifurcation analysis further identified the polarization rate of M1 type macrophages $\kappa$ and the baseline level of resting macrophages $M_0$ as critical determinants of the system's dynamical behavior. Notably, using approximate Bayesian computation for parameter inference and dynamic simulations, the model successfully recapitulated the evolutionary trajectories of eight tumor samples. The results demonstrate that lower tumor burden is significantly associated with higher M1 type macrophage infiltration and delayed peak time of M3 type macrophage activation. Moreover, survival analysis indicated that both enhanced M1 type macrophage infiltration and delayed peak time of M3 type macrophage activation are correlated with longer survival time. In summary, this study not only provides a theoretical framework for understanding the dynamic mechanisms underlying tumor macrophage interactions but also proposes two potential clinical prognostic markers: the level of M1 type macrophage infiltration and the peak time of M3 type macrophage activation.

q-bio.PE

Extracting Interaction Kernels for Many-Particle Systems by a Two-Phase Approach

This paper presents a two-phase method for learning interaction kernels of stochastic many-particle systems. After transforming stochastic trajectories of every particle into the particle density function by the kernel density estimation method, the first phase of our approach combines importance sampling with an adaptive threshold strategy to identify key terms in the kernel function, while the second phase uses the whole dataset to refine the coefficients. During the implementation of our method, the mean-field equation plays a key role in reformulating the task of extracting the interaction kernels into a learnable regression problem. We demonstrate the outstanding performance of our approach through extensive numerical examples, including interacting particle systems with a cubic potential, power-law repulsion-attraction potential, piecewise linear potential, as well as a two-dimensional radially symmetric potential.

physics.comp-ph

MEP-Net: Generating Solutions to Scientific Problems with Limited Knowledge by Maximum Entropy Principle

Maximum entropy principle (MEP) offers an effective and unbiased approach to inferring unknown probability distributions when faced with incomplete information, while neural networks provide the flexibility to learn complex distributions from data. This paper proposes a novel neural network architecture, the MEP-Net, which combines the MEP with neural networks to generate probability distributions from moment constraints. We also provide a comprehensive overview of the fundamentals of the maximum entropy principle, its mathematical formulations, and a rigorous justification for its applicability for non-equilibrium systems based on the large deviations principle. Through fruitful numerical experiments, we demonstrate that the MEP-Net can be particularly useful in modeling the evolution of probability distributions in biochemical reaction networks and in generating complex distributions from data.

stat.ML

Thermodynamics for Reduced Models of Breakable Amyloid Filaments Based on Maximum Entropy Principle

Amyloid filaments are associated with neurodegenerative diseases such as Alzheimer's and Parkinson's. Simplified models of amyloid aggregation are crucial because the original mass-action equations involve numerous variables, complicating analysis and understanding. While dynamical aspects of simplified models have been widely studied, their thermodynamic properties are less understood. In this study, we explore the Maximum Entropy Principle (MEP)-reduced models, initially developed for dynamical analysis, from a brand-new thermodynamic perspective. Analytical expressions along with numerical simulations demonstrate that the discrete MEP-reduced model strictly retains laws of thermodynamics, which holds true even when filament lengths transit from discrete values to continuous real numbers. Our findings not only clarify the thermodynamic consistency between the MEP-reduced models and the original models of amyloid filaments for the first time, but also suggest avenues for future research into the model-reduction thermodynamics.

physics.bio-ph

A data-driven analysis on the mediation effect of compartment models between control measures and COVID-19 epidemics

We make a retrospective review on various control measures taken by 127 countries/territories during the first wave of COVID-19 pandemic until July 7, 2020, and evaluate their impacts on the epidemic dynamics quantitatively. The SEIR-QD model, as a representative for general compartment models, is used to fit the epidemic data, enabling the extraction of crucial model parameters and dynamical features. The mediation effect of the SEIR-QD model is revealed by using the mediation analysis with structure equation modeling for multiple mediators operating in parallel. The inherent impacts of these control policies on the transmission dynamics of COVID-19 epidemics are clarified, and compared with results derived from both multiple linear regression and neural-network-based nonlinear regression. Through this data-driven analysis, the mediation effect of compartment models is confirmed, which provides a better understanding on the intrinsic correlations among the strength of control measures and the dynamical features of COVID-19 epidemics.

q-bio.PE

Entropy Structure Informed Learning for Inverse XDE Problems

Entropy, since its first discovery by Ludwig Boltzmann in 1877, has been widely applied in diverse disciplines, including thermodynamics, continuum mechanics, mathematical analysis, machine learning, etc. In this paper, we propose a new method for solving the inverse XDE (ODE, PDE, SDE) problems by utilizing the entropy balance equation instead of the original differential equations. This distinguishing feature constitutes a major difference between our current method and other previous classical methods (e.g. SINDy). Despite concerns about the potential information loss during the compression procedure from the original XDEs to single entropy balance equation, various examples from MM reactions, Schlogl model and chemical Lorenz equations in the form of ODEs to nonlinear porous medium equation and Fokker-Planck equation with a double-well potential in the PDE form all well confirm the accuracy, robustness and reliability of our method, as well as its comparable performance with respect to SINDy.

math.DS

Rational evaluation of various epidemic models based on the COVID-19 data of China

In this paper, based on the Akaike information criterion, root mean square error and robustness coefficient, a rational evaluation of various epidemic models/methods, including seven empirical functions, four statistical inference methods and five dynamical models, on their forecasting abilities is carried out. With respect to the outbreak data of COVID-19 epidemics in China, we find that before the inflection point, all models fail to make a reliable prediction. The Logistic function consistently underestimates the final epidemic size, while the Gompertz's function makes an overestimation in all cases. Towards statistical inference methods, the methods of sequential Bayesian and time-dependent reproduction number are more accurate at the late stage of an epidemic. And the transition-like behavior of exponential growth method from underestimation to overestimation with respect to the inflection point might be useful for constructing a more reliable forecast. Compared to ODE-based SIR, SEIR and SEIR-AHQ models, the SEIR-QD and SEIR-PO models generally show a better performance on studying the COVID-19 epidemics, whose success we believe could be attributed to a proper trade-off between model complexity and fitting accuracy. Our findings not only are crucial for the forecast of COVID-19 epidemics, but also may apply to other infectious diseases.

q-bio.PE

Revealing hidden dynamics from time-series data by ODENet

To derive the hidden dynamics from observed data is one of the fundamental but also challenging problems in many different fields. In this study, we propose a new type of interpretable network called the ordinary differential equation network (ODENet), in which the numerical integration of explicit ordinary differential equations (ODEs) are embedded into the machine learning scheme to build a general framework for revealing the hidden dynamics buried in massive time-series data efficiently and reliably. ODENet takes full advantage of both machine learning algorithms and ODE modeling. On one hand, the embedding of ODEs makes the framework more interpretable benefiting from the mature theories of ODEs. On the other hand, the schemes of machine learning enable data handling, paralleling, and optimization to be easily and efficiently implemented. From classical Lotka-Volterra equations to chaotic Lorenz equations, the ODENet exhibits its remarkable capability in handling time-series data even in the presence of large noise. We further apply the ODENet to real actin aggregation data, which shows an impressive performance as well. These results demonstrate the superiority of ODENet in dealing with noisy data, data with either non-equal spacing or large sampling time steps over other traditional machine learning algorithms.

math.DS

Epidemic analysis of COVID-19 in China by dynamical modeling

The outbreak of novel coronavirus-caused pneumonia (COVID-19) in Wuhan has attracted worldwide attention. Here, we propose a generalized SEIR model to analyze this epidemic. Based on the public data of National Health Commission of China from Jan. 20th to Feb. 9th, 2020, we reliably estimate key epidemic parameters and make predictions on the inflection point and possible ending time for 5 different regions. According to optimistic estimation, the epidemics in Beijing and Shanghai will end soon within two weeks, while for most part of China, including the majority of cities in Hubei province, the success of anti-epidemic will be no later than the middle of March. The situation in Wuhan is still very severe, at least based on public data until Feb. 15th. We expect it will end up at the beginning of April. Moreover, by inverse inference, we find the outbreak of COVID-19 in Mainland, Hubei province and Wuhan all can be dated back to the end of December 2019, and the doubling time is around two days at the early stage.

q-bio.PE

Identification of hydrodynamic instability by convolutional neural networks

The onset of hydrodynamic instabilities is of great importance in both industry and daily life, due to the dramatic mechanical and thermodynamic changes for different types of flow motions. In this paper, modern machine learning techniques, especially the convolutional neural networks (CNN), are applied to identify the transition between different flow motions raised by hydrodynamic instability, as well as critical non-dimensionalized parameters for characterizing this transit. CNN not only correctly predicts the critical transition values for both Taylor-Couette (TC) flow and Rayleigh- Bénard (RB) convection under various setups and conditions, but also shows an outstanding performance on robustness and noise-tolerance. In addition, key spatial features used for classifying different flow patterns are revealed by the principal component analysis.

physics.comp-ph

When Machine Learning Meets Multiscale Modeling in Chemical Reactions

Due to the intrinsic complexity and nonlinearity of chemical reactions, direct applications of traditional machine learning algorithms may face with many difficulties. In this study, through two concrete examples with biological background, we illustrate how the key ideas of multiscale modeling can help to reduce the computational cost of machine learning a lot, as well as how machine learning algorithms perform model reduction automatically in a time-scale separated system. Our study highlights the necessity and effectiveness of an integration of machine learning algorithms and multiscale modeling during the study of chemical reactions.

q-bio.MN