arXiv subjects

Lingxiao Wang

Publications and source records attributed to Lingxiao Wang.

At least 73 records · Page 4Linked to original sources

arXiv2022

GAMMA Challenge:Glaucoma grAding from Multi-Modality imAges

Color fundus photography and Optical Coherence Tomography (OCT) are the two most cost-effective tools for glaucoma screening. Both two modalities of images have prominent biomarkers to indicate glaucoma suspected. Clinically, it is often recommended to take both of the screenings for a more accurate and reliable diagnosis. However, although numerous algorithms are proposed based on fundus images or OCT volumes in computer-aided diagnosis, there are still few methods leveraging both of the modalities for the glaucoma assessment. Inspired by the success of Retinal Fundus Glaucoma Challenge (REFUGE) we held previously, we set up the Glaucoma grAding from Multi-Modality imAges (GAMMA) Challenge to encourage the development of fundus \& OCT-based glaucoma grading. The primary task of the challenge is to grade glaucoma from both the 2D fundus images and 3D OCT scanning volumes. As part of GAMMA, we have publicly released a glaucoma annotated dataset with both 2D fundus color photography and 3D OCT volumes, which is the first multi-modality dataset for glaucoma grading. In addition, an evaluation framework is also established to evaluate the performance of the submitted methods. During the challenge, 1272 results were submitted, and finally, top-10 teams were selected to the final stage. We analysis their results and summarize their methods in the paper. Since all these teams submitted their source code in the challenge, a detailed ablation study is also conducted to verify the effectiveness of the particular modules proposed. We find many of the proposed techniques are practical for the clinical diagnosis of glaucoma. As the first in-depth study of fundus \& OCT multi-modality glaucoma grading, we believe the GAMMA Challenge will be an essential starting point for future research.

cs.CV↗

arXiv2022

Reconstructing the neutron star equation of state from observational data via automatic differentiation

Neutron star observables like masses, radii, and tidal deformability are direct probes to the dense matter equation of state~(EoS). A novel deep learning method that optimizes an EoS in the automatic differentiation framework of solving inverse problems is presented. The trained neural network EoS yields narrow bands for the relationship between the pressure and speed of sound as a function of the mass density. The results are consistent with those obtained from conventional approaches and the observational bound on the tidal deformability inferred from the gravitational wave event, GW170817.

astro-ph.HE↗

arXiv2022

Amplitude/Phase Retrieval for Terahertz Holography with Supervised and Unsupervised Physics-Informed Deep Learning

Recently, digital holographic imaging techniques (including methods with heterodyne detection) have found increased attention in the terahertz (THz) frequency range. However, holographic techniques rely on the use of a reference beam in order to obtain phase information. This letter investigates the potential of reference-free THz holographic imaging and proposes novel supervised and unsupervised deep learning (DL) methods for amplitude and phase recovery. The calculations incorporate Fresnel diffraction as prior knowledge. We first show that our unsupervised dual network can predict amplitude and phase simultaneously, thus overcoming the limitation of previous studies which could only predict phase objects. This is demonstrated with synthetic 2D image data as well as with measured 2D THz diffraction images. The advantage of unsupervised DL is that it can be used directly without labeling by human experts. We then address supervised DL -- a concept of general applicability. We introduce training with a database set of 2D images taken in the visible spectra range and modified by us numerically to emulate THz images. With this approach, we avoid the prohibitively time-consuming collection of a large number of THz-frequency images. The results obtained with both approaches represent the first steps towards fast holographic THz imaging with reference-beam-free low-cost power detection.

physics.optics↗

arXiv2022

Fourier-Flow model generating Feynman paths

As an alternative but unified and more fundamental description for quantum physics, Feynman path integrals generalize the classical action principle to a probabilistic perspective, under which the physical observables' estimation translates into a weighted sum over all possible paths. The underlying difficulty is to tackle the whole path manifold from finite samples that can effectively represent the Feynman propagator dictated probability distribution. Modern generative models in machine learning can handle learning and representing probability distribution with high computational efficiency. In this study, we propose a Fourier-flow generative model to simulate the Feynman propagator and generate paths for quantum systems. As demonstration, we validate the path generator on the harmonic and anharmonic oscillators. The latter is a double-well system without analytic solutions. To preserve the periodic condition for the system, the Fourier transformation is introduced into the flow model to approach a Matsubara representation. With this novel development, the ground-state wave function and low-lying energy levels are estimated accurately. Our method offers a new avenue to investigate quantum systems with machine learning assisted Feynman Path integral solving.

hep-lat↗

arXiv2022

Rethinking the ill-posedness of the spectral function reconstruction -- why is it fundamentally hard and how Artificial Neural Networks can help

Reconstructing hadron spectral functions through Euclidean correlation functions are of the important missions in lattice QCD calculations. However, in a Källen--Lehmann(KL) spectral representation, the reconstruction is observed to be ill-posed in practice. It is usually ascribed to the fewer observation points compared to the number of points in the spectral function. In this paper, by solving the eigenvalue problem of continuous KL convolution, we show analytically that the ill-posedness of the inversion is fundamental and it exists even for continuous correlation functions. We discussed how to introduce regulators to alleviate the predicament, in which include the Artificial Neural Networks(ANNs) representations recently proposed by the Authors in~[Phys. Rev. D 106 (2022) L051502]. The uniqueness of solutions using ANNs representations is manifested analytically and validated numerically. Reconstructed spectral functions using different regularization schemes are also demonstrated, together with their eigen-mode decomposition. We observe that components with large eigenvalues can be reliably reconstructed by all methods, whereas those with low eigenvalues need to be constrained by regulators.

hep-ph↗

arXiv2022

Reconstructing spectral functions via automatic differentiation

Reconstructing spectral functions from Euclidean Green's functions is an important inverse problem in many-body physics. However, the inversion is proved to be ill-posed in the realistic systems with noisy Green's functions. In this Letter, we propose an automatic differentiation(AD) framework as a generic tool for the spectral reconstruction from propagator observable. Exploiting the neural networks' regularization as a non-local smoothness regulator of the spectral function, we represent spectral functions by neural networks and use the propagator's reconstruction error to optimize the network parameters unsupervisedly. In the training process, except for the positive-definite form for the spectral function, there are no other explicit physical priors embedded into the neural networks. The reconstruction performance is assessed through relative entropy and mean square error for two different network representations. Compared to the maximum entropy method, the AD framework achieves better performance in the large-noise situation. It is noted that the freedom of introducing non-local regularization is an inherent advantage of the present framework and may lead to substantial improvements in solving inverse problems.

hep-ph↗

arXiv2022

Neural network reconstruction of the dense matter equation of state from neutron star observables

The Equation of State (EoS) of strongly interacting cold and hot ultra-dense QCD matter remains a major challenge in the field of nuclear astrophysics. With the advancements in measurements of neutron star masses, radii, and tidal deformabilities, from electromagnetic and gravitational wave observations, neutron stars play an important role in constraining the ultra-dense QCD matter EoS. In this work, we present a novel method that exploits deep learning techniques to reconstruct the neutron star EoS from mass-radius (M-R) observations. We employ neural networks (NNs) to represent the EoS in a model-independent way, within the range of $\sim$1-7 times the nuclear saturation density. The unsupervised Automatic Differentiation (AD) framework is implemented to optimize the EoS, so as to yield through TOV equations, an M-R curve that best fits the observations. We demonstrate that this method works by rebuilding the EoS on mock data, i.e., mass-radius pairs derived from a randomly generated polytropic EoS. The reconstructed EoS fits the mock data with reasonable accuracy, using just 11 mock M-R pairs observations, close to the current number of actual observations.

hep-ph↗

arXiv2022

Pessimistic Bootstrapping for Uncertainty-Driven Offline Reinforcement Learning

Offline Reinforcement Learning (RL) aims to learn policies from previously collected datasets without exploring the environment. Directly applying off-policy algorithms to offline RL usually fails due to the extrapolation error caused by the out-of-distribution (OOD) actions. Previous methods tackle such problem by penalizing the Q-values of OOD actions or constraining the trained policy to be close to the behavior policy. Nevertheless, such methods typically prevent the generalization of value functions beyond the offline data and also lack precise characterization of OOD data. In this paper, we propose Pessimistic Bootstrapping for offline RL (PBRL), a purely uncertainty-driven offline algorithm without explicit policy constraints. Specifically, PBRL conducts uncertainty quantification via the disagreement of bootstrapped Q-functions, and performs pessimistic updates by penalizing the value function based on the estimated uncertainty. To tackle the extrapolating error, we further propose a novel OOD sampling method. We show that such OOD sampling and pessimistic bootstrapping yields provable uncertainty quantifier in linear MDPs, thus providing the theoretical underpinning for PBRL. Extensive experiments on D4RL benchmark show that PBRL has better performance compared to the state-of-the-art algorithms.

cs.LG↗

arXiv2021

Automatic differentiation approach for reconstructing spectral functions with neural networks

Reconstructing spectral functions from Euclidean Green's functions is an important inverse problem in physics. The prior knowledge for specific physical systems routinely offers essential regularization schemes for solving the ill-posed problem approximately. Aiming at this point, we propose an automatic differentiation framework as a generic tool for the reconstruction from observable data. We represent the spectra by neural networks and set chi-square as loss function to optimize the parameters with backward automatic differentiation unsupervisedly. In the training process, there is no explicit physical prior embedding into neural networks except the positive-definite form. The reconstruction accuracy is assessed through Kullback-Leibler(KL) divergence and mean square error(MSE) at multiple noise levels. It should be noted that the automatic differential framework and the freedom of introducing regularization are inherent advantages of the present approach and may lead to improvements of solving inverse problem in the future.

physics.comp-ph↗

arXiv2021

Adaptive Differentially Private Empirical Risk Minimization

We propose an adaptive (stochastic) gradient perturbation method for differentially private empirical risk minimization. At each iteration, the random noise added to the gradient is optimally adapted to the stepsize; we name this process adaptive differentially private (ADP) learning. Given the same privacy budget, we prove that the ADP method considerably improves the utility guarantee compared to the standard differentially private method in which vanilla random noise is added. Our method is particularly useful for gradient-based algorithms with time-varying learning rates, including variants of AdaGrad (Duchi et al., 2011). We provide extensive numerical experiments to demonstrate the effectiveness of the proposed adaptive differentially private algorithm.

cs.LG↗

arXiv2021

Dynamic Bottleneck for Robust Self-Supervised Exploration

Exploration methods based on pseudo-count of transitions or curiosity of dynamics have achieved promising results in solving reinforcement learning with sparse rewards. However, such methods are usually sensitive to environmental dynamics-irrelevant information, e.g., white-noise. To handle such dynamics-irrelevant information, we propose a Dynamic Bottleneck (DB) model, which attains a dynamics-relevant representation based on the information-bottleneck principle. Based on the DB model, we further propose DB-bonus, which encourages the agent to explore state-action pairs with high information gain. We establish theoretical connections between the proposed DB-bonus, the upper confidence bound (UCB) for linear case, and the visiting count for tabular case. We evaluate the proposed method on Atari suits with dynamics-irrelevant noises. Our experiments show that exploration with DB bonus outperforms several state-of-the-art exploration methods in noisy environments.

cs.LG↗

arXiv2021

Learning Langevin dynamics with QCD phase transition

In this proceeding, the deep Convolutional Neural Networks (CNNs) are deployed to recognize the order of QCD phase transition and predict the dynamical parameters in Langevin processes. To overcome the intrinsic randomness existed in a stochastic process, we treat the final spectra as image-type inputs which preserve sufficient spatiotemporal correlations. As a practical example, we demonstrate this paradigm for the scalar condensation in QCD matter near the critical point, in which the order parameter of chiral phase transition can be characterized in a $1+1$-dimensional Langevin equation for $σ$ field. The well-trained CNNs accurately classify the first-order phase transition and crossover from $σ$ field configurations with fluctuations, in which the noise does not impair the performance of the recognition. In reconstructing the dynamics, we demonstrate it is robust to extract the damping coefficients $η$ from the intricate field configurations.

nucl-th↗

arXiv2021

Detecting Chiral Magnetic Effect via Deep Learning

The search of chiral magnetic effect (CME) in heavy-ion collisions has attracted long-term attentions. Multiple observables have been proposed but all suffer from obstacles due to large background contaminations. In this Letter, we construct an observable-independent CME-meter based on a deep convolutional neural network. After trained over data set generated by a multiphase transport model, the CME-meter shows high accuracy in recognizing the CME-featured charge separation from the final-state pion spectra. It also exhibits remarkable robustness to diverse conditions including different collision energies, centralities, and elliptic flow backgrounds. In a transfer learning manner, the CME-meter is validated in isobaric collision systems, showing good transferability among different colliding systems. Based on variational approaches, we utilize the DeepDream method to derive the most responsive CME-spectra that demonstrates the physical contents the machine learns.

hep-ph↗

arXiv2021

Measuring the rationality in evacuation behavior with deep learning

The bounded rationality is a crucial component in human behaviors. It plays a key role in the typical collective behavior of evacuation, in which the heterogeneous information leads to the deviation of rational choices. In this study, we propose a deep learning framework to extract the quantitative deviation which emerges in a cellular automaton (CA) model describing the evacuation. The well-trained deep convolutional neural networks (CNNs) accurately predict the rational factors from multi-frame images generated by the CA model. In addition, it should be noted that the performance of this machine is robust to the incomplete images corresponding to global information loss. Moreover, this framework provides us with a playground in which the rationality is measured in evacuation and the scheme could also be generalized to other well-designed virtual experiments.

physics.soc-ph↗

arXiv2021

Permutation Invariant Policy Optimization for Mean-Field Multi-Agent Reinforcement Learning: A Principled Approach

Multi-agent reinforcement learning (MARL) becomes more challenging in the presence of more agents, as the capacity of the joint state and action spaces grows exponentially in the number of agents. To address such a challenge of scale, we identify a class of cooperative MARL problems with permutation invariance, and formulate it as a mean-field Markov decision processes (MDP). To exploit the permutation invariance therein, we propose the mean-field proximal policy optimization (MF-PPO) algorithm, at the core of which is a permutation-invariant actor-critic neural architecture. We prove that MF-PPO attains the globally optimal policy at a sublinear rate of convergence. Moreover, its sample complexity is independent of the number of agents. We validate the theoretical advantages of MF-PPO with numerical experiments in the multi-agent particle environment (MPE). In particular, we show that the inductive bias introduced by the permutation-invariant neural architecture enables MF-PPO to outperform existing competitors with a smaller number of model parameters, which is the key to its generalization performance.

cs.LG↗

arXiv2021

Principled Exploration via Optimistic Bootstrapping and Backward Induction

One principled approach for provably efficient exploration is incorporating the upper confidence bound (UCB) into the value function as a bonus. However, UCB is specified to deal with linear and tabular settings and is incompatible with Deep Reinforcement Learning (DRL). In this paper, we propose a principled exploration method for DRL through Optimistic Bootstrapping and Backward Induction (OB2I). OB2I constructs a general-purpose UCB-bonus through non-parametric bootstrap in DRL. The UCB-bonus estimates the epistemic uncertainty of state-action pairs for optimistic exploration. We build theoretical connections between the proposed UCB-bonus and the LSVI-UCB in a linear setting. We propagate future uncertainty in a time-consistent manner through episodic backward update, which exploits the theoretical advantage and empirically improves the sample-efficiency. Our experiments in the MNIST maze and Atari suite suggest that OB2I outperforms several state-of-the-art exploration approaches.

cs.LG↗

arXiv2021

Deep learning stochastic processes with QCD phase transition

It is non-trivial to recognize phase transitions and track dynamics inside a stochastic process because of its intrinsic stochasticity. In this paper, we employ the deep learning method to classify the phase orders and predict the damping coefficient of fluctuating systems under Langevin's description. As a concrete set-up, we demonstrate this paradigm for the scalar condensation in QCD matter near the critical point, in which the order parameter of chiral phase transition can be characterized in a $1+1$-dimensional Langevin equation for $σ$ field. In a supervised learning manner, the Convolutional Neural Networks(CNNs) accurately classify the first-order phase transition and crossover based on $σ$ field configurations with fluctuations. Noise in the stochastic process does not significantly hinder the performance of the well-trained neural network for phase order recognition. For mixed dynamics with diverse dynamical parameters, we further devise and train the machine to predict the damping coefficients $η$ in a broad range. The results show that it is robust to extract the dynamics from the bumpy field configurations.

nucl-th↗

arXiv2021

Adjusted Logistic Propensity Weighting Methods for Population Inference using Nonprobability Volunteer-Based Epidemiologic Cohorts

Many epidemiologic studies forgo probability sampling and turn to nonprobability volunteer-based samples because of cost, response burden, and invasiveness of biological samples. However, finite population inference is difficult to make from the nonprobability samples due to the lack of population representativeness. Aiming for making inferences at the population level using nonprobability samples, various inverse propensity score weighting (IPSW) methods have been studied with the propensity defined by the participation rate of population units in the nonprobability sample. In this paper, we propose an adjusted logistic propensity weighting (ALP) method to estimate the participation rates for nonprobability sample units. Compared to existing IPSW methods, the proposed ALP method is easy to implement by ready-to-use software while producing approximately unbiased estimators for population quantities regardless of the nonprobability sample rate. The efficiency of the ALP estimator can be further improved by scaling the survey sample weights in propensity estimation. Taylor linearization variance estimators are proposed for ALP estimators of finite population means that account for all sources of variability. The proposed ALP methods are evaluated numerically via simulation studies and empirically using the naïve unweighted National Health and Nutrition Examination Survey III sample, while taking the 1997 National Health Interview Survey as the reference, to estimate the 15-year mortality rates.

stat.AP↗