arXiv subjects

Kai Zhou

Publications and source records attributed to Kai Zhou.

At least 145 records · Page 8Linked to original sources

arXiv2022

Amplitude/Phase Retrieval for Terahertz Holography with Supervised and Unsupervised Physics-Informed Deep Learning

Recently, digital holographic imaging techniques (including methods with heterodyne detection) have found increased attention in the terahertz (THz) frequency range. However, holographic techniques rely on the use of a reference beam in order to obtain phase information. This letter investigates the potential of reference-free THz holographic imaging and proposes novel supervised and unsupervised deep learning (DL) methods for amplitude and phase recovery. The calculations incorporate Fresnel diffraction as prior knowledge. We first show that our unsupervised dual network can predict amplitude and phase simultaneously, thus overcoming the limitation of previous studies which could only predict phase objects. This is demonstrated with synthetic 2D image data as well as with measured 2D THz diffraction images. The advantage of unsupervised DL is that it can be used directly without labeling by human experts. We then address supervised DL -- a concept of general applicability. We introduce training with a database set of 2D images taken in the visible spectra range and modified by us numerically to emulate THz images. With this approach, we avoid the prohibitively time-consuming collection of a large number of THz-frequency images. The results obtained with both approaches represent the first steps towards fast holographic THz imaging with reference-beam-free low-cost power detection.

physics.optics↗

arXiv2022

Fourier-Flow model generating Feynman paths

As an alternative but unified and more fundamental description for quantum physics, Feynman path integrals generalize the classical action principle to a probabilistic perspective, under which the physical observables' estimation translates into a weighted sum over all possible paths. The underlying difficulty is to tackle the whole path manifold from finite samples that can effectively represent the Feynman propagator dictated probability distribution. Modern generative models in machine learning can handle learning and representing probability distribution with high computational efficiency. In this study, we propose a Fourier-flow generative model to simulate the Feynman propagator and generate paths for quantum systems. As demonstration, we validate the path generator on the harmonic and anharmonic oscillators. The latter is a double-well system without analytic solutions. To preserve the periodic condition for the system, the Fourier transformation is introduced into the flow model to approach a Matsubara representation. With this novel development, the ground-state wave function and low-lying energy levels are estimated accurately. Our method offers a new avenue to investigate quantum systems with machine learning assisted Feynman Path integral solving.

hep-lat↗

arXiv2022

Non-equilibrium dynamics of bacterial colonies -- growth, active fluctuations, segregation, adhesion, and invasion

Colonies of bacteria endowed with a pili-based self-propulsion machinery are ideal models for investigating the structure and dynamics of active many-particle systems. We study Neisseria gonorrhoeae colonies with a molecular-dynamics-based approach. A generic, adaptable simulation method for particle systems with fluctuating bond-like interactions is devised. The simulations are employed to investigate growth of bacterial colonies and the dependence of the colony structure on cell-cell interactions. In colonies, pilus retraction enhances local ordering. For colonies consisting of different types of cells, the simulations show a segregation depending on the pili-mediated interactions among different cells. These results agree with experimental observations. Next, we quantify the power-spectral density of colony-shape fluctuations in silico. Simulations predict a strong violation of the equilibrium fluctuation-response relation. Furthermore, we show that active force generation enables colonies to spread on surfaces and to invade narrow channels. The methodology can serve as a foundation for future studies of active many-particle systems at boundaries with complex shape.

cond-mat.soft↗

arXiv2022

Rethinking the ill-posedness of the spectral function reconstruction -- why is it fundamentally hard and how Artificial Neural Networks can help

Reconstructing hadron spectral functions through Euclidean correlation functions are of the important missions in lattice QCD calculations. However, in a Källen--Lehmann(KL) spectral representation, the reconstruction is observed to be ill-posed in practice. It is usually ascribed to the fewer observation points compared to the number of points in the spectral function. In this paper, by solving the eigenvalue problem of continuous KL convolution, we show analytically that the ill-posedness of the inversion is fundamental and it exists even for continuous correlation functions. We discussed how to introduce regulators to alleviate the predicament, in which include the Artificial Neural Networks(ANNs) representations recently proposed by the Authors in~[Phys. Rev. D 106 (2022) L051502]. The uniqueness of solutions using ANNs representations is manifested analytically and validated numerically. Reconstructed spectral functions using different regularization schemes are also demonstrated, together with their eigen-mode decomposition. We observe that components with large eigenvalues can be reliably reconstructed by all methods, whereas those with low eigenvalues need to be constrained by regulators.

hep-ph↗

arXiv2022

Reconstructing spectral functions via automatic differentiation

Reconstructing spectral functions from Euclidean Green's functions is an important inverse problem in many-body physics. However, the inversion is proved to be ill-posed in the realistic systems with noisy Green's functions. In this Letter, we propose an automatic differentiation(AD) framework as a generic tool for the spectral reconstruction from propagator observable. Exploiting the neural networks' regularization as a non-local smoothness regulator of the spectral function, we represent spectral functions by neural networks and use the propagator's reconstruction error to optimize the network parameters unsupervisedly. In the training process, except for the positive-definite form for the spectral function, there are no other explicit physical priors embedded into the neural networks. The reconstruction performance is assessed through relative entropy and mean square error for two different network representations. Compared to the maximum entropy method, the AD framework achieves better performance in the large-noise situation. It is noted that the freedom of introducing non-local regularization is an inherent advantage of the present framework and may lead to substantial improvements in solving inverse problems.

hep-ph↗

arXiv2022

Sunda-arc seismicity: continuing increase of high-magnitude earthquakes since 2004

Spatial and temporal data for earthquakes with magnitude M greater than or equal to 6.5 can provide crucial information about the seismic history and potential for large earthquakes in a region. We analyzed approximately 313,500 events that occurred in the Sunda-arc region during the last 56 years, from 1964 to 2020, reported by the International Seismological Center. We report a persistent increase in the annual number of the events with mb greater than or equal to 6.5. We tested this increase against the null hypothesis and discarded the possibility of the increase being due to random groupings. The trend given by Auto-Regressive Integrated Moving Average suggests continuing increase of such large-magnitude events in the region during the next decade. At the same time, the computed Gutenberg Richter b value shows anomalies that can be related to the occurrence of the mega 2004 Sumatra earthquake, and to possible state of high tectonic stress in the eastern parts of the region.

physics.geo-ph↗

arXiv2022

Neural network reconstruction of the dense matter equation of state from neutron star observables

The Equation of State (EoS) of strongly interacting cold and hot ultra-dense QCD matter remains a major challenge in the field of nuclear astrophysics. With the advancements in measurements of neutron star masses, radii, and tidal deformabilities, from electromagnetic and gravitational wave observations, neutron stars play an important role in constraining the ultra-dense QCD matter EoS. In this work, we present a novel method that exploits deep learning techniques to reconstruct the neutron star EoS from mass-radius (M-R) observations. We employ neural networks (NNs) to represent the EoS in a model-independent way, within the range of $\sim$1-7 times the nuclear saturation density. The unsupervised Automatic Differentiation (AD) framework is implemented to optimize the EoS, so as to yield through TOV equations, an M-R curve that best fits the observations. We demonstrate that this method works by rebuilding the EoS on mock data, i.e., mass-radius pairs derived from a randomly generated polytropic EoS. The reconstructed EoS fits the mock data with reasonable accuracy, using just 11 mock M-R pairs observations, close to the current number of actual observations.

hep-ph↗

arXiv2022

A multi-task learning for cavitation detection and cavitation intensity recognition of valve acoustic signals

With the rapid development of smart manufacturing, data-driven machinery health management has received a growing attention. As one of the most popular methods in machinery health management, deep learning (DL) has achieved remarkable successes. However, due to the issues of limited samples and poor separability of different cavitation states of acoustic signals, which greatly hinder the eventual performance of DL modes for cavitation intensity recognition and cavitation detection. In this work, a novel multi-task learning framework for simultaneous cavitation detection and cavitation intensity recognition framework using 1-D double hierarchical residual networks (1-D DHRN) is proposed for analyzing valves acoustic signals. Firstly, a data augmentation method based on sliding window with fast Fourier transform (Swin-FFT) is developed to alleviate the small-sample issue confronted in this study. Secondly, a 1-D double hierarchical residual block (1-D DHRB) is constructed to capture sensitive features from the frequency domain acoustic signals of valve. Then, a new structure of 1-D DHRN is proposed. Finally, the devised 1-D DHRN is evaluated on two datasets of valve acoustic signals without noise (Dataset 1 and Dataset 2) and one dataset of valve acoustic signals with realistic surrounding noise (Dataset 3) provided by SAMSON AG (Frankfurt). Our method has achieved state-of-the-art results. The prediction accurcies of 1-D DHRN for cavitation intensitys recognition are as high as 93.75%, 94.31% and 100%, which indicates that 1-D DHRN outperforms other DL models and conventional methods. At the same time, the testing accuracies of 1-D DHRN for cavitation detection are as high as 97.02%, 97.64% and 100%. In addition, 1-D DHRN has also been tested for different frequencies of samples and shows excellent results for frequency of samples that mobile phones can accommodate.

cs.SD↗

arXiv2022

Deep Learning-based Small Magnitude Earthquake Detection and Seismic Phase Classification

Reliable earthquake detection and seismic phase classification is often challenging especially in the circumstances of low magnitude events or poor signal-to-noise ratio. With improved seismometers and better global coverage, a sharp increase in the volume of recorded seismic data is witnessed. This makes the handling of the seismic data rather daunting based on traditional approaches and therefore fuels the need for a more robust and reliable method. In this study, we investigate two deep learningbased models, termed 1D ResidualNeuralNetwork (ResNet) and multi-branch ResNet, for tackling the problem of seismic signal detection and phase identification, especially the later can be used in the case where multiple classes is organized in the hierarchical format. These methods are trained and tested on the dataset of the Southern California Seismic Network. Results demonstrate that the proposed methods can achieve robust performance for the detection of seismic signals, and the identification of seismic phases, even when the seismic events are of small magnitude and are masked by noise. Compared with previously proposed deep learning methods, the introduced frameworks achieve 4% improvement in earthquake monitoring, and a slight enhancement in seismic phase classification.

physics.geo-ph↗

arXiv2022

CREIME: A Convolutional Recurrent model for Earthquake Identification and Magnitude Estimation

The detection and rapid characterisation of earthquake parameters such as magnitude are of prime importance in seismology, particularly in applications such as Earthquake Early Warning (EEW). Traditionally, algorithms such as STA/LTA are used for event detection, while frequency or amplitude domain parameters calculated from 1-3 seconds of first P-arrival data are sometimes used to provide a first estimate of (body wave) magnitude. Owing to extensive involvement of human experts in parameter determination, these approaches are often found to be insufficient. Moreover, these methods are sensitive to the signal to noise ratio and may often lead to false or missed alarms depending on the choice of parameters. We, therefore, propose a multitasking deep learning model the Convolutional Recurrent model for Earthquake Identification and Magnitude Estimation (CREIME) that: (i) detects the first earthquake signal, from background seismic noise, (ii) determines first P arrival time as well as (iii) estimates the magnitude using the raw 3-component waveform data from a single station as model input. Considering, speed is of essence in EEW, we use up to two seconds of P-wave information which, to the best of our knowledge, is a significantly smaller data window (5 second window with up to of P wave data) compared to the previous studies. To examine the robustness of CREIME we test it on two independent datasets and find that it achieves an average accuracy of 98 percent for event vs noise discrimination and is able to estimate first P arrival time and local magnitude with average root mean squared errors of 0.13 seconds and 0.65 units, respectively. We also compare CREIME architecture with architectures of other baseline models, by training them on the same data, and also with traditional algorithms such as STA/LTA, and show that our architecture outperforms these methods.

physics.geo-ph↗

arXiv2022

Computing Equilibria in Binary Networked Public Goods Games

Public goods games study the incentives of individuals to contribute to a public good and their behaviors in equilibria. In this paper, we examine a specific type of public goods game where players are networked and each has binary actions, and focus on the algorithmic aspects of such games. First, we show that checking the existence of a pure-strategy Nash equilibrium is NP-complete. We then identify tractable instances based on restrictions of either utility functions or of the underlying graphical structure. In certain cases, we also show that we can efficiently compute a socially optimal Nash equilibrium. Finally, we propose a heuristic approach for computing approximate equilibria in general binary networked public goods games, and experimentally demonstrate its effectiveness.

cs.GT↗

arXiv2022

Shared Data and Algorithms for Deep Learning in Fundamental Physics

We introduce a Python package that provides simply and unified access to a collection of datasets from fundamental physics research - including particle physics, astroparticle physics, and hadron- and nuclear physics - for supervised machine learning studies. The datasets contain hadronic top quarks, cosmic-ray induced air showers, phase transitions in hadronic matter, and generator-level histories. While public datasets from multiple fundamental physics disciplines already exist, the common interface and provided reference models simplify future work on cross-disciplinary machine learning and transfer learning in fundamental physics. We discuss the design and structure and line out how additional datasets can be submitted for inclusion. As showcase application, we present a simple yet flexible graph-based neural network architecture that can easily be applied to a wide range of supervised learning tasks. We show that our approach reaches performance close to dedicated methods on all datasets. To simplify adaptation for various problems, we provide easy-to-follow instructions on how graph-based representations of data structures, relevant for fundamental physics, can be constructed and provide code implementations for several of them. Implementations are also provided for our proposed method and all reference algorithms.

cs.LG↗

arXiv2022

An acoustic signal cavitation detection framework based on XGBoost with adaptive selection feature engineering

Valves are widely used in industrial and domestic pipeline systems. However, during their operation, they may suffer from the occurrence of the cavitation, which can cause loud noise, vibration and damage to the internal components of the valve. Therefore, monitoring the flow status inside valves is significantly beneficial to prevent the additional cost induced by cavitation. In this paper, a novel acoustic signal cavitation detection framework--based on XGBoost with adaptive selection feature engineering--is proposed. Firstly, a data augmentation method with non-overlapping sliding window (NOSW) is developed to solve small-sample problem involved in this study. Then, the each segmented piece of time-domain acoustic signal is transformed by fast Fourier transform (FFT) and its statistical features are extracted to be the input to the adaptive selection feature engineering (ASFE) procedure, where the adaptive feature aggregation and feature crosses are performed. Finally, with the selected features the XGBoost algorithm is trained for cavitation detection and tested on valve acoustic signal data provided by Samson AG (Frankfurt). Our method has achieved state-of-the-art results. The prediction performance on the binary classification (cavitation and no-cavitation) and the four-class classification (cavitation choked flow, constant cavitation, incipient cavitation and no-cavitation) are satisfactory and outperform the traditional XGBoost by 4.67% and 11.11% increase of the accuracy.

cs.SD↗

arXiv2022

Regional-Local Adversarially Learned One-Class Classifier Anomalous Sound Detection in Global Long-Term Space

Anomalous sound detection (ASD) is one of the most significant tasks of mechanical equipment monitoring and maintaining in complex industrial systems. In practice, it is vital to precisely identify abnormal status of the working mechanical system, which can further facilitate the failure troubleshooting. In this paper, we propose a multi-pattern adversarial learning one-class classification framework, which allows us to use both the generator and the discriminator of an adversarial model for efficient ASD. The core idea is learning to reconstruct the normal patterns of acoustic data through two different patterns of auto-encoding generators, which succeeds in extending the fundamental role of a discriminator from identifying real and fake data to distinguishing between regional and local pattern reconstructions. Furthermore, we present a global filter layer for long-term interactions in the frequency domain space, which directly learns from the original data without introducing any human priors. Extensive experiments performed on four real-world datasets from different industrial domains (three cavitation datasets provided by SAMSON AG, and one existing publicly) for anomaly detection show superior results, and outperform recent state-of-the-art ASD methods.

cs.SD↗

arXiv2022

Heavy quark potential in quark-gluon Plasma: Deep neural network meets lattice quantum chromodynamics

Bottomonium states are key probes for experimental studies of the quark-gluon plasma (QGP) created in high-energy nuclear collisions. Theoretical models of bottomonium productions in high-energy nuclear collisions rely on the in-medium interactions between the bottom and antibottom quarks. The latter can be characterized by the temperature ($T$) dependent potential, with real ($V_R(T,r)$) and imaginary ($V_I(T,r)$) parts, as a function of the spatial separation ($r$). Recently, the masses and thermal widths of up to $3S$ and $2P$ bottomonium states in QGP were calculated using lattice quantum chromodynamics (LQCD). Starting from these LQCD results and through a novel application of deep neural network, here, we obtain $V_R(T,r)$ and $V_I(T,r)$ in a model-independent fashion. The temperature dependence of $V_R(T,r)$ was found to be very mild between $T\approx0-334$~MeV. For $T=151-334$~MeV, $V_I(T,r)$ shows a rapid increase with $T$ and $r$, which is much larger than the perturbation-theory-based expectations.

hep-ph↗

arXiv2022

BinarizedAttack: Structural Poisoning Attacks to Graph-based Anomaly Detection

Graph-based Anomaly Detection (GAD) is becoming prevalent due to the powerful representation abilities of graphs as well as recent advances in graph mining techniques. These GAD tools, however, expose a new attacking surface, ironically due to their unique advantage of being able to exploit the relations among data. That is, attackers now can manipulate those relations (i.e., the structure of the graph) to allow some target nodes to evade detection. In this paper, we exploit this vulnerability by designing a new type of targeted structural poisoning attacks to a representative regression-based GAD system termed OddBall. Specially, we formulate the attack against OddBall as a bi-level optimization problem, where the key technical challenge is to efficiently solve the problem in a discrete domain. We propose a novel attack method termed BinarizedAttack based on gradient descent. Comparing to prior arts, BinarizedAttack can better use the gradient information, making it particularly suitable for solving combinatorial optimization problems. Furthermore, we investigate the attack transferability of BinarizedAttack by employing it to attack other representation-learning-based GAD systems. Our comprehensive experiments demonstrate that BinarizedAttack is very effective in enabling target nodes to evade graph-based anomaly detection tools with limited attackers' budget, and in the black-box transfer attack setting, BinarizedAttack is also tested effective and in particular, can significantly change the node embeddings learned by the GAD systems. Our research thus opens the door to studying a new type of attack against security analytic tools that rely on graph data.

cs.LG↗

arXiv2021

A Multi-user Oriented Live Free-viewpoint Video Streaming System Based On View Interpolation

As an important application form of immersive multimedia services, free-viewpoint video(FVV) enables users with great immersive experience by strong interaction. However, the computational complexity of virtual view synthesis algorithms poses a significant challenge to the real-time performance of an FVV system. Furthermore, the individuality of user interaction makes it difficult to serve multiple users simultaneously for a system with conventional architecture. In this paper, we novelly introduce a CNN-based view interpolation algorithm to synthesis dense virtual views in real time. Based on this, we also build an end-to-end live free-viewpoint system with a multi-user oriented streaming strategy. Our system can utilize a single edge server to serve multiple users at the same time without having to bring a large view synthesis load on the client side. We analyze the whole system and show that our approaches give the user a pleasant immersive experience, in terms of both visual quality and latency.

cs.MM↗

arXiv2021

Automatic differentiation approach for reconstructing spectral functions with neural networks

Reconstructing spectral functions from Euclidean Green's functions is an important inverse problem in physics. The prior knowledge for specific physical systems routinely offers essential regularization schemes for solving the ill-posed problem approximately. Aiming at this point, we propose an automatic differentiation framework as a generic tool for the reconstruction from observable data. We represent the spectra by neural networks and set chi-square as loss function to optimize the parameters with backward automatic differentiation unsupervisedly. In the training process, there is no explicit physical prior embedding into neural networks except the positive-definite form. The reconstruction accuracy is assessed through Kullback-Leibler(KL) divergence and mean square error(MSE) at multiple noise levels. It should be noted that the automatic differential framework and the freedom of introducing regularization are inherent advantages of the present approach and may lead to improvements of solving inverse problem in the future.

physics.comp-ph↗