arXiv subjects

Yue Wu

Publications and source records attributed to Yue Wu.

At least 361 records · Page 20Linked to original sources

arXiv2019

Earthquake Detection in 1-D Time Series Data with Feature Selection and Dictionary Learning

Earthquakes can be detected by matching spatial patterns or phase properties from 1-D seismic waves. Current earthquake detection methods, such as waveform correlation and template matching, have difficulty detecting anomalous earthquakes that are not similar to other earthquakes. In recent years, machine-learning techniques for earthquake detection have been emerging as a new active research direction. In this paper, we develop a novel earthquake detection method based on dictionary learning. Our detection method first generates rich features via signal processing and statistical methods and further employs feature selection techniques to choose features that carry the most significant information. Based on these selected features, we build a dictionary for classifying earthquake events from non-earthquake events. To evaluate the performance of our dictionary-based detection methods, we test our method on a labquake dataset from Penn State University, which contains 3,357,566 time series data points with a 400 MHz sampling rate. 1,000 earthquake events are manually labeled in total, and the length of these earthquake events varies from 74 to 7151 data points. Through comparison to other detection methods, we show that our feature selection and dictionary learning incorporated earthquake detection method achieves an 80.1% prediction accuracy and outperforms the baseline methods in earthquake detection, including Template Matching (TM) and Support Vector Machine (SVM).

physics.geo-ph↗

arXiv2019

A Data-Driven CO2 Leakage Detection Using Seismic Data and Spatial-Temporal Densely Connected Convolutional Neural Networks

In carbon capture and sequestration, developing effective monitoring methods is needed to detect and respond to CO2 leakage. CO2 leakage detection methods rely on geophysical observations and monitoring sensor network. However, traditional methods usually require the development of site-specific physical models and expert interpretation, and the effectiveness of these methods can be limited to different application locations, operational scenarios, and conditions. In this paper, we developed a novel data-driven leakage detection method based on densely connected convolutional neural networks. Our method differs from conventional leakage monitoring methods by directly learning a mapping relationship between seismic data and the CO2 leakage mass. To account for the spatial and temporal characteristics of seismic data, our novel networks architecture combines 1D and 2D convolutional neural networks. To overcome the computational expense of solving optimization problems, we apply a densely-connecting strategy in our network architecture that reduces the number of network parameters. Based on the features generated by our convolutional neural networks, we further incorporate a long short-term memory network to utilize time-sequential information, which further improves the detection accuracy. Finally, we employ our detection method to synthetic seismic datasets generated based on flow simulations of a hypothetical CO2 storage scenario with injection into a partially compartmentalized sandstone storage reservoir. To evaluate method performance, we conducted multiple experiments including a random leakage test, a sequential test, and a robustness test. Numerical results show that our CO2 leakage detection method successfully detects the leakage and accurately predicts the leakage mass, suggesting that it has the potential for application in monitoring of real CO2 storage sites.

physics.geo-ph↗

arXiv2019

InversionNet: A Real-Time and Accurate Full Waveform Inversion with CNNs and continuous CRFs

Full-waveform inversion problems are usually formulated as optimization problems, where the forward-wave propagation operator $f$ maps the subsurface velocity structures to seismic signals. The existing computational methods for solving full-waveform inversion are not only computationally expensive, but also yields low-resolution results because of the ill-posedness and cycle skipping issues of full-waveform inversion. To resolve those issues, we employ machine-learning techniques to solve the full-waveform inversion. Specifically, we focus on applying the convolutional neural network~(CNN) to directly derive the inversion operator $f^{-1}$ so that the velocity structure can be obtained without knowing the forward operator $f$. We build a convolutional neural network with an encoder-decoder structure to model the correspondence from seismic data to subsurface velocity structures. Furthermore, we employ the conditional random field~(CRF) on top of the CNN to generate structural predictions by modeling the interactions between different locations on the velocity model. Our numerical examples using synthetic seismic reflection data show that the propose CNN-CRF model significantly improve the accuracy of the velocity inversion while the computational time is reduced.

eess.SP↗

arXiv2018

Rayleigh fading suppression in one-dimension optical scatters

Highly coherent wave is favorable for applications in which phase retrieval is necessary, yet a high coherent wave is prone to encounter Rayleigh fading phenomenon as it passes through a medium of random scatters. As an exemplary case, phase-sensitive optical time-domain reflectometry (Φ-OTDR) utilizes coherent interference of backscattering light along a fiber to achieve ultra-sensitive acoustic sensing, but sensing locations with fading won't be functional. Apart from the sensing domain, fading is also ubiquitous in optical imaging and wireless telecommunication, therefore it is of great interest. In this paper, we theoretically describe and experimentally verify how the fading phenomena in one-dimension optical scatters will be suppressed with arbitrary number of independent probing channels. We initially theoretically explained why fading would cause severe noise in the demodulated phase of Φ-OTDR; then M-degree summation of incoherent scattered light-waves is studied for the purpose of eliminating fading. Finally, the gain of the retrieved phase signal-to-noise-ratio and its fluctuations were analytically derived and experimentally verified. This work provides a guideline for fading elimination in one-dimension optical scatters, and it also provides insight for optical imaging and wireless telecommunication.

eess.SP↗

arXiv2018

Towards Understanding Learning Representations: To What Extent Do Different Neural Networks Learn the Same Representation

It is widely believed that learning good representations is one of the main reasons for the success of deep neural networks. Although highly intuitive, there is a lack of theory and systematic approach quantitatively characterizing what representations do deep neural networks learn. In this work, we move a tiny step towards a theory and better understanding of the representations. Specifically, we study a simpler problem: How similar are the representations learned by two networks with identical architecture but trained from different initializations. We develop a rigorous theory based on the neuron activation subspace match model. The theory gives a complete characterization of the structure of neuron activation subspace matches, where the core concepts are maximum match and simple match which describe the overall and the finest similarity between sets of neurons in two networks respectively. We also propose efficient algorithms to find the maximum match and simple matches. Finally, we conduct extensive experiments using our algorithms. Experimental results suggest that, surprisingly, representations learned by the same convolutional layers of networks trained from different initializations are not as similar as prevalently expected, at least in terms of subspace match.

cs.LG↗

arXiv2018

Research on CRO's Dilemma In Sapiens Chain: A Game Theory Method

In recent years, blockchain-based techniques have been widely used in cybersecurity, owing to the decentralization, anonymity, credibility and not be tampered properties of the blockchain. As one of the decentralized framework, Sapiens Chain was proposed to protect cybersecurity by scheduling the computational resources dynamically, which were owned by Computational Resources Owners (CROs). However, when CROs in the same pool attack each other, all CROs will earn less. In this paper, we tackle the problem of prisoner's dilemma from the perspective of CROs. We first define a game that a CRO infiltrates another pool and perform an attack. In such game, the honest CRO can control the payoffs and increase its revenue. By simulating this game, we propose to apply Zero Determinant (ZD) strategy on strategy decision, which can be categorized into cooperation and defecting. Our experimental results demonstrate the effectiveness of the proposed strategy decision method.

cs.GT↗

arXiv2018

Image-to-GPS Verification Through A Bottom-Up Pattern Matching Network

The image-to-GPS verification problem asks whether a given image is taken at a claimed GPS location. In this paper, we treat it as an image verification problem -- whether a query image is taken at the same place as a reference image retrieved at the claimed GPS location. We make three major contributions: 1) we propose a novel custom bottom-up pattern matching (BUPM) deep neural network solution; 2) we demonstrate that the verification can be directly done by cross-checking a perspective-looking query image and a panorama reference image, and 3) we collect and clean a dataset of 30K pairs query and reference. Our experimental results show that the proposed BUPM solution outperforms the state-of-the-art solutions in terms of both verification and localization.

cs.CV↗

arXiv2018

GD-1: the relic of an old metal-poor globular cluster

Combining data from Gaia DR2, SDSS DR14 and LAMOST DR6, we update the fit to model of the properties of the stellar stream GD-1 and find that it has an age of $\sim 13$ Gyr, [Fe/H] of $-2.2\pm 0.12$, and a distance from the sun of $\sim 8$ kpc. We tabulate 6D phase-space fiducial points along the GD-1 stream orbit over a 90$^\circ$ arc. The fitted orbit shows that the stream has an eccentricity $e \sim 0.3$, perigalacticon of 14.2 kpc, apogalacticon of 27.0 kpc and inclination $i \sim 40^{\circ}$. There is evidence along the arc for 4 candidate stellar overdensities, one candidate gap, two candidate stellar underdensities and is cut off at $ϕ_1 \sim 2^{\circ}$ (in the stream-aligned $(ϕ_1,ϕ_2)$ coordinate system of \citet{kop10}). The spur originating at $ϕ_1 \sim -40^{\circ}$ implies stars were pulled away from the stream trace by an encounter (potentially a dark matter subhalo). The narrowest place ( FWHM $\sim 44.6$ pc) of the GD-1 trace is at $(ϕ_1, ϕ_2^c) \sim (-14^{\circ}, 0.15^{\circ})$, which is $\sim (178.18^{\circ}, 52.19^{\circ})$ in (R. A., Decl.), where the progenitor is possibly located. We also find six BHB and 10 BS spectroscopic stars in the GD-1 stream.

astro-ph.GA↗

arXiv2018

Bidirectional Conditional Generative Adversarial Networks

Conditional Generative Adversarial Networks (cGANs) are generative models that can produce data samples ($x$) conditioned on both latent variables ($z$) and known auxiliary information ($c$). We propose the Bidirectional cGAN (BiCoGAN), which effectively disentangles $z$ and $c$ in the generation process and provides an encoder that learns inverse mappings from $x$ to both $z$ and $c$, trained jointly with the generator and the discriminator. We present crucial techniques for training BiCoGANs, which involve an extrinsic factor loss along with an associated dynamically-tuned importance weight. As compared to other encoder-based cGANs, BiCoGANs encode $c$ more accurately, and utilize $z$ and $c$ more effectively and in a more disentangled way to generate samples.

cs.LG↗

arXiv2018

Spatial-Temporal Densely Connected Convolutional Networks: An Application to CO2 Leakage Detection

In carbon capture and sequestration, building an effective monitoring method is a crucial step to detect and respond to CO2 leakage. CO2 leakage detection methods rely on geophysical observations and monitoring sensor network. However, traditional methods usually require physical models to be interpreted by experts, and the accuracy of these methods will be restricted by different application conditions. In this paper, we develop a novel data-driven detection method based on densely connected convolutional networks. Our detection method learns a mapping relation between seismic data and the CO2 leakage mass. To account for the spatial and temporal characteristics of seismic data, we design a novel network architecture by combining 1-D and 2-D convolutional neural networks together. To overcome the expensive computational cost, we further apply a densely-connecting policy to our network architecture to reduce the network parameters. We employ our detection method to synthetic seismic datasets using Kimberlina model. The numerical results show that our leakage detection method accurately detects the leakage mass. Therefore, our novel CO2 leakage detection method has great potential for monitoring CO2 storage.

physics.geo-ph↗

arXiv2018

LAMOST observations in the Kepler field. II. Database of the low-resolution spectra from the five-year regular survey

The LAMOST-Kepler (LK-) project was initiated to use the Large Sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST) to make spectroscopic follow-up observations for the targets in the field of the Kepler mission. The Kepler field is divided into 14 subfields that are adapted to the LAMOST circular field with a diameter of 5 degrees. During the regular survey phase of LAMOST, the LK-project took data from 2012 June to 2017 June and covered all the 14 subfields at least twice. In particular, we describe in this paper the second Data Release of the LK-project, including all spectra acquired through 2015 May to 2017 June together with the first round observations of the LK-project from 2012 June to 2014 September. The LK-project now counts 227 870 spectra of 156 390 stars, among which we have derived atmospheric parameters (log g, T eff and [Fe/H]) and heliocentric radial velocity (RV) for 173 971 spectra of 126 172 stars. These parameters were obtained with the most recent version of the LAMOST Stellar Parameter Pipeline v 2.9.7. Nearly one half, namely 76 283 targets, are observed both by LAMOST and Kepler telescopes. These spectra, establishing a large spectroscopy library, will be useful for the entire astronomical community, particularly for planetary science and stellar variability on Kepler targets.

astro-ph.SR↗

arXiv2018

CapsuleGAN: Generative Adversarial Capsule Network

We present Generative Adversarial Capsule Network (CapsuleGAN), a framework that uses capsule networks (CapsNets) instead of the standard convolutional neural networks (CNNs) as discriminators within the generative adversarial network (GAN) setting, while modeling image data. We provide guidelines for designing CapsNet discriminators and the updated GAN objective function, which incorporates the CapsNet margin loss, for training CapsuleGAN models. We show that CapsuleGAN outperforms convolutional-GAN at modeling image data distribution on MNIST and CIFAR-10 datasets, evaluated on the generative adversarial metric and at semi-supervised image classification.

stat.ML↗

arXiv2018

Unsupervised Adversarial Invariance

Data representations that contain all the information about target variables but are invariant to nuisance factors benefit supervised learning algorithms by preventing them from learning associations between these factors and the targets, thus reducing overfitting. We present a novel unsupervised invariance induction framework for neural networks that learns a split representation of data through competitive training between the prediction task and a reconstruction task coupled with disentanglement, without needing any labeled information about nuisance factors or domain knowledge. We describe an adversarial instantiation of this framework and provide analysis of its working. Our unsupervised model outperforms state-of-the-art methods, which are supervised, at inducing invariance to inherent nuisance factors, effectively using synthetic data augmentation to learn invariance, and domain adaptation. Our method can be applied to any prediction task, eg., binary/multi-class classification or regression, without loss of generality.

cs.LG↗

arXiv2018

Time stamps of vertical phase mixing in the Galactic disk from LAMOST-Gaia stars

The perturbation mechanism of the Galactic disk has puzzled us for a long time. The imprints from perturbations provide important diagnostics on the disk formation and evolution. Here we try to constrain when the vertical perturbation took place in the disk by tracking the phase mixing history. Firstly, we clearly depict the spiral structures of radial ($v_R$) and azimuthal ($v_ϕ$) velocities in the phase space of the vertical position and velocity ($z$-$v_z$) with 723,871 LAMOST-Gaia combined stars. Then, we investigate the variation of the spirals with stellar age ($τ$) by dividing the sample into seven stellar age bins. Finally, we find that the spirals explicitly exist in all the bins, even in the bin of $τ<0.5$\,Gyr, except for the bin of $τ>6.0$\,Gyr. This constrains the vertical perturbation probably starting no later than 0.5\,Gyr ago. But we can not rule out whether the young stars ($τ<0.5$\,Gyr) inherit the oscillations from the perturbed ISM where they born from. This study provides some important observational evidences to understand the disk perturbation mechanisms, even the formation and evolution of our Galaxy.

astro-ph.GA↗

arXiv2018

Energy Efficient and Fair Resource Allocation for LTE-Unlicensed Uplink Networks: A Two-sided Matching Approach with Partial Information

LTE-Unlicensed (LTE-U) has recently attracted worldwide interest to meet the explosion in cellular traffic data. By using carrier aggregation (CA), licensed and unlicensed bands are integrated to enhance transmission capacity while maintaining reliable and predictable performance. As there may exist other conventional unlicensed band users, such as Wi-Fi users, LTE-U users have to share the same unlicensed bands with them. Thus, an optimized resource allocation scheme to ensure the fairness between LTE-U users and conventional unlicensed band users is critical for the deployment of LTE-U networks. In this paper, we investigate an energy efficient resource allocation problem in LTE-U coexisting with other wireless networks, which aims at guaranteeing fairness among the users of different radio access networks (RANs). We formulate the problem as a multi-objective optimization problem and propose a semi-distributed matching framework with a partial information-based algorithm to solve it. We demonstrate our contributions with simulations in which various network densities and traffic load levels are considered.

cs.IT↗

arXiv2018

Deep Multimodal Image-Repurposing Detection

Nefarious actors on social media and other platforms often spread rumors and falsehoods through images whose metadata (e.g., captions) have been modified to provide visual substantiation of the rumor/falsehood. This type of modification is referred to as image repurposing, in which often an unmanipulated image is published along with incorrect or manipulated metadata to serve the actor's ulterior motives. We present the Multimodal Entity Image Repurposing (MEIR) dataset, a substantially challenging dataset over that which has been previously available to support research into image repurposing detection. The new dataset includes location, person, and organization manipulations on real-world data sourced from Flickr. We also present a novel, end-to-end, deep multimodal learning model for assessing the integrity of an image by combining information extracted from the image with related information from a knowledge base. The proposed method is compared against state-of-the-art techniques on existing datasets as well as MEIR, where it outperforms existing methods across the board, with AUC improvement up to 0.23.

cs.MM↗

arXiv2018

The Coming Era of AlphaHacking? A Survey of Automatic Software Vulnerability Detection, Exploitation and Patching Techniques

With the success of the Cyber Grand Challenge (CGC) sponsored by DARPA, the topic of Autonomous Cyber Reasoning System (CRS) has recently attracted extensive attention from both industry and academia. Utilizing automated system to detect, exploit and patch software vulnerabilities seems so attractive because of its scalability and cost-efficiency compared with the human expert based solution. In this paper, we give an extensive survey of former representative works related to the underlying technologies of a CRS, including vulnerability detection, exploitation and patching. As an important supplement, we then review several pioneer studies that explore the potential of machine learning technologies in this field, and point out that the future development of Autonomous CRS is inseparable from machine learning.

cs.CR↗

arXiv2018

Predictive Local Smoothness for Stochastic Gradient Methods

Stochastic gradient methods are dominant in nonconvex optimization especially for deep models but have low asymptotical convergence due to the fixed smoothness. To address this problem, we propose a simple yet effective method for improving stochastic gradient methods named predictive local smoothness (PLS). First, we create a convergence condition to build a learning rate which varies adaptively with local smoothness. Second, the local smoothness can be predicted by the latest gradients. Third, we use the adaptive learning rate to update the stochastic gradients for exploring linear convergence rates. By applying the PLS method, we implement new variants of three popular algorithms: PLS-stochastic gradient descent (PLS-SGD), PLS-accelerated SGD (PLS-AccSGD), and PLS-AMSGrad. Moreover, we provide much simpler proofs to ensure their linear convergence. Empirical results show that the variants have better performance gains than the popular algorithms, such as, faster convergence and alleviating explosion and vanish of gradients.

cs.LG↗