arXiv subjects

Yan Liu

Publications and source records attributed to Yan Liu.

At least 451 records · Page 25Linked to original sources

arXiv2017

A Novel Convolutional Neural Network for Image Steganalysis with Shared Normalization

Deep learning based image steganalysis has attracted increasing attentions in recent years. Several Convolutional Neural Network (CNN) models have been proposed and achieved state-of-the-art performances on detecting steganography. In this paper, we explore an important technique in deep learning, the batch normalization, for the task of image steganalysis. Different from natural image classification, steganalysis is to discriminate cover images and stego images which are the result of adding weak stego signals into covers. This characteristic makes a cover image is more statistically similar to its stego than other cover images, requiring steganalytic methods to use paired learning to extract effective features for image steganalysis. Our theoretical analysis shows that a CNN model with multiple normalization layers is hard to be generalized to new data in the test set when it is well trained with paired learning. To hand this difficulty, we propose a novel normalization technique called Shared Normalization (SN) in this paper. Unlike the batch normalization layer utilizing the mini-batch mean and standard deviation to normalize each input batch, SN shares same statistics for all training and test batches. Based on the proposed SN layer, we further propose a novel neural network model for image steganalysis. Extensive experiments demonstrate that the proposed network with SN layers is stable and can detect the state of the art steganography with better performances than previous methods.

cs.MM↗

arXiv2017

Tensor Regression Meets Gaussian Processes

Low-rank tensor regression, a new model class that learns high-order correlation from data, has recently received considerable attention. At the same time, Gaussian processes (GP) are well-studied machine learning models for structure learning. In this paper, we demonstrate interesting connections between the two, especially for multi-way data analysis. We show that low-rank tensor regression is essentially learning a multi-linear kernel in Gaussian processes, and the low-rank assumption translates to the constrained Bayesian inference problem. We prove the oracle inequality and derive the average case learning curve for the equivalent GP model. Our finding implies that low-rank tensor regression, though empirically successful, is highly dependent on the eigenvalues of covariance functions as well as variable correlations.

cs.LG↗

arXiv2017

Benchmark of Deep Learning Models on Large Healthcare MIMIC Datasets

Deep learning models (aka Deep Neural Networks) have revolutionized many fields including computer vision, natural language processing, speech recognition, and is being increasingly used in clinical healthcare applications. However, few works exist which have benchmarked the performance of the deep learning models with respect to the state-of-the-art machine learning models and prognostic scoring systems on publicly available healthcare datasets. In this paper, we present the benchmarking results for several clinical prediction tasks such as mortality prediction, length of stay prediction, and ICD-9 code group prediction using Deep Learning models, ensemble of machine learning models (Super Learner algorithm), SAPS II and SOFA scores. We used the Medical Information Mart for Intensive Care III (MIMIC-III) (v1.4) publicly available dataset, which includes all patients admitted to an ICU at the Beth Israel Deaconess Medical Center from 2001 to 2012, for the benchmarking tasks. Our results show that deep learning models consistently outperform all the other approaches especially when the `raw' clinical time series data is used as input features to the models.

cs.LG↗

arXiv2017

Boosting Deep Learning Risk Prediction with Generative Adversarial Networks for Electronic Health Records

The rapid growth of Electronic Health Records (EHRs), as well as the accompanied opportunities in Data-Driven Healthcare (DDH), has been attracting widespread interests and attentions. Recent progress in the design and applications of deep learning methods has shown promising results and is forcing massive changes in healthcare academia and industry, but most of these methods rely on massive labeled data. In this work, we propose a general deep learning framework which is able to boost risk prediction performance with limited EHR data. Our model takes a modified generative adversarial network namely ehrGAN, which can provide plausible labeled EHR data by mimicking real patient records, to augment the training dataset in a semi-supervised learning manner. We use this generative model together with a convolutional neural network (CNN) based prediction model to improve the onset prediction performance. Experiments on two real healthcare datasets demonstrate that our proposed framework produces realistic data samples and achieves significant improvements on classification tasks with the generated data over several stat-of-the-art baselines.

cs.LG↗

arXiv2017

CSI: A Hybrid Deep Model for Fake News Detection

The topic of fake news has drawn attention both from the public and the academic communities. Such misinformation has the potential of affecting public opinion, providing an opportunity for malicious parties to manipulate the outcomes of public events such as elections. Because such high stakes are at play, automatically detecting fake news is an important, yet challenging problem that is not yet well understood. Nevertheless, there are three generally agreed upon characteristics of fake news: the text of an article, the user response it receives, and the source users promoting it. Existing work has largely focused on tailoring solutions to one particular characteristic which has limited their success and generality. In this work, we propose a model that combines all three characteristics for a more accurate and automated prediction. Specifically, we incorporate the behavior of both parties, users and articles, and the group behavior of users who propagate fake news. Motivated by the three characteristics, we propose a model called CSI which is composed of three modules: Capture, Score, and Integrate. The first module is based on the response and text; it uses a Recurrent Neural Network to capture the temporal pattern of user activity on a given article. The second module learns the source characteristic based on the behavior of users, and the two are integrated with the third module to classify an article as fake or not. Experimental analysis on real-world data demonstrates that CSI achieves higher accuracy than existing models, and extracts meaningful latent representations of both users and articles.

cs.LG↗

arXiv2017

On Unifying Multi-View Self-Representations for Clustering by Tensor Multi-Rank Minimization

In this paper, we address the multi-view subspace clustering problem. Our method utilizes the circulant algebra for tensor, which is constructed by stacking the subspace representation matrices of different views and then rotating, to capture the low rank tensor subspace so that the refinement of the view-specific subspaces can be achieved, as well as the high order correlations underlying multi-view data can be explored.} By introducing a recently proposed tensor factorization, namely tensor-Singular Value Decomposition (t-SVD) \cite{kilmer13}, we can impose a new type of low-rank tensor constraint on the rotated tensor to capture the complementary information from multiple views. Different from traditional unfolding based tensor norm, this low-rank tensor constraint has optimality properties similar to that of matrix rank derived from SVD, so the complementary information among views can be explored more efficiently and thoroughly. The established model, called t-SVD based Multi-view Subspace Clustering (t-SVD-MSC), falls into the applicable scope of augmented Lagrangian method, and its minimization problem can be efficiently solved with theoretical convergence guarantee and relatively low computational complexity. Extensive experimental testing on eight challenging image dataset shows that the proposed method has achieved highly competent objective performance compared to several state-of-the-art multi-view clustering methods.

cs.CV↗

arXiv2017

Cross-symmetry breaking of two-component discrete dipolar matter-wave solitons

We study the spontaneous symmetry breaking of dipolar Bose--Einstein condensates trapped in stacks of two-well systems, which may be effectively built as one-dimensional trapping lattices sliced by a repelling laser sheet. If the potential wells are sufficiently deep, the system is modeled by coupled discrete Gross--Pitaevskii equations with nonlocal self- and cross-interaction terms representing dipole--dipole interactions. When the dipoles are not polarized perpendicular or parallel to the lattice, the cross-interaction is asymmetric, replacing the familiar symmetric two-component solitons with a new species of cross-symmetric or -asymmetric ones. The orientation of the dipole moments and the interwell hopping rate strongly affect the shapes of the discrete two-component solitons as well as the characteristics of the cross-symmetry breaking and the associated phase transition. The sub- and super-critical types of cross-symmetry breaking can be controlled by either the hopping rate between the components or the total norm of the solitons. The effect of the interplay between the contact nonlinearity and the dipole angle on the cross-symmetry breaking is also discussed.

nlin.PS↗

arXiv2017

Trace codes over $\Z_4$ and Boolean function

We construct trace codes over $\Z_4$ by using Boolean functions and skew sets, respectively. Their Lee weight distribution is studied by using a Galois ring version of the Walsh-Hadamard transform and exponential sums. We obtain a new family of optimal two-weight codes over $\Z_4.$

cs.IT↗

arXiv2017

Complex wavefront engineering with disorder-engineered metasurfaces

Recently, complex wavefront engineering with disordered media has demonstrated optical manipulation capabilities beyond those of conventional optics. These capabilities include extended volume, aberration-free focusing and subwavelength focusing via evanescent mode coupling. However, translating these capabilities to useful applications has remained challenging as the input-output characteristics of the disordered media ($P$ variables) need to be exhaustively determined via $O(P)$ measurements. Here, we propose a paradigm shift where the disorder is specifically designed so that its exact characteristics are known, resulting in an a priori determined transmission matrix that can be utilized with only a few alignment steps. We implement this concept with a disorder-engineered metasurface, which exhibits additional unique features for complex wavefront engineering such as an unprecedented optical memory effect range, excellent stability, and a tailorable angular scattering profile.

physics.optics↗

arXiv2017

Two-dimensional dipolar gap solitons in free space with spin-orbit coupling

We present gap solitons (GSs) that can be created in free nearly two-dimensional (2D) space in dipolar spinor Bose-Einstein condensates with the spin-orbit coupling (SOC), subject to tight confinement, with size $a_{\perp }$, in the third direction. For quasi-2D patterns, with lateral sizes $l\gg a_{\perp }$, the kinetic-energy terms in the respective spinor Gross-Pitaevskii equations may be neglected in comparison with SOC. This gives rise to a bandgap in the system's spectrum, in the presence of the Zeeman splitting between the spinor components. While the present system with contact interactions does not produce 2D solitons, stable gap solitons(GSs), with vorticities $0$ and $1$ in the two components, are found, in quasi-analytical and numerical forms, under the action of dipole-dipole interaction (DDI). Namely, isotropic and anisotropic 2D GSs are obtained when the dipoles are polarized, respectively, perpendicular or parallel to the 2D plane. The GS families extend, as \textit{embedded solitons} (ESs), into spectral bands, a part of the ES branch being stable for isotropic solitons. The GSs remain stable if the competing contact interaction, with the sign opposite to that of the DDI, is included, while the addition of the contact term with the same sign destabilizes the GSs, at first replacing them by breathers, and eventually leading to destruction of the solitons. Mobility and collision of the GSs are studied too, revealing negative and positive effective masses of the isotropic and anisotropic solitons, respectively.

cond-mat.quant-gas↗

arXiv2017

Spatially modulated instabilities of holographic gauge-gravitational anomaly

We performed a study of the perturbative instabilities in Einstein-Maxwell-Chern-Simons theory with a gravitational Chern-Simons term, which is dual to a strongly coupled field theory with both chiral and mixed gauge-gravitational anomaly. With an analysis of the fluctuations in the near horizon regime at zero temperature, we found that there might be two possible sources of instabilities. The first one corresponds to a real mass-squared which is below the BF bound of AdS$_2$, and it leads to the bell-curve phase diagram at finite temperature. The effect of mixed gauge-gravitational anomaly is emphasised. Another source of instability is independent of gauge Chern-Simons coupling and exists for any finite gravitational Chern-Simons coupling. There is a singular momentum close to which unstable mode appears. The possible implications of this singular momentum are discussed. Our analysis suggests that the theory with a gravitational Chern-Simons term around Reissner-Nordström black hole is unreliable unless the gravitational Chern-Simons coupling is treated as a small perturbative parameter.

hep-th↗

arXiv2017

A Methodology of Guiding Web Content Mining and Knowledge Discovery in Evidence-based Software Engineering

Systematic Literature Review (SLR) is a rigorous methodology applied for Evidence-Based Software Engineering (EBSE) that identify, assess and synthesize the relevant evidence for answering specific research questions. Benefiting from the booming online materials in the era of Web 2.0, the technical Web content starts acting as alternative sources for EBSE. Web knowledge has been investigated and derived from Web content mining and knowledge discovery techniques, however they are still significantly different from reviewing academic literature. Thus the direct adoption of Web knowledge in EBSE lacks of systematic guidelines. In this paper, we propose to make an SLR adaptation to bridge the aforementioned gap along two stages. Firstly, we follow the general logic and procedure of SLR to regulate Web mining activities. Secondly, we substitute and enhance particular SLR processes with Web-mining-friendly methods and approaches. At the second stage, we mainly focus on adapting Conducting Review by integrating a set of automated components ranging from programmatic searching to various text mining techniques.

cs.SE↗

arXiv2017

CNN based music emotion classification

Music emotion recognition (MER) is usually regarded as a multi-label tagging task, and each segment of music can inspire specific emotion tags. Most researchers extract acoustic features from music and explore the relations between these features and their corresponding emotion tags. Considering the inconsistency of emotions inspired by the same music segment for human beings, seeking for the key acoustic features that really affect on emotions is really a challenging task. In this paper, we propose a novel MER method by using deep convolutional neural network (CNN) on the music spectrograms that contains both the original time and frequency domain information. By the proposed method, no additional effort on extracting specific features required, which is left to the training procedure of the CNN model. Experiments are conducted on the standard CAL500 and CAL500exp dataset. Results show that, for both datasets, the proposed method outperforms state-of-the-art methods.

cs.MM↗

arXiv2017

Cross-symmetric dipolar-matter-wave solitons in double-well chains

We consider a dipolar Bose-Einstein condensate trapped in an array of two-well systems with an arbitrary orientations of the dipoles relative to the system's axis. The system can be built as a chain of local traps sliced into two parallel lattices by a repelling laser sheet. It is modelled by a pair of coupled discrete Gross-Pitaevskii equations, with dipole-dipole self- and cross-interactions. When the dipoles are not polarized perpendicular or parallel to the lattice, the cross-interaction is asymmetric, replacing the familiar symmetric two-component discrete solitons by two new species of cross-symmetric ones, on-site- and off-site-centered, which are strongly affected by the orientation of the dipoles and separation between the parallel lattices. A very narrow region of intermediate asymmetric discrete solitons is found at the boundary between the on- and off-site families. Two different types of solitons in the $\mathcal{PT}$%-symmetric version of the system are constructed too, and stability areas are identified for them.

cond-mat.quant-gas↗

arXiv2017

Origin of the phase change from pyrochlore to perovskite-like layered structure and a new lead free ferroelectric

Materials with formula of A2B2O7 is a famous family with more than 300 compounds, and have abundant properties, like ferroelectric, multiferroic, and photocatalyst properties, etc. Generally, two structures dominate this family, which are pyrochlore and perovskite-like layered (PL) structure. Previously, the structure and properties design of these materials are usually complex, and solid solutions, which complicates the manufacture, as well as introducing complexity in the study of the microscopic origins of the properties. Here, we report that the pyrochlore-PL structure change happened in pure Eu2Ti2O7 under high pressure and temperature, and the formed PL structure will transfer back by heating. These results reveal that the PL structure formed in PL-pyrochlore solid solutions, is due to tuning of the high-pressure formed PL structure in pure pyrochlore compounds to ambient pressure. These results indicate the high pressure and high temperature can be used to manipulate the crystal structures from pyrochlore to PL structure, or vice versa. Furthermore, the PL Eu2Ti2O7 was confirmed as a lead free ferroelectric material for the first time.

cond-mat.mtrl-sci↗

arXiv2017

Exploiting Convolutional Neural Network for Risk Prediction with Medical Feature Embedding

The widespread availability of electronic health records (EHRs) promises to usher in the era of personalized medicine. However, the problem of extracting useful clinical representations from longitudinal EHR data remains challenging. In this paper, we explore deep neural network models with learned medical feature embedding to deal with the problems of high dimensionality and temporality. Specifically, we use a multi-layer convolutional neural network (CNN) to parameterize the model and is thus able to capture complex non-linear longitudinal evolution of EHRs. Our model can effectively capture local/short temporal dependency in EHRs, which is beneficial for risk prediction. To account for high dimensionality, we use the embedding medical features in the CNN model which hold the natural medical concepts. Our initial experiments produce promising results and demonstrate the effectiveness of both the medical feature embedding and the proposed convolutional neural network in risk prediction on cohorts of congestive heart failure and diabetes patients compared with several strong baselines.

cs.LG↗

arXiv2017

Regular approximations of spectra of singular discrete linear Hamiltonian systems with one singular endpoint?

This paper is concerned with regular approximations of spectra of singular discrete linear Hamiltonian systems with one singular endpoint. For any given self-adjoint subspace extension (SSE) of the corresponding minimal subspace, its spectrum can be approximated by eigenvalues of a sequence of induced regular SSEs, generated by the same difference expression on smaller finite intervals. It is shown that every SSE of the minimal subspace has a pure discrete spectrum, and the k-th eigenvalue of any given SSE is exactly the limit of the k-th eigenvalues of the induced regular SSEs; that is, spectral exactness holds, in the limit circle case. Furthermore, error estimates for the approximations of eigenvalues are given in this case. In addition, in the limit point and intermediate cases, spectral inclusive holds.

math.SP↗

arXiv2016

Change point detection in autoregressive models with no moment assumptions

In this paper we consider the problem of detecting a change in the parameters of an autoregressive process, where the moments of the innovation process do not necessarily exist. An empirical likelihood ratio test for the existence of a change point is proposed and its asymptotic properties are studied. In contrast to other work on change point tests using empirical likelihood, we do not assume knowledge of the location of the change point. In particular, we prove that the maximizer of the empirical likelihood is a consistent estimator for the parameters of the autoregressive model in the case of no change point and derive the limiting distribution of the corresponding test statistic under the null hypothesis. We also establish consistency of the new test. A nice feature of the method consists in the fact that the resulting test is asymptotically distribution free and does not require an estimate of the long run variance. The asymptotic properties of the test are investigated by means of a small simulation study, which demonstrates good finite sample properties of the proposed method.

math.ST↗