arXiv subjects

Jie Chen

Publications and source records attributed to Jie Chen.

At least 559 records · Page 31Linked to original sources

arXiv2020

Hyperspectral Unmixing via Nonnegative Matrix Factorization with Handcrafted and Learnt Priors

Nowadays, nonnegative matrix factorization (NMF) based methods have been widely applied to blind spectral unmixing. Introducing proper regularizers to NMF is crucial for mathematically constraining the solutions and physically exploiting spectral and spatial properties of images. Generally, properly handcrafting regularizers and solving the associated complex optimization problem are non-trivial tasks. In our work, we propose an NMF based unmixing framework which jointly uses a handcrafting regularizer and a learnt regularizer from data. we plug learnt priors of abundances where the associated subproblem can be addressed using various image denoisers, and we consider an l_2,1-norm regularizer to the abundance matrix to promote sparse unmixing results. The proposed framework is flexible and extendable. Both synthetic data and real airborne data are conducted to confirm the effectiveness of our method.

cs.CV↗

arXiv2020

The 1st Tiny Object Detection Challenge:Methods and Results

The 1st Tiny Object Detection (TOD) Challenge aims to encourage research in developing novel and accurate methods for tiny object detection in images which have wide views, with a current focus on tiny person detection. The TinyPerson dataset was used for the TOD Challenge and is publicly released. It has 1610 images and 72651 box-levelannotations. Around 36 participating teams from the globe competed inthe 1st TOD Challenge. In this paper, we provide a brief summary of the1st TOD Challenge including brief introductions to the top three methods.The submission leaderboard will be reopened for researchers that areinterested in the TOD challenge. The benchmark dataset and other information can be found at: https://github.com/ucas-vg/TinyBenchmark.

cs.CV↗

arXiv2020

Deep Coarse-to-fine Dense Light Field Reconstruction with Flexible Sampling and Geometry-aware Fusion

A densely-sampled light field (LF) is highly desirable in various applications, such as 3-D reconstruction, post-capture refocusing and virtual reality. However, it is costly to acquire such data. Although many computational methods have been proposed to reconstruct a densely-sampled LF from a sparsely-sampled one, they still suffer from either low reconstruction quality, low computational efficiency, or the restriction on the regularity of the sampling pattern. To this end, we propose a novel learning-based method, which accepts sparsely-sampled LFs with irregular structures, and produces densely-sampled LFs with arbitrary angular resolution accurately and efficiently. We also propose a simple yet effective method for optimizing the sampling pattern. Our proposed method, an end-to-end trainable network, reconstructs a densely-sampled LF in a coarse-to-fine manner. Specifically, the coarse sub-aperture image (SAI) synthesis module first explores the scene geometry from an unstructured sparsely-sampled LF and leverages it to independently synthesize novel SAIs, in which a confidence-based blending strategy is proposed to fuse the information from different input SAIs, giving an intermediate densely-sampled LF. Then, the efficient LF refinement module learns the angular relationship within the intermediate result to recover the LF parallax structure. Comprehensive experimental evaluations demonstrate the superiority of our method on both real-world and synthetic LF images when compared with state-of-the-art methods. In addition, we illustrate the benefits and advantages of the proposed approach when applied in various LF-based applications, including image-based rendering and depth estimation enhancement.

eess.IV↗

arXiv2020

Automatic Detection and Correction Algorithms for Magnetic Saturation in the SMFT/HSOS longitudinal Magnetograms

longitudinal magnetic field often suffers the saturation effect in strong magnetic field region when the measurement performs in a single-wavelength point and linear calibration is adopted. In this study, we develop a method that can judge the threshold of saturation in Stokes $V/I$ observed by the Solar Magnetic Field Telescope (SMFT) and correct for it automatically. The procedure is that first perform the second-order polynomial fit to the Stokes $V/I$ \textit{vs} $I/I_{m}$ ($I_{m}$ is the maximum value of Stokes $I$) curve to estimate the threshold of saturation, then reconstruct Stokes $V/I$ in strong field region to correct for saturation. The algorithm is proved to be effective by comparing with the magnetograms obtained by the Helioseismic and Magnetic Imager (HMI). The accurate rate of detection and correction for saturation is $\sim$99.4\% and $\sim$88\% respectively among 175 active regions. The advantages and disadvantages of the algorithm are discussed.

astro-ph.SR↗

arXiv2020

Automated discovery of a robust interatomic potential for aluminum

Accuracy of molecular dynamics simulations depends crucially on the interatomic potential used to generate forces. The gold standard would be first-principles quantum mechanics (QM) calculations, but these become prohibitively expensive at large simulation scales. Machine learning (ML) based potentials aim for faithful emulation of QM at drastically reduced computational cost. The accuracy and robustness of an ML potential is primarily limited by the quality and diversity of the training dataset. Using the principles of active learning (AL), we present a highly automated approach to dataset construction. The strategy is to use the ML potential under development to sample new atomic configurations and, whenever a configuration is reached for which the ML uncertainty is sufficiently large, collect new QM data. Here, we seek to push the limits of automation, removing as much expert knowledge from the AL process as possible. All sampling is performed using MD simulations starting from an initially disordered configuration, and undergoing non-equilibrium dynamics as driven by time-varying applied temperatures. We demonstrate this approach by building an ML potential for aluminum (ANI-Al). After many AL iterations, ANI-Al teaches itself to predict properties like the radial distribution function in melt, liquid-solid coexistence curve, and crystal properties such as defect energies and barriers. To demonstrate transferability, we perform a 1.3M atom shock simulation, and show that ANI-Al predictions agree very well with DFT calculations on local atomic environments sampled from the nonequilibrium dynamics. Interestingly, the configurations appearing in shock appear to have been well sampled in the AL training dataset, in a way that we illustrate visually.

cond-mat.mtrl-sci↗

arXiv2020

Multi-wavelength Observation of a Failed Eruption from a Helical Kink-unstable Prominence

Multi-wavelength observations of prominence eruptions provide an opportunity to uncover the physical mechanism of the triggering and the evolution process of the eruption. In this paper, we investigated an erupting prominence on October 14, 2012, recorded in Hα, EUV, and X-ray wavelengths. The process of the eruption gives evidences on the existence of a helical magnetic structure and showing the twist being converting to writhe. The estimated twist is ~6π (3 turns), exceeding the threshold of the kink instability. The rising plasma then reached a high speed, estimated at 228 km s-1, followed by a sudden rapid acceleration at 2715 m s-2, and synchronous with a solar are. Co-spatial cusp shaped structures were observed in both AIA 131Å and 94Å images, signifying the location of the magnetic reconnection. The erupted flux rope finally undergone a deceleration with a maximum value of 391 m s-2, which is even larger than the free-fall acceleration on the Sun (273 m s-2) , suggesting that the eruption finally failed, possibly due to an inward magnetic tension force.

astro-ph.SR↗

arXiv2020

Chart Auto-Encoders for Manifold Structured Data

Deep generative models have made tremendous advances in image and signal representation learning and generation. These models employ the full Euclidean space or a bounded subset as the latent space, whose flat geometry, however, is often too simplistic to meaningfully reflect the manifold structure of the data. In this work, we advocate the use of a multi-chart latent space for better data representation. Inspired by differential geometry, we propose a \textbf{Chart Auto-Encoder (CAE)} and prove a universal approximation theorem on its representation capability. We show that the training data size and the network size scale exponentially in approximation error with an exponent depending on the intrinsic dimension of the data manifold. CAE admits desirable manifold properties that auto-encoders with a flat latent space fail to obey, predominantly proximity of data. We conduct extensive experimentation with synthetic and real-life examples to demonstrate that CAE provides reconstruction with high fidelity, preserves proximity in the latent space, and generates new data remaining near the manifold. These experiments show that CAE is advantageous over existing auto-encoders and variants by preserving the topology of the data manifold as well as its geometry.

cs.LG↗

arXiv2020

Deep Learning Methods for Solving Linear Inverse Problems: Research Directions and Paradigms

The linear inverse problem is fundamental to the development of various scientific areas. Innumerable attempts have been carried out to solve different variants of the linear inverse problem in different applications. Nowadays, the rapid development of deep learning provides a fresh perspective for solving the linear inverse problem, which has various well-designed network architectures results in state-of-the-art performance in many applications. In this paper, we present a comprehensive survey of the recent progress in the development of deep learning for solving various linear inverse problems. We review how deep learning methods are used in solving different linear inverse problems, and explore the structured neural network architectures that incorporate knowledge used in traditional methods. Furthermore, we identify open challenges and potential future directions along this research line.

eess.SP↗

arXiv2020

Light Field Super-resolution via Attention-Guided Fusion of Hybrid Lenses

This paper explores the problem of reconstructing high-resolution light field (LF) images from hybrid lenses, including a high-resolution camera surrounded by multiple low-resolution cameras. To tackle this challenge, we propose a novel end-to-end learning-based approach, which can comprehensively utilize the specific characteristics of the input from two complementary and parallel perspectives. Specifically, one module regresses a spatially consistent intermediate estimation by learning a deep multidimensional and cross-domain feature representation; the other one constructs another intermediate estimation, which maintains the high-frequency textures, by propagating the information of the high-resolution view. We finally leverage the advantages of the two intermediate estimations via the learned attention maps, leading to the final high-resolution LF image. Extensive experiments demonstrate the significant superiority of our approach over state-of-the-art ones. That is, our method not only improves the PSNR by more than 2 dB, but also preserves the LF structure much better. To the best of our knowledge, this is the first end-to-end deep learning method for reconstructing a high-resolution LF image with a hybrid input. We believe our framework could potentially decrease the cost of high-resolution LF data acquisition and also be beneficial to LF data storage and transmission. The code is available at https://github.com/jingjin25/LFhybridSR-Fusion.

cs.CV↗

arXiv2020

Surrogate Locally-Interpretable Models with Supervised Machine Learning Algorithms

Supervised Machine Learning (SML) algorithms, such as Gradient Boosting, Random Forest, and Neural Networks, have become popular in recent years due to their superior predictive performance over traditional statistical methods. However, their complexity makes the results hard to interpret without additional tools. There has been a lot of recent work in developing global and local diagnostics for interpreting SML models. In this paper, we propose a locally-interpretable model that takes the fitted ML response surface, partitions the predictor space using model-based regression trees, and fits interpretable main-effects models at each of the nodes. We adapt the algorithm to be efficient in dealing with high-dimensional predictors. While the main focus is on interpretability, the resulting surrogate model also has reasonably good predictive performance.

stat.ML↗

arXiv2020

Supervised Machine Learning Techniques: An Overview with Applications to Banking

This article provides an overview of Supervised Machine Learning (SML) with a focus on applications to banking. The SML techniques covered include Bagging (Random Forest or RF), Boosting (Gradient Boosting Machine or GBM) and Neural Networks (NNs). We begin with an introduction to ML tasks and techniques. This is followed by a description of: i) tree-based ensemble algorithms including Bagging with RF and Boosting with GBMs, ii) Feedforward NNs, iii) a discussion of hyper-parameter optimization techniques, and iv) machine learning interpretability. The paper concludes with a comparison of the features of different ML algorithms. Examples taken from credit risk modeling in banking are used throughout the paper to illustrate the techniques and interpret the results of the algorithms.

q-fin.GN↗

arXiv2020

Deep Spatial-angular Regularization for Compressive Light Field Reconstruction over Coded Apertures

Coded aperture is a promising approach for capturing the 4-D light field (LF), in which the 4-D data are compressively modulated into 2-D coded measurements that are further decoded by reconstruction algorithms. The bottleneck lies in the reconstruction algorithms, resulting in rather limited reconstruction quality. To tackle this challenge, we propose a novel learning-based framework for the reconstruction of high-quality LFs from acquisitions via learned coded apertures. The proposed method incorporates the measurement observation into the deep learning framework elegantly to avoid relying entirely on data-driven priors for LF reconstruction. Specifically, we first formulate the compressive LF reconstruction as an inverse problem with an implicit regularization term. Then, we construct the regularization term with an efficient deep spatial-angular convolutional sub-network to comprehensively explore the signal distribution free from the limited representation ability and inefficiency of deterministic mathematical modeling. Experimental results show that the reconstructed LFs not only achieve much higher PSNR/SSIM but also preserve the LF parallax structure better, compared with state-of-the-art methods on both real and synthetic LF benchmarks. In addition, experiments show that our method is efficient and robust to noise, which is an essential advantage for a real camera system. The code is publicly available at \url{https://github.com/angmt2008/LFCA}

eess.IV↗

arXiv2020

Adaptive generalized multiscale approximation of a mixed finite element method with velocity elimination

In this paper, we propose offline and online adaptive enrichment algorithms for the generalized multiscale approximation of a mixed finite element method with velocity elimination to solve the subsurface flow problem in high-contrast and heterogeneous porous media. We give the theoretical analysis for the convergence of these two adaptive methods, which shows that sufficient initial basis functions (belong to the offline space) leads to a faster convergence rate. A series of numerical examples are provided to highlight the performance of both these two adaptive methods and also validate the theoretical analysis. Both offline and online adaptive methods are effective that can reduce the relative error substantially. In addition, the online adaptive method generally performs better than the offline adaptive method as online basis functions contain important global information such as distant effects that cannot be captured by offline basis functions. The numerical results also show that with a suitable initial multiscale space that includes all offline basis functions corresponding to relative smaller eigenvalues of local spectral decompositions in the offline stage, the convergence rate of the online enrichment is independent of the permeability contrast.

math.NA↗

arXiv2020

Generalized multiscale approximation of a multipoint flux mixed finite element method for Darcy-Forchheimer model

In this paper, we propose a multiscale method for the Darcy-Forchheimer model in highly heterogeneous porous media. The problem is solved in the framework of generalized multiscale finite element methods (GMsFEM) combined with a multipoint flux mixed finite element (MFMFE) method. %In the MFMFE methods, appropriate mixed finite element spaces and suitable quadrature rules are employed, which allow for local velocity elimination and lead to a cell-centered system for the pressure. We consider the MFMFE method that utilizes the lowest order Brezzi-Douglas-Marini ($\textrm{BDM}_1$) mixed finite element spaces for the velocity and pressure approximation. The symmetric trapezoidal quadrature rule is employed for the integration of bilinear forms relating to the velocity variables so that the local velocity elimination is allowed and leads to a cell-centered system for the pressure. %on meshes composed of simplices and $h^2$-perturbed parallelograms. We construct multiscale space for the pressure and solve the problem on the coarse grid following the GMsFEM framework. In the offline stage, we construct local snapshot spaces and perform spectral decompositions to get the offline space with a smaller dimension. In the online stage, we use the Newton iterative algorithm to solve the nonlinear problem and obtain the offline solution, which reduces the iteration times greatly comparing to the standard Picard iteration. Based on the offline space and offline solution, we calculate online basis functions which contain important global information to enrich the multiscale space iteratively. The online basis functions are efficient and accurate to reduce relative errors substantially. Numerical examples are provided to highlight the performance of the proposed multiscale method.

math.NA↗

arXiv2020

Asymptotic population imbalance of an ultracold bosonic ensemble in a driven double-well

We demonstrate that an ultracold many-body bosonic ensemble confined in an one-dimensional (1D) double well potential exhibits a population imbalance between the two wells at large timescales, when the depth of the wells are modulated by a time-dependent driving force. The specific form of the driving force is shown to break spatial parity and time-reversal symmetries, which leads to such an asymptotic population imbalance (API). The value of the API can be flexibly controlled by changing the phase of the driving force and the total number of particles. While the API is highly sensitive to the initial state in the few-particle regime, this dependence on the initial state is lost as we approach the classical limit of large particle numbers. We perform a Floquet analysis in the few-particle regime and an analysis based on a driven classical non-rigid pendulum in the many-particle regime. Although the obtained API values in the many-particle regime agree very well with that obtained in the classical limit, we show that there exists a significant disagreement in the corresponding real-time population imbalance due to quantum correlations.

quant-ph↗

arXiv2020

Online Graph-Based Change Point Detection in Multiband Image Sequences

The automatic detection of changes or anomalies between multispectral and hyperspectral images collected at different time instants is an active and challenging research topic. To effectively perform change-point detection in multitemporal images, it is important to devise techniques that are computationally efficient for processing large datasets, and that do not require knowledge about the nature of the changes. In this paper, we introduce a novel online framework for detecting changes in multitemporal remote sensing images. Acting on neighboring spectra as adjacent vertices in a graph, this algorithm focuses on anomalies concurrently activating groups of vertices corresponding to compact, well-connected and spectrally homogeneous image regions. It fully benefits from recent advances in graph signal processing to exploit the characteristics of the data that lie on irregular supports. Moreover, the graph is estimated directly from the images using superpixel decomposition algorithms. The learning algorithm is scalable in the sense that it is efficient and spatially distributed. Experiments illustrate the detection and localization performance of the method.

eess.SP↗

arXiv2020

Policy Gradient from Demonstration and Curiosity

With reinforcement learning, an agent could learn complex behaviors from high-level abstractions of the task. However, exploration and reward shaping remained challenging for existing methods, especially in scenarios where the extrinsic feedback was sparse. Expert demonstrations have been investigated to solve these difficulties, but a tremendous number of high-quality demonstrations were usually required. In this work, an integrated policy gradient algorithm was proposed to boost exploration and facilitate intrinsic reward learning from only limited number of demonstrations. We achieved this by reformulating the original reward function with two additional terms, where the first term measured the Jensen-Shannon divergence between current policy and the expert, and the second term estimated the agent's uncertainty about the environment. The presented algorithm was evaluated on a range of simulated tasks with sparse extrinsic reward signals where only one single demonstrated trajectory was provided to each task, superior exploration efficiency and high average return were demonstrated in all tasks. Furthermore, it was found that the agent could imitate the expert's behavior and meanwhile sustain high return.

cs.LG↗

arXiv2020

Adaptive Explainable Neural Networks (AxNNs)

While machine learning techniques have been successfully applied in several fields, the black-box nature of the models presents challenges for interpreting and explaining the results. We develop a new framework called Adaptive Explainable Neural Networks (AxNN) for achieving the dual goals of good predictive performance and model interpretability. For predictive performance, we build a structured neural network made up of ensembles of generalized additive model networks and additive index models (through explainable neural networks) using a two-stage process. This can be done using either a boosting or a stacking ensemble. For interpretability, we show how to decompose the results of AxNN into main effects and higher-order interaction effects. The computations are inherited from Google's open source tool AdaNet and can be efficiently accelerated by training with distributed computing. The results are illustrated on simulated and real datasets.

stat.ML↗