arXiv subjects

Jia Li

Publications and source records attributed to Jia Li.

At least 559 records · Page 31Linked to original sources

arXiv2018

Lifted Proximal Operator Machines

We propose a new optimization method for training feed-forward neural networks. By rewriting the activation function as an equivalent proximal operator, we approximate a feed-forward neural network by adding the proximal operators to the objective function as penalties, hence we call the lifted proximal operator machine (LPOM). LPOM is block multi-convex in all layer-wise weights and activations. This allows us to use block coordinate descent to update the layer-wise weights and activations in parallel. Most notably, we only use the mapping of the activation function itself, rather than its derivatives, thus avoiding the gradient vanishing or blow-up issues in gradient based training methods. So our method is applicable to various non-decreasing Lipschitz continuous activation functions, which can be saturating and non-differentiable. LPOM does not require more auxiliary variables than the layer-wise activations, thus using roughly the same amount of memory as stochastic gradient descent (SGD) does. We further prove the convergence of updating the layer-wise weights and activations. Experiments on MNIST and CIFAR-10 datasets testify to the advantages of LPOM.

cs.LG↗

arXiv2018

Learning a Saliency Evaluation Metric Using Crowdsourced Perceptual Judgments

In the area of human fixation prediction, dozens of computational saliency models are proposed to reveal certain saliency characteristics under different assumptions and definitions. As a result, saliency model benchmarking often requires several evaluation metrics to simultaneously assess saliency models from multiple perspectives. However, most computational metrics are not designed to directly measure the perceptual similarity of saliency maps so that the evaluation results may be sometimes inconsistent with the subjective impression. To address this problem, this paper first conducts extensive subjective tests to find out how the visual similarities between saliency maps are perceived by humans. Based on the crowdsourced data collected in these tests, we conclude several key factors in assessing saliency maps and quantize the performance of existing metrics. Inspired by these factors, we propose to learn a saliency evaluation metric based on a two-stream convolutional neural network using crowdsourced perceptual judgements. Specifically, the relative saliency score of each pair from the crowdsourced data is utilized to regularize the network during the training process. By capturing the key factors shared by various subjects in comparing saliency maps, the learned metric better aligns with human perception of saliency maps, making it a good complement to the existing metrics. Experimental results validate that the learned metric can be generalized to the comparisons of saliency maps from new images, new datasets, new models and synthetic data. Due to the effectiveness of the learned metric, it also can be used to facilitate the development of new models for fixation prediction.

cs.CV↗

arXiv2018

Collaborative Annotation of Semantic Objects in Images with Multi-granularity Supervisions

Per-pixel masks of semantic objects are very useful in many applications, which, however, are tedious to be annotated. In this paper, we propose a human-agent collaborative annotation approach that can efficiently generate per-pixel masks of semantic objects in tagged images with multi-granularity supervisions. Given a set of tagged image, a computer agent is first dynamically generated to roughly localize the semantic objects described by the tag. The agent first extracts massive object proposals from an image and then infer the tag-related ones under the weak and strong supervisions from linguistically and visually similar images and previously annotated object masks. By representing such supervisions by over-complete dictionaries, the tag-related object proposals can pop-out according to their sparse coding length, which are then converted to superpixels with binary labels. After that, human annotators participate in the annotation process by flipping labels and dividing superpixels with mouse clicks, which are used as click supervisions that teach the agent to recover false positives/negatives in processing images with the same tags. Experimental results show that our approach can facilitate the annotation process and generate object masks that are highly consistent with those generated by the LabelMe toolbox.

cs.CV↗

arXiv2018

Ultra-fast wide band spectrum analyzer based on a rapidly tuned spin-torque nano-oscillator

A spintronic method of ultra-fast broadband microwave spectrum analysis is proposed. It uses a rapidly tuned spin torque nano-oscillator (STNO), and does not require injection locking. This method treats an STNO generating a microwave signal as an element with an oscillating resistance. When an external signal is applied to this "resistor" for analysis, it is mixed with the signal generated by the STNO. The resulting mixed voltage contains the "sum" and "difference" frequencies, and the latter produces a DC component when the external frequency matches the frequency generated by the STNO. The mixed voltage is processed using a low pass filter to exclude the "sum" frequency components, and a matched filter to exclude the dependence of the resultant DC voltage on the phase difference between the two signals. It is found analytically and by numerical simulation, that the proposed spectrum analyzer has a frequency resolution at a theoretical limit in a real-time scanning bandwidth of 10~GHz, and a frequency scanning rate above 1~GHz/ns, while remaining sensitive to signal power as low as the Johnson-Nyquist thermal noise floor.

cond-mat.mes-hall↗

arXiv2018

Grid-side Flexibility of Power Systems in Integrating Large-scale Renewable Generations: A Critical Review on Concepts, Formulations and Solution Approaches

Though considerable effort has been devoted to exploiting generation-side and demand-side operational flexibility in order to cope with uncertain renewable generations, grid-side operational flexibility has not been fully investigated. In this review, we define grid-side flexibility as the ability of a power network to deploy its flexibility resources to cope with the changes of power system state, particularly due to variation of renewable generation. Starting with a survey on the metrics of operational flexibility, we explain the definition from both physical and mathematical point of views. Then conceptual examples are presented to demonstrate the impacts of grid-side flexibility graphically, providing a geometric interpretation for a better understanding of the concepts. Afterwards the formulations and solution approaches in terms of grid-side flexibility in power system operation and planning are reviewed, based on which future research directions and challenges are outlined.

math.OC↗

arXiv2018

Resilience Control of DC Shipboard Power Systems

Direct current (DC) network has been recognized as a promising technique, especially for shipboard power systems (SPSs). Fast resilience control is required for an SPS to survive after faults. Towards this end, this paper proposes the indices of survivability and functionality, based on which a two-phase resilience control method is derived. The on/off status of loads are determined in the first phase to maximize survivability, while the functionality of supplying loads are maximized in the second phase. Based on a comprehensive model of a DC shipboard power systems (DC-SPS), the two-phase method renders two mixed-integer non-convex problems. To make the problems tractable, we develop second-order-cone-based convex relaxations, thus converting the problems into mixed-integer convex problems. Though this approach does not necessarily guarantee feasible, hence global, solutions to the original non-convex formulations, we provide additional mild assumptions, which ensures that the convex relaxations are exact when line constraints are not binding. In the case of inexactness, we provide a simple heuristic approach to ensure feasible solutions. Numerical tests empirically confirm the efficacy of the proposed method.

math.OC↗

arXiv2018

Image Co-segmentation via Multi-scale Local Shape Transfer

Image co-segmentation is a challenging task in computer vision that aims to segment all pixels of the objects from a predefined semantic category. In real-world cases, however, common foreground objects often vary greatly in appearance, making their global shapes highly inconsistent across images and difficult to be segmented. To address this problem, this paper proposes a novel co-segmentation approach that transfers patch-level local object shapes which appear more consistent across different images. In our framework, a multi-scale patch neighbourhood system is first generated using proposal flow on arbitrary image-pair, which is further refined by Locally Linear Embedding. Based on the patch relationships, we propose an efficient algorithm to jointly segment the objects in each image while transferring their local shapes across different images. Extensive experiments demonstrate that the proposed method can robustly and effectively segment common objects from an image set. On iCoseg, MSRC and Coseg-Rep dataset, the proposed approach performs comparable or better than the state-of-thearts, while on a more challenging benchmark Fashionista dataset, our method achieves significant improvements.

cs.CV↗

arXiv2018

Salient Object Detection: A Benchmark

We extensively compare, qualitatively and quantitatively, 40 state-of-the-art models (28 salient object detection, 10 fixation prediction, 1 objectness, and 1 baseline) over 6 challenging datasets for the purpose of benchmarking salient object detection and segmentation methods. From the results obtained so far, our evaluation shows a consistent rapid progress over the last few years in terms of both accuracy and running time. The top contenders in this benchmark significantly outperform the models identified as the best in the previous benchmark conducted just two years ago. We find that the models designed specifically for salient object detection generally work better than models in closely related areas, which in turn provides a precise definition and suggests an appropriate treatment of this problem that distinguishes it from other problems. In particular, we analyze the influences of center bias and scene complexity in model performance, which, along with the hard cases for state-of-the-art models, provide useful hints towards constructing more challenging large scale datasets and better saliency models. Finally, we propose probable solutions for tackling several open problems such as evaluation scores and dataset bias, which also suggest future research directions in the rapidly-growing field of salient object detection.

cs.CV↗

arXiv2018

Graph Pattern Matching for Dynamic Team Formation

Finding a list of k teams of experts, referred to as top-k team formation, with the required skills and high collaboration compatibility has been extensively studied. However, existing methods have not considered the specific collaboration relationships among different team members, i.e., structural constraints, which are typically needed in practice. In this study, we first propose a novel graph pattern matching approach for top-k team formation, which incorporates both structural constraints and capacity bounds. Second, we formulate and study the dynamic top-k team formation problem due to the growing need of a dynamic environment. Third, we develop an unified incremental approach, together with an optimization technique, to handle continuous pattern and data updates, separately and simultaneously, which has not been explored before. Finally, using real-life and synthetic data, we conduct an extensive experimental study to show the effectiveness and efficiency of our graph pattern matching approach for (dynamic) top-k team formation.

cs.DB↗

arXiv2017

Aggregated Wasserstein Metric and State Registration for Hidden Markov Models

We propose a framework, named Aggregated Wasserstein, for computing a dissimilarity measure or distance between two Hidden Markov Models with state conditional distributions being Gaussian. For such HMMs, the marginal distribution at any time position follows a Gaussian mixture distribution, a fact exploited to softly match, aka register, the states in two HMMs. We refer to such HMMs as Gaussian mixture model-HMM (GMM-HMM). The registration of states is inspired by the intrinsic relationship of optimal transport and the Wasserstein metric between distributions. Specifically, the components of the marginal GMMs are matched by solving an optimal transport problem where the cost between components is the Wasserstein metric for Gaussian distributions. The solution of the optimization problem is a fast approximation to the Wasserstein metric between two GMMs. The new Aggregated Wasserstein distance is a semi-metric and can be computed without generating Monte Carlo samples. It is invariant to relabeling or permutation of states. The distance is defined meaningfully even for two HMMs that are estimated from data of different dimensionality, a situation that can arise due to missing variables. This distance quantifies the dissimilarity of GMM-HMMs by measuring both the difference between the two marginal GMMs and that between the two transition matrices. Our new distance is tested on tasks of retrieval, classification, and t-SNE visualization of time series. Experiments on both synthetic and real data have demonstrated its advantages in terms of accuracy as well as efficiency in comparison with existing distances based on the Kullback-Leibler divergence.

cs.LG↗

arXiv2017

Towards the solution of the many-electron problem in real materials: equation of state of the hydrogen chain with state-of-the-art many-body methods

We present numerical results for the equation of state of an infinite chain of hydrogen atoms. A variety of modern many-body methods are employed, with exhaustive cross-checks and validation. Approaches for reaching the continuous space limit and the thermodynamic limit are investigated, proposed, and tested. The detailed comparisons provide a benchmark for assessing the current state of the art in many-body computation, and for the development of new methods. The ground-state energy per atom in the linear chain is accurately determined versus bondlength, with a confidence bound given on all uncertainties.

physics.comp-ph↗

arXiv2017

Impacts and Benefits of UPFC to Wind Power Integration in Unit Commitment

Unified Power Flow Controller (UPFC) is recognized as the most powerful flexible AC transmission systems (FACTS) device for power system operation. This paper addresses how UPFC explores the transmission flexibility and facilitates the integration of uncertain and volatile wind power generation. To this end, a comprehensive unit commitment (UC) model with UPFC and uncertain wind power generation is proposed. Then, some metrics are introduced to evaluate the impacts of UPFC on the reliability, security and economy of power system operation. Further, different dispatch strategies of UPFC are compared to provide helpful guidances on making full use of UPFC to hedge against uncertainties. In addition, facing the challenging mixed-integer non-linear non-convex problems, approximate models are proposed to provide a starting point to solve the problems efficiently. All these models are easy to adapt to other types of FACTS devices. Illustrative numerical results are provided.

math.OC↗

arXiv2017

Optimal Power Flow in Stand-alone DC Microgrids

Direct-current microgrids (DC-MGs) can operate in either grid-connected or stand-alone mode. In particular, stand-alone DC-MG has many distinct applications. However, the optimal power flow problem of a stand-alone DC-MG is inherently non-convex. In this paper, the optimal power flow (OPF) problem of DC-MG is investigated considering convex relaxation based on second-order cone programming (SOCP). Mild assumptions are proposed to guarantee the exactness of relaxation, which only require uniform nodal voltage upper bounds and positive network loss. Furthermore, it is revealed that the exactness of SOCP relaxation of DC-MGs does not rely on either topology or operating mode of DC-MGs, and an optimal solution must be unique if it exists. If line constraints are considered, the exactness of SOCP relaxation may not hold. In this regard, two heuristic methods are proposed to give approximate solutions. Simulations are conducted to confirm the theoretic results.

math.OC↗

arXiv2017

Solving Partial Differential Equations on Manifolds From Incomplete Inter-Point Distance

Solutions of partial differential equations (PDEs) on manifolds have provided important applications in different fields in science and engineering. Existing methods are majorly based on discretization of manifolds as implicit functions, triangle meshes, or point clouds, where the manifold structure is approximated by either zero level set of an implicit function or a set of points. In many applications, manifolds might be only provided as an inter-point distance matrix with possible missing values. This paper discusses a framework to discretize PDEs on manifolds represented as incomplete inter-point distance information. Without conducting a time-consuming global coordinates reconstruction, we propose a more efficient strategy by discretizing differential operators only based on point-wisely local reconstruction. Our local reconstruction model is based on the recent advances of low-rank matrix completion theory, where only a very small random portion of distance information is required. This method enables us to conduct analyses of incomplete distance data using solutions of special designed PDEs such as the Laplace-Beltrami (LB) eigen-system. As an application, we demonstrate a new way of manifold reconstruction from an incomplete distance by stitching patches using the spectrum of the LB operator. Intensive numerical experiments demonstrate the effectiveness of the proposed methods.

math.NA↗

arXiv2017

Testing self-energy embedding theory in combination with GW

We present a theoretical framework and implementation details for self-energy embedding theory (SEET) with the GW approximation for the treatment of weakly correlated degrees of freedom and configuration interactions solver for handing the strongly correlated degrees. On a series of molecular examples, for which the exact results are known within a given basis, we demonstrate that SEET(CI/GW) is a systematically improvable and well controlled method capable of giving accurate results and well behaved causal self-energies and Green's functions. We compare the theoretical framework of SEET(CI/GW) to that of GW+DMFT and comment on differences between these to approaches that aim to treat both strongly and weakly correlated simultaneously.

cond-mat.str-el↗

arXiv2017

A Simulated Annealing based Inexact Oracle for Wasserstein Loss Minimization

Learning under a Wasserstein loss, a.k.a. Wasserstein loss minimization (WLM), is an emerging research topic for gaining insights from a large set of structured objects. Despite being conceptually simple, WLM problems are computationally challenging because they involve minimizing over functions of quantities (i.e. Wasserstein distances) that themselves require numerical algorithms to compute. In this paper, we introduce a stochastic approach based on simulated annealing for solving WLMs. Particularly, we have developed a Gibbs sampler to approximate effectively and efficiently the partial gradients of a sequence of Wasserstein losses. Our new approach has the advantages of numerical stability and readiness for warm starts. These characteristics are valuable for WLM problems that often require multiple levels of iterations in which the oracle for computing the value and gradient of a loss function is embedded. We applied the method to optimal transport with Coulomb cost and the Wasserstein non-negative matrix factorization problem, and made comparisons with the existing method of entropy regularization.

stat.CO↗

arXiv2017

A Benchmark Dataset and Saliency-guided Stacked Autoencoders for Video-based Salient Object Detection

Image-based salient object detection (SOD) has been extensively studied in the past decades. However, video-based SOD is much less explored since there lack large-scale video datasets within which salient objects are unambiguously defined and annotated. Toward this end, this paper proposes a video-based SOD dataset that consists of 200 videos (64 minutes). In constructing the dataset, we manually annotate all objects and regions over 7,650 uniformly sampled keyframes and collect the eye-tracking data of 23 subjects that free-view all videos. From the user data, we find salient objects in video can be defined as objects that consistently pop-out throughout the video, and objects with such attributes can be unambiguously annotated by combining manually annotated object/region masks with eye-tracking data of multiple subjects. To the best of our knowledge, it is currently the largest dataset for video-based salient object detection. Based on this dataset, this paper proposes an unsupervised baseline approach for video-based SOD by using saliency-guided stacked autoencoders. In the proposed approach, multiple spatiotemporal saliency cues are first extracted at pixel, superpixel and object levels. With these saliency cues, stacked autoencoders are unsupervisedly constructed which automatically infer a saliency score for each pixel by progressively encoding the high-dimensional saliency cues gathered from the pixel and its spatiotemporal neighbors. Experimental results show that the proposed unsupervised approach outperforms 30 state-of-the-art models on the proposed dataset, including 19 image-based & classic (unsupervised or non-deep learning), 6 image-based & deep learning, and 5 video-based & unsupervised. Moreover, benchmarking results show that the proposed dataset is very challenging and has the potential to boost the development of video-based SOD.

cs.CV↗

arXiv2017

CT Image Reconstruction in a Low Dimensional Manifold

Regularization methods are commonly used in X-ray CT image reconstruction. Different regularization methods reflect the characterization of different prior knowledge of images. In a recent work, a new regularization method called a low-dimensional manifold model (LDMM) is investigated to characterize the low-dimensional patch manifold structure of natural images, where the manifold dimensionality characterizes structural information of an image. In this paper, we propose a CT image reconstruction method based on the prior knowledge of the low-dimensional manifold of CT image. Using the clinical raw projection data from GE clinic, we conduct comparisons for the CT image reconstruction among the proposed method, the simultaneous algebraic reconstruction technique (SART) with the total variation (TV) regularization, and the filtered back projection (FBP) method. Results show that the proposed method can successfully recover structural details of an imaging object, and achieve higher spatial and contrast resolution of the reconstructed image than counterparts of FBP and SART with TV.

physics.med-ph↗