arXiv subjects

Chia-Wen Lin

Publications and source records attributed to Chia-Wen Lin.

94 records · Page 6Linked to original sources

arXiv2017

CNN-Based Joint Clustering and Representation Learning with Feature Drift Compensation for Large-Scale Image Data

Given a large unlabeled set of images, how to efficiently and effectively group them into clusters based on extracted visual representations remains a challenging problem. To address this problem, we propose a convolutional neural network (CNN) to jointly solve clustering and representation learning in an iterative manner. In the proposed method, given an input image set, we first randomly pick k samples and extract their features as initial cluster centroids using the proposed CNN with an initial model pre-trained from the ImageNet dataset. Mini-batch k-means is then performed to assign cluster labels to individual input samples for a mini-batch of images randomly sampled from the input image set until all images are processed. Subsequently, the proposed CNN simultaneously updates the parameters of the proposed CNN and the centroids of image clusters iteratively based on stochastic gradient descent. We also proposed a feature drift compensation scheme to mitigate the drift error caused by feature mismatch in representation learning. Experimental results demonstrate the proposed method outperforms start-of-the-art clustering schemes in terms of accuracy and storage complexity on large-scale image sets containing millions of images.

cs.CV↗

arXiv2017

Robust Semi-Supervised Graph Classifier Learning with Negative Edge Weights

In a semi-supervised learning scenario, (possibly noisy) partially observed labels are used as input to train a classifier, in order to assign labels to unclassified samples. In this paper, we study this classifier learning problem from a graph signal processing (GSP) perspective. Specifically, by viewing a binary classifier as a piecewise constant graph-signal in a high-dimensional feature space, we cast classifier learning as a signal restoration problem via a classical maximum a posteriori (MAP) formulation. Unlike previous graph-signal restoration works, we consider in addition edges with negative weights that signify anti-correlation between samples. One unfortunate consequence is that the graph Laplacian matrix $\mathbf{L}$ can be indefinite, and previously proposed graph-signal smoothness prior $\mathbf{x}^T \mathbf{L} \mathbf{x}$ for candidate signal $\mathbf{x}$ can lead to pathological solutions. In response, we derive an optimal perturbation matrix $\boldsymbolΔ$ - based on a fast lower-bound computation of the minimum eigenvalue of $\mathbf{L}$ via a novel application of the Haynsworth inertia additivity formula---so that $\mathbf{L} + \boldsymbolΔ$ is positive semi-definite, resulting in a stable signal prior. Further, instead of forcing a hard binary decision for each sample, we define the notion of generalized smoothness on graph that promotes ambiguity in the classifier signal. Finally, we propose an algorithm based on iterative reweighted least squares (IRLS) that solves the posed MAP problem efficiently. Extensive simulation results show that our proposed algorithm outperforms both SVM variants and graph-based classifiers using positive-edge graphs noticeably.

cs.LG↗

arXiv2017

Graph-based Joint Signal / Power Restoration for Energy Harvesting Wireless Sensor Networks

The design of energy and spectrally efficient Wireless Sensor Networks (WSN) is crucial to support the upcoming expansion of IoT/M2M mobile data traffic. In this work, we consider an energy harvesting WSN where sensor data are periodically reported to a Fusion Center (FC) by a sparse set of active sensors. Unlike most existing works, the transmit power levels of each sensor are assumed to be unknown at the FC in this distributed setting. We address the inverse problem of joint signal / power restoration at the FC- a challenging under-determined separation problem. To regularize the ill-posed problem, we assume both a graph-signal smoothness prior (signal is smooth with respect to a graph modeling spatial correlation among sensors) and a sparsity power prior for the two unknown variables. We design an efficient algorithm by alternately fixing one variable and solving for the other until convergence. Specifically, when the signal is fixed, we solve for the power vector using Simplex pivoting in linear programming (LP) to iteratively identify sparse feasible solutions, locally minimizing an objective. Simulation results show that our proposal can achieve very low reconstruction errors and outperform conventional schemes under reasonable assumptions

cs.IT↗

arXiv2017

Graph Fourier Transform with Negative Edges for Depth Image Coding

Recent advent in graph signal processing (GSP) has led to the development of new graph-based transforms and wavelets for image / video coding, where the underlying graph describes inter-pixel correlations. In this paper, we develop a new transform called signed graph Fourier transform (SGFT), where the underlying graph G contains negative edges that describe anti-correlations between pixel pairs. Specifically, we first construct a one-state Markov process that models both inter-pixel correlations and anti-correlations. We then derive the corresponding precision matrix, and show that the loopy graph Laplacian matrix Q of a graph G with a negative edge and two self-loops at its end nodes is approximately equivalent. This proves that the eigenvectors of Q - called SGFT - approximates the optimal Karhunen-Lo`eve Transform (KLT). We show the importance of the self-loops in G to ensure Q is positive semi-definite. We prove that the first eigenvector of Q is piecewise constant (PWC), and thus can well approximate a piecewise smooth (PWS) signal like a depth image. Experimental results show that a block-based coding scheme based on SGFT outperforms a previous scheme using graph transforms with only positive edges for several depth images.

cs.CV↗