arXiv subjects

Jie Tang

Publications and source records attributed to Jie Tang.

At least 397 records · Page 22Linked to original sources

arXiv2018

Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2vec

Since the invention of word2vec, the skip-gram model has significantly advanced the research of network embedding, such as the recent emergence of the DeepWalk, LINE, PTE, and node2vec approaches. In this work, we show that all of the aforementioned models with negative sampling can be unified into the matrix factorization framework with closed forms. Our analysis and proofs reveal that: (1) DeepWalk empirically produces a low-rank transformation of a network's normalized Laplacian matrix; (2) LINE, in theory, is a special case of DeepWalk when the size of vertices' context is set to one; (3) As an extension of LINE, PTE can be viewed as the joint factorization of multiple networks' Laplacians; (4) node2vec is factorizing a matrix related to the stationary distribution and transition probability tensor of a 2nd-order random walk. We further provide the theoretical connections between skip-gram based network embedding algorithms and the theory of graph Laplacian. Finally, we present the NetMF method as well as its approximation algorithm for computing network embedding. Our method offers significant improvements over DeepWalk and LINE for conventional network mining tasks. This work lays the theoretical foundation for skip-gram based network embedding methods, leading to a better understanding of latent network representation learning.

cs.SI↗

arXiv2017

Online Red Packets: A Large-scale Empirical Study of Gift Giving on WeChat

Gift giving is a ubiquitous social phenomenon, and red packets have been used as monetary gifts in Asian countries for thousands of years. In recent years, online red packets have become widespread in China through the WeChat platform. Exploiting a unique dataset consisting of 61 million group red packets and seven million users, we conduct a large-scale, data-driven study to understand the spread of red packets and the effect of red packets on group activity. We find that the cash flows between provinces are largely consistent with provincial GDP rankings, e.g., red packets are sent from users in the south to those in the north. By distinguishing spontaneous from reciprocal red packets, we reveal the behavioral patterns in sending red packets: males, seniors, and people with more in-group friends are more inclined to spontaneously send red packets, while red packets from females, youths, and people with less in-group friends are more reciprocal. Furthermore, we use propensity score matching to study the external effects of red packets on group dynamics. We show that red packets increase group participation and strengthen in-group relationships, which partly explain the benefits and motivations for sending red packets.

cs.SI↗

arXiv2017

Fast Top-k Area Topics Extraction with Knowledge Base

What are the most popular research topics in Artificial Intelligence (AI)? We formulate the problem as extracting top-$k$ topics that can best represent a given area with the help of knowledge base. We theoretically prove that the problem is NP-hard and propose an optimization model, FastKATE, to address this problem by combining both explicit and latent representations for each topic. We leverage a large-scale knowledge base (Wikipedia) to generate topic embeddings using neural networks and use this kind of representations to help capture the representativeness of topics for given areas. We develop a fast heuristic algorithm to efficiently solve the problem with a provable error bound. We evaluate the proposed model on three real-world datasets. Experimental results demonstrate our model's effectiveness, robustness, real-timeness (return results in $<1$s), and its superiority over several alternative methods.

cs.AI↗

arXiv2017

Full-Duplex Cloud Radio Access Network: Stochastic Design and Analysis

Full-duplex (FD) has emerged as a disruptive communications paradigm for enhancing the achievable spectral efficiency (SE), thanks to the recent major breakthroughs in self-interference (SI) mitigation. The FD versus half-duplex (HD) SE gain, in cellular networks, is however largely limited by the mutual-interference (MI) between the downlink (DL) and the uplink (UL). A potential remedy for tackling the MI bottleneck is through cooperative communications. This paper provides a stochastic design and analysis of FD enabled cloud radio access network (C-RAN) under the Poisson point process (PPP)-based abstraction model of multi-antenna radio units (RUs) and user equipments (UEs). We consider different disjoint and user-centric approaches towards the formation of finite clusters in the C-RAN. Contrary to most existing studies, we explicitly take into consideration non-isotropic fading channel conditions and finite-capacity fronthaul links. Accordingly, upper-bound expressions for the C-RAN DL and UL SEs, involving the statistics of all intended and interfering signals, are derived. The performance of the FD C-RAN is investigated through the proposed theoretical framework and Monte-Carlo (MC) simulations. The results indicate that significant FD versus HD C-RAN SE gains can be achieved, particularly in the presence of sufficient-capacity fronthaul links and advanced interference cancellation capabilities.

cs.IT↗

arXiv2017

Energy Efficiency Optimization with Simultaneous Wireless Information and Power Transfer in MIMO Broadcast Channels

Simultaneous wireless information and power transfer (SWIPT) is anticipated to have great applications in fifth-generation (5G) and beyond communication systems. In this paper, we address the energy efficiency (EE) optimization problem for SWIPT multiple-input multiple-output broadcast channel (MIMO-BC) with time-switching (TS) receiver design. Our aim is to maximize the EE of the system whilst satisfying certain constraints in terms of maximum transmit power and minimum harvested energy per user. The coupling of the optimization variables, namely, transmit covariance matrices and TS ratios, leads to a EE problem which is non-convex, and hence very difficult to solve directly. Hence, we transform the original maximization problem with multiple constraints into a min-max problem with a single constraint and multiple auxiliary variables. We propose a dual inner/outer layer resource allocation framework to tackle the problem. For the inner-layer, we invoke an extended SWIPT-based BC-multiple access channel (MAC) duality approach and provide two iterative resource allocation schemes under fixed auxiliary variables for solving the dual MAC problem. A sub-gradient searching scheme is then proposed for the outer-layer in order to obtain the optimal auxiliary variables. Numerical results confirm the effectiveness of the proposed algorithms and illustrate that significant performance gain in terms of EE can be achieved by adopting the proposed extended BC-MAC duality-based algorithm.

cs.IT↗

arXiv2017

Real-Time Robot Localization, Vision, and Speech Recognition on Nvidia Jetson TX1

Robotics systems are complex, often consisted of basic services including SLAM for localization and mapping, Convolution Neural Networks for scene understanding, and Speech Recognition for user interaction, etc. Meanwhile, robots are mobile and usually have tight energy constraints, integrating these services onto an embedded platform with around 10 W of power consumption is critical to the proliferation of mobile robots. In this paper, we present a case study on integrating real-time localization, vision, and speech recognition services on a mobile SoC, Nvidia Jetson TX1, within about 10 W of power envelope. In addition, we explore whether offloading some of the services to cloud platform can lead to further energy efficiency while meeting the real-time requirements

cs.RO↗

arXiv2017

Distributed Simulation Platform for Autonomous Driving

Autonomous vehicle safety and reliability are the paramount requirements when developing autonomous vehicles. These requirements are guaranteed by massive functional and performance tests. Conducting these tests on real vehicles is extremely expensive and time consuming, and thus it is imperative to develop a simulation platform to perform these tasks. For simulation, we can utilize the Robot Operating System (ROS) for data playback to test newly developed algorithms. However, due to the massive amount of simulation data, performing simulation on single machines is not practical. Hence, a high-performance distributed simulation platform is a critical piece in autonomous driving development. In this paper we present our experiences of building a production distributed autonomous driving simulation platform. This platform is built upon Spark distributed framework, for distributed computing management, and ROS, for data playback simulations.

cs.DC↗

arXiv2017

Learn-Memorize-Recall-Reduce A Robotic Cloud Computing Paradigm

The rise of robotic applications has led to the generation of a huge volume of unstructured data, whereas the current cloud infrastructure was designed to process limited amounts of structured data. To address this problem, we propose a learn-memorize-recall-reduce paradigm for robotic cloud computing. The learning stage converts incoming unstructured data into structured data; the memorization stage provides effective storage for the massive amount of data; the recall stage provides efficient means to retrieve the raw data; while the reduction stage provides means to make sense of this massive amount of unstructured data with limited computing resources.

cs.DC↗

arXiv2017

Implementing a Cloud Platform for Autonomous Driving

Autonomous driving clouds provide essential services to support autonomous vehicles. Today these services include but not limited to distributed simulation tests for new algorithm deployment, offline deep learning model training, and High-Definition (HD) map generation. These services require infrastructure support including distributed computing, distributed storage, as well as heterogeneous computing. In this paper, we present the details of how we implement a unified autonomous driving cloud infrastructure, and how we support these services on top of this infrastructure.

cs.DC↗

arXiv2017

Multiple User Context Inference by Fusing Data Sources

Inference of user context information, including user's gender, age, marital status, location and so on, has been proven to be valuable for building context aware recommender system. However, prevalent existing studies on user context inference have two shortcommings: 1. focusing on only a single data source (e.g. Internet browsing logs, or mobile call records), and 2. ignoring the interdependence of multiple user contexts (e.g. interdependence between age and marital status), which have led to poor inference performance. To solve this problem, in this paper, we first exploit tensor outer product to fuse multiple data sources in the feature space to obtain an extensional user feature representation. Following this, by taking this extensional user feature representation as input, we propose a multiple attribute probabilistic model called MulAProM to infer user contexts that can take advantage of the interdependence between them. Our study is based on large telecommunication datasets from the local mobile operator of Shanghai, China, and consists of two data sources, 4.6 million call detail records and 7.5 million data traffic records of 8,000 mobile users, collected in the course of six months. The experimental results show that our model can outperform other models in terms of \emph{recall}, \emph{precision}, and the \emph{F1-measure}.

cs.IR↗

arXiv2017

Massive MIMO-Enabled Full-Duplex Cellular Networks

In this paper, we provide a theoretical framework for the study of massive multiple-input multiple-output (MIMO)-enabled full-duplex (FD) cellular networks in which the self-interference (SI) channels follow the Rician distribution and other channels are Rayleigh distributed. To facilitate bi-directional wireless functionality, we adopt (i) a downlink (DL) linear zero-forcing with self-interference-nulling (ZF-SIN) precoding scheme at the FD base stations (BSs), and (ii) an uplink (UL) self-interference-aware (SIA) fractional power control mechanism at the FD user equipments (UEs). Linear ZF receivers are further utilized for signal detection in the UL. The results indicate that the UL rate bottleneck in the baseline FD single-antenna system can be overcome via exploiting massive MIMO. On the other hand, the findings may be viewed as a reality-check, since we show that, under state-of-the-art system parameters, the spectral efficiency (SE) gain of FD massive MIMO over its half-duplex (HD) counterpart largely depends on the SI cancellation capability of the UEs. In addition, the anticipated two-fold increase in SE is shown to be only achievable with an infinitely large number of antennas.

cs.IT↗

arXiv2017

CAAD: Computer Architecture for Autonomous Driving

We describe the computing tasks involved in autonomous driving, examine existing autonomous driving computing platform implementations. To enable autonomous driving, the computing stack needs to simultaneously provide high performance, low power consumption, and low thermal dissipation, at low cost. We discuss possible approaches to design computing platforms that will meet these needs.

cs.AR↗

arXiv2017

Embedded Systems Architecture for SLAM Applications

In recent years, we have observed a clear trend in the rapid rise of autonomous vehicles, robotics, virtual reality, and augmented reality. The core technology enabling these applications, Simultaneous Localization And Mapping (SLAM), imposes two main challenges: first, these workloads are computationally intensive and they often have real-time requirements; second, these workloads run on battery-powered mobile devices with limited energy budget. In short, the essence of these challenges is that performance should be improved while simultaneously reducing energy consumption, two rather contradicting goals by conventional wisdom. In this paper, we take a close look at state-of-the-art Simultaneous Localization And Mapping (SLAM) workloads, especially how these workloads behave on mobile devices. Based on the results, we propose a mobile architecture to improve SLAM performance on mobile devices.

cs.AR↗

arXiv2017

Self-Interference in Full-Duplex Multi-User MIMO Channels

We consider a multi-user multiple-input multiple-output (MIMO) setup where full-duplex (FD) multi-antenna nodes apply linear beamformers to simultaneously transmit and receive multiple streams over Rician fading channels. The exact first and second positive moments of the residual self-interference (SI), involving the squared norm of a sum of non-identically distributed random variables, are derived in closed-form. The method of moments is hence invoked to provide a Gamma approximation for the residual SI distribution. The proposed theorem holds under arbitrary linear precoder/decoder design, number of antennas and streams, and SI cancellation capability.

cs.IT↗

arXiv2016

Word Embedding based Correlation Model for Question/Answer Matching

With the development of community based question answering (Q&A) services, a large scale of Q&A archives have been accumulated and are an important information and knowledge resource on the web. Question and answer matching has been attached much importance to for its ability to reuse knowledge stored in these systems: it can be useful in enhancing user experience with recurrent questions. In this paper, we try to improve the matching accuracy by overcoming the lexical gap between question and answer pairs. A Word Embedding based Correlation (WEC) model is proposed by integrating advantages of both the translation model and word embedding, given a random pair of words, WEC can score their co-occurrence probability in Q&A pairs and it can also leverage the continuity and smoothness of continuous space word representation to deal with new pairs of words that are rare in the training parallel text. An experimental study on Yahoo! Answers dataset and Baidu Zhidao dataset shows this new method's promising potential.

cs.CL↗

arXiv2016

Joint Antenna Selection and Spatial Switching for Energy Efficient MIMO SWIPT System

In this paper, we investigate joint antenna selection and spatial switching (SS) for quality-of-service (QoS)-constrained energy efficiency (EE) optimization in a multiple-input multiple-output (MIMO) simultaneous wireless information and power transfer (SWIPT) system. A practical linear power model taking into account the entire transmit-receive chain is accordingly utilized. The corresponding fractional-combinatorial and non-convex EE problem, involving joint optimization of eigen-channel assignment, power allocation, and active receive antenna set selection, subject to satisfying minimum sum-rate and power transfer constraints, is extremely difficult to solve directly. In order to tackle this, we separate the eigen-channel assignment and power allocation procedure with the antenna selection functionality. In particular, we first tackle the EE maximization problem under fixed receive antenna set using Dinkelbach-based convex programming, iterative joint eigen-channel assignment and power allocation, and low-complexity multi-objective optimization (MOO)-based approach. On the other hand, the number of active receive antennas induces a trade-off in the achievable sum-rate and power transfer versus the transmit-independent power consumption. We provide a fundamental study of the achievable EE with antenna selection and accordingly develop dynamic optimal exhaustive search and Frobenius-norm-based schemes. Simulation results confirm the theoretical findings and demonstrate that the proposed resource allocation algorithms can efficiently approach the optimal EE.

cs.IT↗

arXiv2016

Energy-Efficient Heterogeneous Cellular Networks with Spectrum Underlay and Overlay Access

In this paper, we provide joint subcarrier assignment and power allocation schemes for quality-of-service (QoS)-constrained energy-efficiency (EE) optimization in the downlink of an orthogonal frequency division multiple access (OFDMA)-based two-tier heterogeneous cellular network (HCN). Considering underlay transmission, where spectrum-efficiency (SE) is fully exploited, the EE solution involves tackling a complex mixed-combinatorial and non-convex optimization problem. With appropriate decomposition of the original problem and leveraging on the quasi-concavity of the EE function, we propose a dual-layer resource allocation approach and provide a complete solution using difference-of-two-concave-functions approximation, successive convex approximation, and gradient-search methods. On the other hand, the inherent inter-tier interference from spectrum underlay access may degrade EE particularly under dense small-cell deployment and large bandwidth utilization. We therefore develop a novel resource allocation approach based on the concepts of spectrum overlay access and resource efficiency (RE) (normalized EE-SE trade-off). Specifically, the optimization procedure is separated in this case such that the macro-cell optimal RE and corresponding bandwidth is first determined, then the EE of small-cells utilizing the remaining spectrum is maximized. Simulation results confirm the theoretical findings and demonstrate that the proposed resource allocation schemes can approach the optimal EE with each strategy being superior under certain system settings.

cs.IT↗

arXiv2016

Stochastic Geometric Analysis of Energy-Efficient Dense Cellular Networks

Dense cellular networks (DenseNets) are fast becoming a reality with the rapid deployment of base stations (BSs) aimed at meeting the explosive data traffic demand. In legacy systems however this comes with the penalties of higher network interference and energy consumption. In order to support network densification in a sustainable manner, the system behavior should be made 'load-proportional' thus allowing certain portions of the network to activate on-demand. In this work, we develop an analytical framework using tools from stochastic geometry theory for the performance analysis of DenseNets where load-awareness is explicitly embedded in the design. The model leverages on a flexible cellular network architecture where there is a complete separation of the data and signaling communication functionalities. Using the proposed model, we identify the most energy- efficient deployment solution for meeting certain minimum service criteria and analyze the corresponding power savings through dynamic sleep modes. Based on state-of-the-art system parameters, a homogeneous pico deployment for the data plane with a separate layer of signaling macro-cells is revealed to be the most energy-efficient solution in future dense urban environments.

cs.IT↗