Searcharxiv⌕ Search

arXiv subjects

Qiong Wu

Publications and source records attributed to Qiong Wu.

At least 199 records · Page 11Linked to original sources

HFEL: Joint Edge Association and Resource Allocation for Cost-Efficient Hierarchical Federated Edge Learning

Federated Learning (FL) has been proposed as an appealing approach to handle data privacy issue of mobile devices compared to conventional machine learning at the remote cloud with raw user data uploading. By leveraging edge servers as intermediaries to perform partial model aggregation in proximity and relieve core network transmission overhead, it enables great potentials in low-latency and energy-efficient FL. Hence we introduce a novel Hierarchical Federated Edge Learning (HFEL) framework in which model aggregation is partially migrated to edge servers from the cloud. We further formulate a joint computation and communication resource allocation and edge association problem for device users under HFEL framework to achieve global cost minimization. To solve the problem, we propose an efficient resource scheduling algorithm in the HFEL framework. It can be decomposed into two subproblems: \emph{resource allocation} given a scheduled set of devices for each edge server and \emph{edge association} of device users across all the edge servers. With the optimal policy of the convex resource allocation subproblem for a set of devices under a single edge server, an efficient edge association strategy can be achieved through iterative global cost reduction adjustment process, which is shown to converge to a stable system point. Extensive performance evaluations demonstrate that our HFEL framework outperforms the proposed benchmarks in global cost saving and achieves better training performance compared to conventional federated learning.

cs.DC↗

Personalized Federated Learning for Intelligent IoT Applications: A Cloud-Edge based Framework

Internet of Things (IoT) have widely penetrated in different aspects of modern life and many intelligent IoT services and applications are emerging. Recently, federated learning is proposed to train a globally shared model by exploiting a massive amount of user-generated data samples on IoT devices while preventing data leakage. However, the device, statistical and model heterogeneities inherent in the complex IoT environments pose great challenges to traditional federated learning, making it unsuitable to be directly deployed. In this article we advocate a personalized federated learning framework in a cloud-edge architecture for intelligent IoT applications. To cope with the heterogeneity issues in IoT environments, we investigate emerging personalized federated learning methods which are able to mitigate the negative effects caused by heterogeneity in different aspects. With the power of edge computing, the requirements for fast-processing capacity and low latency in intelligent IoT applications can also be achieved. We finally provide a case study of IoT based human activity recognition to demonstrate the effectiveness of personalized federated learning for intelligent IoT applications.

cs.NI↗

Demonstration of Planar Ultrananocrystalline Diamond Field Emission Source Operating in SRF Injector at 2 Kelvin

Reported here is the first demonstration of electron beam generation in an SRF TESLA 1.3 GHz gun equipped with field emission cathode when operated at 2 Kelvin. The cathode is submicron film of nitrogen-incorporated ultrananocrystalline diamond [(N)UNCD] deposited atop a Nb RRR300 cathode plug. The output current was measured to increase exponentially as a function of the cavity gradient. Our results demonstrate a feasible path toward simplified fully cryogenic SRF injector technology. One important finding is that the electron emitter made of (N)UNCD, a material long been known as a highly efficient field emission material, demonstrated a record low turn-on gradient of 0.6 MV/m. A hypothesis explaining this behavior is proposed.

physics.acc-ph↗

DeepCP: Deep Learning Driven Cascade Prediction Based Autonomous Content Placement in Closed Social Network

Online social networks (OSNs) are emerging as the most popular mainstream platform for content cascade diffusion. In order to provide satisfactory quality of experience (QoE) for users in OSNs, much research dedicates to proactive content placement by using the propagation pattern, user's personal profiles and social relationships in open social network scenarios (e.g., Twitter and Weibo). In this paper, we take a new direction of popularity-aware content placement in a closed social network (e.g., WeChat Moment) where user's privacy is highly enhanced. We propose a novel data-driven holistic deep learning framework, namely DeepCP, for joint diffusion-aware cascade prediction and autonomous content placement without utilizing users' personal and social information. We first devise a time-window LSTM model for content popularity prediction and cascade geo-distribution estimation. Accordingly, we further propose a novel autonomous content placement mechanism CP-GAN which adopts the generative adversarial network (GAN) for agile placement decision making to reduce the content access latency and enhance users' QoE. We conduct extensive experiments using cascade diffusion traces in WeChat Moment (WM). Evaluation results corroborate that the proposed DeepCP framework can predict the content popularity with a high accuracy, generate efficient placement decision in a real-time manner, and achieve significant content access latency reduction over existing schemes.

cs.SI↗

Bandit Learning for Diversified Interactive Recommendation

Interactive recommender systems that enable the interactions between users and the recommender system have attracted increasing research attentions. Previous methods mainly focus on optimizing recommendation accuracy. However, they usually ignore the diversity of the recommendation results, thus usually results in unsatisfying user experiences. In this paper, we propose a novel diversified recommendation model, named Diversified Contextual Combinatorial Bandit (DC$^2$B), for interactive recommendation with users' implicit feedback. Specifically, DC$^2$B employs determinantal point process in the recommendation procedure to promote diversity of the recommendation results. To learn the model parameters, a Thompson sampling-type algorithm based on variational Bayesian inference is proposed. In addition, theoretical regret analysis is also provided to guarantee the performance of DC$^2$B. Extensive experiments on real datasets are performed to demonstrate the effectiveness of the proposed method.

cs.IR↗

Video-based Person Re-identification with Two-stream Convolutional Network and Co-attentive Snippet Embedding

Recently, the applications of person re-identification in visual surveillance and human-computer interaction are sharply increasing, which signifies the critical role of such a problem. In this paper, we propose a two-stream convolutional network (ConvNet) based on the competitive similarity aggregation scheme and co-attentive embedding strategy for video-based person re-identification. By dividing the long video sequence into multiple short video snippets, we manage to utilize every snippet's RGB frames, optical flow maps and pose maps to facilitate residual networks, e.g., ResNet, for feature extraction in the two-stream ConvNet. The extracted features are embedded by the co-attentive embedding method, which allows for the reduction of the effects of noisy frames. Finally, we fuse the outputs of both streams as the embedding of a snippet, and apply competitive snippet-similarity aggregation to measure the similarity between two sequences. Our experiments show that the proposed method significantly outperforms current state-of-the-art approaches on multiple datasets.

cs.IR↗

Recent Advances in Diversified Recommendation

With the rapid development of recommender systems, accuracy is no longer the only golden criterion for evaluating whether the recommendation results are satisfying or not. In recent years, diversity has gained tremendous attention in recommender systems research, which has been recognized to be an important factor for improving user satisfaction. On the one hand, diversified recommendation helps increase the chance of answering ephemeral user needs. On the other hand, diversifying recommendation results can help the business improve product visibility and explore potential user interests. In this paper, we are going to review the recent advances in diversified recommendation. Specifically, we first review the various definitions of diversity and generate a taxonomy to shed light on how diversity have been modeled or measured in recommender systems. After that, we summarize the major optimization approaches to diversified recommendation from a taxonomic view. Last but not the least, we project into the future and point out trending research directions on this topic.

cs.IR↗

Diversity-Promoting Deep Reinforcement Learning for Interactive Recommendation

Interactive recommendation that models the explicit interactions between users and the recommender system has attracted a lot of research attentions in recent years. Most previous interactive recommendation systems only focus on optimizing recommendation accuracy while overlooking other important aspects of recommendation quality, such as the diversity of recommendation results. In this paper, we propose a novel recommendation model, named \underline{D}iversity-promoting \underline{D}eep \underline{R}einforcement \underline{L}earning (D$^2$RL), which encourages the diversity of recommendation results in interaction recommendations. More specifically, we adopt a Determinantal Point Process (DPP) model to generate diverse, while relevant item recommendations. A personalized DPP kernel matrix is maintained for each user, which is constructed from two parts: a fixed similarity matrix capturing item-item similarity, and the relevance of items dynamically learnt through an actor-critic reinforcement learning framework. We performed extensive offline experiments as well as simulated online experiments with real world datasets to demonstrate the effectiveness of the proposed model.

cs.IR↗

PolarLight: a CubeSat X-ray Polarimeter based on the Gas Pixel Detector

The gas pixel detector (GPD) is designed and developed for high-sensitivity astronomical X-ray polarimetry, which is a new window about to open in a few years. Due to the small mass, low power, and compact geometry of the GPD, we propose a CubeSat mission Polarimeter Light (PolarLight) to demonstrate and test the technology directly in space. There is no optics but a collimator to constrain the field of view to 2.3 degrees. Filled with pure dimethyl ether (DME) at 0.8 atm and sealed by a beryllium window of 100 micron thick, with a sensitive area of about 1.4 mm by 1.4 mm, PolarLight allows us to observe the brightest X-ray sources on the sky, with a count rate of, e.g., ~0.2 counts/s from the Crab nebula. The PolarLight is 1U in size and mounted in a 6U CubeSat, which was launched into a low Earth Sun-synchronous orbit on October 29, 2018, and is currently under test. More launches with improved designs are planned in 2019. These tests will help increase the technology readiness for future missions such as the enhanced X-ray Timing and Polarimetry (eXTP), better understand the orbital background, and may help constrain the physics with observations of the brightest objects.

astro-ph.IM↗

Towards Non-Parametric Learning to Rank

This paper studies a stylized, yet natural, learning-to-rank problem and points out the critical incorrectness of a widely used nearest neighbor algorithm. We consider a model with $n$ agents (users) $\{x_i\}_{i \in [n]}$ and $m$ alternatives (items) $\{y_j\}_{j \in [m]}$, each of which is associated with a latent feature vector. Agents rank items nondeterministically according to the Plackett-Luce model, where the higher the utility of an item to the agent, the more likely this item will be ranked high by the agent. Our goal is to find neighbors of an arbitrary agent or alternative in the latent space. We first show that the Kendall-tau distance based kNN produces incorrect results in our model. Next, we fix the problem by introducing a new algorithm with features constructed from "global information" of the data matrix. Our approach is in sharp contrast to most existing feature engineering methods. Finally, we design another new algorithm identifying similar alternatives. The construction of alternative features can be done using "local information," highlighting the algorithmic difference between finding similar agents and similar alternatives.

cs.LG↗

Parameter-free $\ell_p$-Box Decoding of LDPC Codes

The Alternating Direction Method of Multipliers (ADMM) decoding of Low Density Parity Check (LDPC) codes has received many attentions due to its excellent performance at the error floor region. In this paper, we develop a parameter-free decoder based on Linear Program (LP) decoding by replacing the binary constraint with the intersection of a box and an $\ell_p$ sphere. An efficient $\ell_2$-box ADMM is designed to handle this model in a distributed fashion. Numerical experiments demonstrate that our decoder attains better adaptability to different Signal-to-Noise Ratio and channels.

cs.IT↗

Mechanism of Electric Power Generation from Ionic Droplet Motion on Polymer Supported Graphene

Graphene-based electric power generation that converts mechanical energy of flow of ionic droplets over the device surface into electricity has emerged as promising candidate for a blue-energy network. Yet the lack of a microscopic understanding of the underlying mechanism has prevented ability to optimize and control the performance of such devices. This requires information on interfacial structure and charging behavior at the molecular level. Here, we use sum-frequency vibrational spectroscopy (SFVS) to probe the interfaces of devices composed of aqueous solution, graphene and supporting polymer substrate. We discover that the surface dipole layer of the polymer is responsible for ion attraction toward and adsorption at the graphene surface that leads to electricity generation in graphene. Graphene itself does not attract ions and only acts as a conducting sheet for the induced carrier transport. Replacing the polymer by an organic ferroelectric substrate could enhance the efficiency and allow switching of the electricity generation. Our microscopic understanding of the electricity generation process paves the way for the rational design of scalable and more efficient droplet-motion-based energy transducer devices.

physics.app-ph↗

$L_2$-Box Optimization for Green Cloud-RAN via Network Adaptation

In this paper, we propose a reformulation for the Mixed Integer Programming (MIP) problem into an exact and continuous model through using the $\ell_2$-box technique to recast the binary constraints into a box with an $\ell_2$ sphere constraint. The reformulated problem can be tackled by a dual ascent algorithm combined with a Majorization-Minimization (MM) method for the subproblems to solve the network power consumption problem of the Cloud Radio Access Network (Cloud-RAN), and which leads to solving a sequence of Difference of Convex (DC) subproblems handled by an inexact MM algorithm. After obtaining the final solution, we use it as the initial result of the bi-section Group Sparse Beamforming (GSBF) algorithm to promote the group-sparsity of beamformers, rather than using the weighted $\ell_1 / \ell_2$-norm. Simulation results indicate that the new method outperforms the bi-section GSBF algorithm by achieving smaller network power consumption, especially in sparser cases, i.e., Cloud-RANs with a lot of Remote Radio Heads (RRHs) but fewer users.

eess.SP↗

Digital Domain Power Division Multiplexed Dual Polarization Coherent Optical OFDM Transmission

Capacity is the eternal pursuit for communication systems due to the overwhelming demand of bandwidth hungry applications. As the backbone infrastructure of modern communication networks, the optical fiber transmission system undergoes a significant capacity growth over decades by exploiting available physical dimensions (time, frequency, quadrature, polarization and space) of the optical carrier for multiplexing. For each dimension, stringent orthogonality must be guaranteed for perfect separation of independent multiplexed signals. To catch up with the ever-increasing capacity requirement, it is therefore interesting and important to develop new multiplexing methodologies relaxing the orthogonal constraint thus achieving better spectral efficiency and more flexibility of frequency reuse. Inspired by the idea of non-orthogonal multiple access (NOMA) scheme, here we propose a digital domain power division multiplexed (PDM) transmission technology which is fully compatible with current dual polarization (DP) coherent optical communication system. The coherent optical orthogonal frequency division multiplexing (CO-OFDM) modulation has been employed owing to its great superiority on high spectral efficiency, flexible coding, ease of channel estimation and robustness against fiber dispersion. And a PDM-DP-CO-OFDM has been theoretically and experimentally demonstrated with 100Gb/s wavelength division multiplexing (WDM) transmission over 1440km standard single mode fibers (SSMFs). Two baseband quadrature phase shift keying (QPSK) OFDM signals are overlaid together with different power levels. After IQ modulation, polarization multiplexing and long distance fiber transmission, the PDM-DP-CO-OFDM signal has been successfully recovered in the typical polarization diversity coherent receiver by successive interference cancellation (SIC) algorithm.

cs.IT↗

Spatially resolving density-dependent screening around a single charged atom in graphene

Electrons in two-dimensional graphene sheets behave as interacting chiral Dirac fermions and have unique screening properties due to their symmetry and reduced dimensionality. By using a combination of scanning tunneling spectroscopy (STM/STS) measurements and theoretical modeling we have characterized how graphene's massless charge carriers screen individual charged calcium atoms. A back-gated graphene device configuration has allowed us to directly visualize how the screening length for this system can be tuned with carrier density. Our results provide insight into electron-impurity and electron-electron interactions in a relativistic setting with important consequences for other graphene-based electronic devices.

cond-mat.mes-hall↗

Improving Deep Neural Network with Multiple Parametric Exponential Linear Units

Activation function is crucial to the recent successes of deep neural networks. In this paper, we first propose a new activation function, Multiple Parametric Exponential Linear Units (MPELU), aiming to generalize and unify the rectified and exponential linear units. As the generalized form, MPELU shares the advantages of Parametric Rectified Linear Unit (PReLU) and Exponential Linear Unit (ELU), leading to better classification performance and convergence property. In addition, weight initialization is very important to train very deep networks. The existing methods laid a solid foundation for networks using rectified linear units but not for exponential linear units. This paper complements the current theory and extends it to the wider range. Specifically, we put forward a way of initialization, enabling training of very deep networks using exponential linear units. Experiments demonstrate that the proposed initialization not only helps the training process but leads to better generalization performance. Finally, utilizing the proposed activation function and initialization, we present a deep MPELU residual architecture that achieves state-of-the-art performance on the CIFAR-10/100 datasets. The code is available at https://github.com/Coldmooon/Code-for-MPELU.

cs.CV↗

Sub-diffusion processes in Hilbert space and their associated stochastic differential equations and Fokker-Planck-Kolmogorov equations

This paper focuses on the time-changed Q-Wiener process, a Hilbert space-valued sub-diffusion. It is a martingale with respect to an appropriate filtration, hence a stochastic integral with respect to it is definable. For the resulting integral, two change of variables formulas are derived. Via a duality theorem for integrals, existence and uniqueness theorems for stochastic differential equations (SDEs) driven by the time-changed Q-Wiener process are discussed. Associated fractional Fokker-Planck-Kolmogorov equations are derived using either a time-changed Itô formula or duality. Connections are established between three integrals driven by time-changed versions of the Q-Wiener process, cylindrical Wiener process, and martingale measure.

math.PR↗

Stability of stochastic differential equations with respect to time-changed Brownian motions

In this paper, the stability behaviors of stochastic differential equations (SDEs) driven by time-changed Brownian motions are discussed. Based on the generalized Lyapunov method and stochastic analysis, necessary conditions are provided for solutions of time-changed SDEs to be stable in differential senses, such as stochastic stability, stochastically asymptotic stability and globally stochastically asymptotic stability. Also, a connection between the stability of the solution to the time-changed SDEs and that to their corresponding non-time-changed SDEs is revealed by applying the duality theorem. Finally, two examples are provided to illustrate the theoretical results.

math.PR↗