arXiv subjects

Sheng Chen

Publications and source records attributed to Sheng Chen.

At least 145 records · Page 8Linked to original sources

arXiv2020

Towards Playing Full MOBA Games with Deep Reinforcement Learning

MOBA games, e.g., Honor of Kings, League of Legends, and Dota 2, pose grand challenges to AI systems such as multi-agent, enormous state-action space, complex action control, etc. Developing AI for playing MOBA games has raised much attention accordingly. However, existing work falls short in handling the raw game complexity caused by the explosion of agent combinations, i.e., lineups, when expanding the hero pool in case that OpenAI's Dota AI limits the play to a pool of only 17 heroes. As a result, full MOBA games without restrictions are far from being mastered by any existing AI system. In this paper, we propose a MOBA AI learning paradigm that methodologically enables playing full MOBA games with deep reinforcement learning. Specifically, we develop a combination of novel and existing learning techniques, including curriculum self-play learning, policy distillation, off-policy adaption, multi-head value estimation, and Monte-Carlo tree-search, in training and playing a large pool of heroes, meanwhile addressing the scalability issue skillfully. Tested on Honor of Kings, a popular MOBA game, we show how to build superhuman AI agents that can defeat top esports players. The superiority of our AI is demonstrated by the first large-scale performance test of MOBA AI agent in the literature.

cs.AI↗

arXiv2020

Supervised Learning Achieves Human-Level Performance in MOBA Games: A Case Study of Honor of Kings

We present JueWu-SL, the first supervised-learning-based artificial intelligence (AI) program that achieves human-level performance in playing multiplayer online battle arena (MOBA) games. Unlike prior attempts, we integrate the macro-strategy and the micromanagement of MOBA-game-playing into neural networks in a supervised and end-to-end manner. Tested on Honor of Kings, the most popular MOBA at present, our AI performs competitively at the level of High King players in standard 5v5 games.

cs.AI↗

arXiv2020

Matrix-Monotonic Optimization Part I: Single-Variable Optimization

Matrix-monotonic optimization exploits the monotonic nature of positive semi-definite matrices to derive optimal diagonalizable structures for the matrix variables of matrix-variable optimization problems. Based on the optimal structures derived, the associated optimization problems can be substantially simplified and underlying physical insights can also be revealed. In our work, a comprehensive framework of the applications of matrix-monotonic optimization to multiple-input multiple-output (MIMO) transceiver design is provided for a series of specific performance metrics under various linear constraints. This framework consists of two parts, i.e., Part-I for single-variable optimization and Part-II for multi-variable optimization. In this paper, single-variable matrix-monotonic optimization is investigated under various power constraints and various types of channel state information (CSI) condition. Specifically, three cases are investigated: 1) both the transmitter and receiver have imperfect CSI; 2) perfect CSI is available at the receiver but the transmitter has no CSI; 3) perfect CSI is available at the receiver but the channel estimation error at the transmitter is norm-bounded. In all three cases, the matrix-monotonic optimization framework can be used for deriving the optimal structures of the optimal matrix variables.

cs.IT↗

arXiv2020

Matrix-Monotonic Optimization Part II: Multi-Variable Optimization

In contrast to Part I of this treatise [1] that focuses on the optimization problems associated with single matrix variables, in this paper, we investigate the application of the matrix-monotonic optimization framework in the optimization problems associated with multiple matrix variables. It is revealed that matrix-monotonic optimization still works even for multiple matrix-variate based optimization problems, provided that certain conditions are satisfied. Using this framework, the optimal structures of the matrix variables can be derived and the associated multiple matrix-variate optimization problems can be substantially simplified. In this paper, several specific examples are given, which are essentially open problems. Firstly, we investigate multi-user multiple-input multiple-output (MU- MIMO) uplink communications under various power constraints. Using the proposed framework, the optimal structures of the precoding matrices at each user under various power constraints can be derived. Secondly, we considered the optimization of the signal compression matrices at each sensor under various power constraints in distributed sensor networks. Finally, we investigate the transceiver optimization for multi-hop amplify-and-forward (AF) MIMO relaying networks with imperfect channel state information (CSI) under various power constraints. At the end of this paper, several simulation results are given to demonstrate the accuracy of the proposed theoretical results.

cs.IT↗

arXiv2020

Quantum Criticism: A Tagged News Corpus Analysed for Sentiment and Named Entities

In this research, we continuously collect data from the RSS feeds of traditional news sources. We apply several pre-trained implementations of named entity recognition (NER) tools, quantifying the success of each implementation. We also perform sentiment analysis of each news article at the document, paragraph and sentence level, with the goal of creating a corpus of tagged news articles that is made available to the public through a web interface. Finally, we show how the data in this corpus could be used to identify bias in news reporting.

cs.CY↗

arXiv2020

Compressive Sensing Based Massive Access for IoT Relying on Media Modulation Aided Machine Type Communications

A fundamental challenge of the large-scale Internet-of-Things lies in how to support massive machine-type communications (mMTC). This letter proposes a media modulation based mMTC solution for increasing the throughput, where a massive multi-input multi-output based base station (BS) is used for enhancing the detection performance. For such a mMTC scenario, the reliable active device detection and data decoding pose a serious challenge. By leveraging the sparsity of the uplink access signals of mMTC received at the BS, a compressive sensing based massive access solution is proposed for tackling this challenge. Specifically, we propose a block sparsity adaptive matching pursuit algorithm for detecting the active devices, whereby the block-sparsity of the uplink access signals exhibited across the successive time slots and the structured sparsity of media modulated symbols are exploited for enhancing the detection performance. Moreover, a successive interference cancellation based structured subspace pursuit algorithm is conceived for data demodulation of the active devices, whereby the structured sparsity of media modulation based symbols found in each time slot is exploited for improving the detection performance. Finally, our simulation results verify the superiority of the proposed scheme over state-of-the-art solutions.

cs.IT↗

arXiv2020

Collision-induced breakage of agglomerates in homogenous isotropic turbulence laden with adhesive particles

We carry out direct numerical simulation combined with adhesive discrete element calculations to investigate collision-induced breakage of agglomerates in homogeneous isotropic turbulence. Based on extensive simulation runs, an adhesion parameter Adn is constructed to quantify the possibility of occurrence of sticking, rebound, and breakage events. The collision-induced breakage rate is then formulated based on the Smoluchowski equation and a breakage fraction. The breakage fraction, defined as the fraction of collisions that result in breakage, is then analytically estimated by a convolution of the probability distribution of collision velocity and a universal transfer function. It is shown that the breakage rate decreases exponentially as the adhesion parameter Adn increases for doublets and scales as linear functions of the agglomerate size, with the slope controlled by Adn. These results allow one to estimate the breakage rate for early-stage agglomerates of arbitrary size. Moreover, the role of the flow structure on the collision-induced breakage is also examined. Violent collisions and breakages are more likely caused by particles ejected rapidly from strong vortices and happen in straining sheets. Our results extend the findings of shear-induced fragmentation, forming a more complete picture of breakage of agglomerates in turbulent flows.

physics.flu-dyn↗

arXiv2020

Log orthogonal functions: approximation properties and applications

We present two new classes of orthogonal functions, log orthogonal functions (LOFs) and generalized log orthogonal functions (GLOFs), which are constructed by applying a $\log$ mapping to Laguerre polynomials. We develop basic approximation theory for these new orthogonal functions and apply them to solve several typical fractional differential equations whose solutions exhibit weak singularities. Our error analysis and numerical results show that our methods based on the new orthogonal functions are particularly suitable for functions which have weak singularities at one endpoint, and can lead to exponential convergence rate, as opposed to low algebraic rates if usual orthogonal polynomials are used.

math.NA↗

arXiv2020

Hybrid Transceiver Optimization for Multi-Hop Communications

Multi-hop communication with the aid of large-scale antenna arrays will play a vital role in future emergence communication systems. In this paper, we investigate amplify-and-forward based and multiple-input multiple-output assisted multi-hop communication, in which all nodes employ hybrid transceivers. Moreover, channel errors are taken into account in our hybrid transceiver design. Based on the matrix-monotonic optimization framework, the optimal structures of the robust hybrid transceivers are derived. By utilizing these optimal structures, the optimizations of analog transceivers and digital transceivers can be separated without loss of optimality. This fact greatly simplifies the joint optimization of analog and digital transceivers. Since the optimization of analog transceivers under unit-modulus constraints is non-convex, a projection type algorithm is proposed for analog transceiver optimization to overcome this difficulty. Based on the derived analog transceivers, the optimal digital transceivers can then be derived using matrix-monotonic optimization. Numeral results obtained demonstrate the performance advantages of the proposed hybrid transceiver designs over other existing solutions.

cs.IT↗

arXiv2019

Channel Fingerprint Based Beam Tracking for Millimeter Wave Communications

Beamforming structures with fixed beam codebooks provide economical solutions for millimeter wave (mmWave) communications due to the low hardware cost. However, the training overhead to search for the optimal beamforming configuration is proportional to the codebook size. To improve the efficiency of beam tracking, we propose a beam tracking scheme based on the channel fingerprint database, which comprises mappings between statistical beamforming gains and user locations. The scheme tracks user movement by utilizing the trained beam configurations and estimating the gains of beam configurations that are not trained. Simulations show that the proposed scheme achieves significant beamforming performance gains over existing beam tracking schemes.

cs.IT↗

arXiv2019

Majorization-Minimization Aided Hybrid Transceivers for MIMO Interference Channels

The potential of deploying large-scale antenna arrays in future wireless systems has stimulated extensive research on hybrid transceiver designs aiming to approximate the optimal fully-digital schemes with much reduced hardware cost and signal processing complexity. Generally, this hybrid transceiver structure requires a joint design of analog and digital processing to enable both beamsteering and spatial multiplexing gains. In this paper, we develop various weighted mean-square-error minimization (WMMSE) based hybrid transceiver designs over multiple-input multiple-output (MIMO) interference channels at both millimeter wave (mmWave) and microwave frequencies. Firstly, a heuristic joint design of hybrid precoder and combiner using alternating optimization is proposed, in which the majorization-minimization (MM) method is utilized to design the analog precoder and combiner with unit-modulus constraints. It is validated that this scheme achieves the comparable performance to the WMMSE fully-digital solution. To further reduce the complexity, a phase projection-based two-stage scheme is proposed to decouple the designs of analog and digital precoder combiner. Secondly, inspired by the fully-digital solutions based on the block-diagonalization zero-forcing (BD-ZF) and signal-to-leakage-plus-noise ratio (SLNR) criteria, low-complexity MMbased BD-ZF and SLNR hybrid designs are proposed to well approximate the corresponding fully-digital solutions. Thirdly, the partially-connected hybrid structure for reducing system hardware cost and power consumption is considered, for which the MM-based alternating optimization still works. Numerical results demonstrate the similar or superior performance of all the above proposed schemes over the existing benchmarks.

cs.IT↗

arXiv2019

Closed-Loop Sparse Channel Estimation for Wideband Millimeter-Wave Full-Dimensional MIMO Systems

This paper proposes a closed-loop sparse channel estimation (CE) scheme for wideband millimeter-wave hybrid full-dimensional multiple-input multiple-output and time division duplexing based systems, which exploits the channel sparsity in both angle and delay domains. At the downlink CE stage, random transmit precoder is designed at base station (BS) for channel sounding, and receive combiners at user devices (UDs) are designed to visualize hybrid array as a low-dimensional digital array for facilitating the multi-dimensional unitary ESPRIT (MDU-ESPRIT) algorithm to estimate respective angle-of-arrivals (AoAs). At the uplink CE stage, the estimated downlink AoAs, namely, uplink angle-of-departures (AoDs), are exploited to design multi-beam transmit precoder at UDs to enable BS to estimate the uplink AoAs, i.e., the downlink AoDs, and delays of different UDs using the MDU-ESPRIT algorithm based on the designed receive combiners at BS. Furthermore, a maximum likelihood approach is proposed to pair the channel parameters acquired at the two stages, and the path gains are then obtained using least squares estimator. According to spectrum estimation theory, our solution can acquire the super-resolution estimations of the AoAs/AoDs and delays of sparse multipath components with low training overhead. Simulation results verify the better CE performance and lower computational complexity of our solution over existing state-of-the-art approaches.

cs.IT↗

arXiv2019

Integral points on twisted Markoff surfaces

We study the integral Hasse principle for affine varieties of the form ax^2+y^2+z^2-xyz=m ,using Brauer-Manin obstruction, and we produce examples whose Brauer groups include 4-torsion elements .We will construct their explicit representatives and compute local invariants in special places.

math.NT↗

arXiv2019

DeepSquare: Boosting the Learning Power of Deep Convolutional Neural Networks with Elementwise Square Operators

Modern neural network modules which can significantly enhance the learning power usually add too much computational complexity to the original neural networks. In this paper, we pursue very efficient neural network modules which can significantly boost the learning power of deep convolutional neural networks with negligible extra computational cost. We first present both theoretically and experimentally that elementwise square operator has a potential to enhance the learning power of neural networks. Then, we design four types of lightweight modules with elementwise square operators, named as Square-Pooling, Square-Softmin, Square-Excitation, and Square-Encoding. We add our four lightweight modules to Resnet18, Resnet50, and ShuffleNetV2 for better performance in the experiment on ImageNet 2012 dataset. The experimental results show that our modules can bring significant accuracy improvements to the base convolutional neural network models. The performance of our lightweight modules is even comparable to many complicated modules such as bilinear pooling, Squeeze-and-Excitation, and Gather-Excite. Our highly efficient modules are particularly suitable for mobile models. For example, when equipped with a single Square-Pooling module, the top-1 classification accuracy of ShuffleNetV2-0.5x on ImageNet 2012 is absolutely improved by 1.45% with no additional parameters and negligible inference time overhead.

cs.CV↗

arXiv2019

Attention-based Walking Gait and Direction Recognition in Wi-Fi Networks

The study of human gait recognition has been becoming an active research field. In this paper, we propose to adopt the attention-based Recurrent Neural Network (RNN) encoder-decoder framework to implement a cycle-independent human gait and walking direction recognition system in Wi-Fi networks. For capturing more human walking dynamics, two receivers together with one transmitter are deployed in different spatial layouts. In the proposed system, the Channel State Information (CSI) measurements from different receivers are first gathered together and refined to form an integrated walking profile. Then, the RNN encoder reads and encodes the walking profile into primary feature vectors. Given a specific recognition task, the decoder computes a corresponding attention vector which is a weighted sum of the primary features assigned with different attentions, and is finally used to predict the target. The attention scheme motivates our system to learn to adaptively align with different critical clips of CSI data sequence for human walking gait and direction recognitions. We implement our system on commodity Wi-Fi devices in indoor environment, and the experimental results demonstrate that our system can achieve average F1 scores of 89.69% for gait recognition from a group of 8 subjects and 95.06% for direction recognition from 8 walking directions, in addition, the average accuracies of these two recognition tasks both exceed 97%.

cs.HC↗

arXiv2018

Boosting Fronthaul Capacity: Global Optimization of Power Sharing for Centralized Radio Access Network

The limited fronthaul capacity imposes a challenge on the uplink of centralized radio access network (C-RAN). We propose to boost the fronthaul capacity of massive multiple-input multiple-output (MIMO) aided C-RAN by globally optimizing the power sharing between channel estimation and data transmission both for the user devices (UDs) and the remote radio units (RRUs). Intuitively, allocating more power to the channel estimation will result in more accurate channel estimates, which increases the achievable throughput. However, increasing the power allocated to the pilot training will reduce the power assigned to data transmission, which reduces the achievable throughput. In order to optimize the powers allocated to the pilot training and to the data transmission of both the UDs and the RRUs, we assign an individual power sharing factor to each of them and derive an asymptotic closed-form expression of the signal-to-interference-plus-noise for the massive MIMO aided C-RAN consisting of both the UD-to-RRU links and the RRU-to-baseband unit (BBU) links. We then exploit the C-RAN architecture's central computing and control capability for jointly optimizing the UDs' power sharing factors and the RRUs' power sharing factors aiming for maximizing the fronthaul capacity. Our simulation results show that the fronthaul capacity is significantly boosted by the proposed global optimization of the power allocation between channel estimation and data transmission both for the UDs and for their host RRUs. As a specific example of 32 receive antennas (RAs) deployed by RRU and 128 RAs deployed by BBU, the sum-rate of 10 UDs achieved with the optimal power sharing factors improves 33\% compared with the one attained without optimizing power sharing factors.

cs.IT↗

arXiv2018

Exponential Scaling in Early-stage Agglomeration of Adhesive Particles in Turbulence

We carry out direct numerical simulation together with an adhesive discrete element method calculation (DNS-DEM) to investigate agglomeration of particles in homogeneous isotropic turbulence (HIT). We report an exponential-form scaling for the size distribution of early-stage agglomerates, which is valid across a wide range of particle inertia and inter-particle adhesion values. Such scaling allows one to quantify the state of agglomeration using a single scale parameter. An agglomeration kernel is then constructed containing the information of agglomerate structures and the sticking probability. An explicit relationship between the sticking probability and microscale particle properties is also proposed based on the scaling analysis of the equation for head-on collisions. Our results extend Smoluchowski's theory to the condition of non-coalescing solid adhesive particles and can reproduce DNS-DEM results with a simple one-dimensional simulation.

physics.flu-dyn↗

arXiv2018

On non-feasible edge sets in matching-covered graphs

Let $G=(V,E)$ be a matching-covered graph and $X$ be an edge set of $G$. $X$ is said to be feasible if there exist two perfect matchings $M_1$ and $M_2$ in $G$ such that $|M_1\cap X|\not \equiv|M_2\cap X|\ (\mbox{mod } 2)$. For any $V_0\subseteq V$, $X$ is said to be switching-equivalent to $X\oplus \nabla_G(V_0)$, where $\nabla_G(V_0)$ is the set of edges in $G$ each of which has exactly one end in $V_0$ and $A \oplus B$ is the symmetric difference of two sets $A$ and $B$. Lukot'ka and Rollová showed that when $G$ is regular and bipartite, $X$ is non-feasible if and only if $X$ is switching-equivalent to $\emptyset$. This article extends Lukot'ka and Rollová's result by showing that this conclusion holds as long as $G$ is matching-covered and bipartite. This article also studies matching-covered graphs $G$ whose non-feasible edge sets are switching-equivalent to $\emptyset$ or $E$ and partially characterizes these matching-covered graphs in terms of their ear decompositions. Another aim of this article is to construct infinite many $r$-connected and $r$-regular graphs of class 1 containing non-feasible edge sets not switching-equivalent to either $\emptyset$ or $E$ for an arbitrary integer $r$ with $r\ge 3$, which provides negative answers to problems asked by Lukot'ka and Rollová and He, et al respectively.

math.CO↗