arXiv subjects

Dusit Niyato

Publications and source records attributed to Dusit Niyato.

At least 775 records · Page 43Linked to original sources

arXiv2018

Deep Reinforcement Learning for Time Scheduling in RF-Powered Backscatter Cognitive Radio Networks

In an RF-powered backscatter cognitive radio network, multiple secondary users communicate with a secondary gateway by backscattering or harvesting energy and actively transmitting their data depending on the primary channel state. To coordinate the transmission of multiple secondary transmitters, the secondary gateway needs to schedule the backscattering time, energy harvesting time, and transmission time among them. However, under the dynamics of the primary channel and the uncertainty of the energy state of the secondary transmitters, it is challenging for the gateway to find a time scheduling mechanism which maximizes the total throughput. In this paper, we propose to use the deep reinforcement learning algorithm to derive an optimal time scheduling policy for the gateway. Specifically, to deal with the problem with large state and action spaces, we adopt a Double Deep-Q Network (DDQN) that enables the gateway to learn the optimal policy. The simulation results clearly show that the proposed deep reinforcement learning algorithm outperforms non-learning schemes in terms of network throughput.

cs.LG↗

arXiv2018

Towards Secure Blockchain-enabled Internet of Vehicles: Optimizing Consensus Management Using Reputation and Contract Theory

In Internet of Vehicles (IoV), data sharing among vehicles is essential to improve driving safety and enhance vehicular services. To ensure data sharing security and traceability, highefficiency Delegated Proof-of-Stake consensus scheme as a hard security solution is utilized to establish blockchain-enabled IoV (BIoV). However, as miners are selected from miner candidates by stake-based voting, it is difficult to defend against voting collusion between the candidates and compromised high-stake vehicles, which introduces serious security challenges to the BIoV. To address such challenges, we propose a soft security enhancement solution including two stages: (i) miner selection and (ii) block verification. In the first stage, a reputation-based voting scheme for the blockchain is proposed to ensure secure miner selection. This scheme evaluates candidates' reputation by using both historical interactions and recommended opinions from other vehicles. The candidates with high reputation are selected to be active miners and standby miners. In the second stage, to prevent internal collusion among the active miners, a newly generated block is further verified and audited by the standby miners. To incentivize the standby miners to participate in block verification, we formulate interactions between the active miners and the standby miners by using contract theory, which takes block verification security and delay into consideration. Numerical results based on a real-world dataset indicate that our schemes are secure and efficient for data sharing in BIoV.

cs.CR↗

arXiv2018

Optimal and Low-Complexity Dynamic Spectrum Access for RF-Powered Ambient Backscatter System with Online Reinforcement Learning

Ambient backscatter has been introduced with a wide range of applications for low power wireless communications. In this article, we propose an optimal and low-complexity dynamic spectrum access framework for RF-powered ambient backscatter system. In this system, the secondary transmitter not only harvests energy from ambient signals (from incumbent users), but also backscatters these signals to its receiver for data transmission. Under the dynamics of the ambient signals, we first adopt the Markov decision process (MDP) framework to obtain the optimal policy for the secondary transmitter, aiming to maximize the system throughput. However, the MDP-based optimization requires complete knowledge of environment parameters, e.g., the probability of a channel to be idle and the probability of a successful packet transmission, that may not be practical to obtain. To cope with such incomplete knowledge of the environment, we develop a low-complexity online reinforcement learning algorithm that allows the secondary transmitter to "learn" from its decisions and then attain the optimal policy. Simulation results show that the proposed learning algorithm not only efficiently deals with the dynamics of the environment, but also improves the average throughput up to 50% and reduces the blocking probability and delay up to 80% compared with conventional methods.

cs.NI↗

arXiv2018

Competitive Data Trading in Wireless-Powered Internet of Things (IoT) Crowdsensing Systems with Blockchain

With the explosive growth of smart IoT devices at the edge of the Internet, embedding sensors on mobile devices for massive data collection and collective environment sensing has been envisioned as a cost-effective solution for IoT applications. However, existing IoT platforms and framework rely on dedicated middleware for (semi-) centralized task dispatching, data storage and incentive provision. Consequently, they are usually expensive to deploy, have limited adaptability to diverse requirements, and face a series of data security and privacy issues. In this paper, we employ permissionless blockchains to construct a purely decentralized platform for data storage and trading in a wireless-powered IoT crowdsensing system. In the system, IoT sensors use power wirelessly transferred from RF-energy beacons for data sensing and transmission to an access point. The data is then forwarded to the blockchain for distributed ledger services, i.e., data/transaction verification, recording, and maintenance. Due to coupled interference of wireless transmission and transaction fee incurred from blockchain's distributed ledger services, rational sensors have to decide on their transmission rates to maximize individual utility. Thus, we formulate a noncooperative game model to analyze this competitive situation among the sensors. We provide the analytical condition for the existence of the Nash equilibrium as well as a series of insightful numerical results about the equilibrium strategies in the game.

cs.NI↗

arXiv2018

Multi-operator spectrum sharing using matching game in small cells network

In this paper, we study a problem where multiple operators (OPs) need to share a common pool of spectrum with each other. Our objective is to maximize the social welfare, defined as the overall weighted sum rate of the OPs. The problem is decomposed into two parts: the first part is to allocate RBs to OPs, which we do so by extending the framework of many-to-one matching game with externalities. The second part is to allocate power of small cell base stations (SBSs) belonging to each OP, which is accomplished using reinforcement learning. Assuming that the SBSs associated with each OPs are spatially distributed according to Poisson point process (PPP), we show that pairwise stable matchings achieve local maximas of the social welfare function. We propose two algorithms to search for the stable matchings. Simulation results show that these algorithms are well behaved in terms of convergence and efficiency of the solutions.

cs.GT↗

arXiv2018

Reinforcement Learning Approach for RF-Powered Cognitive Radio Network with Ambient Backscatter

For an RF-powered cognitive radio network with ambient backscattering capability, while the primary channel is busy, the RF-powered secondary user (RSU) can either backscatter the primary signal to transmit its own data or harvest energy from the primary signal (and store in its battery). The harvested energy then can be used to transmit data when the primary channel becomes idle. To maximize the throughput for the secondary system, it is critical for the RSU to decide when to backscatter and when to harvest energy. This optimal decision has to account for the dynamics of the primary channel, energy storage capability, and data to be sent. To tackle that problem, we propose a Markov decision process (MDP)-based framework to optimize RSU's decisions based on its current states, e.g., energy, data as well as the primary channel state. As the state information may not be readily available at the RSU, we then design a low-complexity online reinforcement learning algorithm that guides the RSU to find the optimal solution without requiring prior- and complete-information from the environment. The extensive simulation results then clearly show that the proposed solution achieves higher throughputs, i.e., up to 50%, than that of conventional methods.

cs.NI↗

arXiv2018

Supplier Cooperation in Drone Delivery

Recently, unmanned aerial vehicles (UAVs), also known as drones, has emerged as an efficient and cost-effective solution for package delivery. Especially, drones are expected to incur lower cost, and achieve fast and environment friendly delivery. While most of existing drone research concentrates on surveillance applications, few works studied the drone package delivery planning problem. Even so, the previous works only focus on the drone delivery planning of a single supplier. In this paper, thus we propose the supplier cooperation in drone delivery (CoDD) framework. The framework considers jointly package assignment, supplier cooperation, and cost management. The objective of the framework is to help suppliers minimize and achieve fair share of the cost as well as reach a stable cooperation. The trade-off between using drones and outsourcing package delivery to a carrier is also investigated. The performance evaluation of the CoDD framework is conducted by using the Solomon benchmark suite and a real Singapore dataset which evidently confirms the practical findings.

math.OC↗

arXiv2018

Joint Ground and Aerial Package Delivery Services: A Stochastic Optimization Approach

Unmanned aerial vehicles (UAVs), also known as drones, have emerged as a promising mode of fast, energy-efficient, and cost-effective package delivery. A considerable number of works have studied different aspects of drone package delivery service by a supplier, one of which is delivery planning. However, existing works addressing the planning issues consider a simple case of perfect delivery without service interruption, e.g., due to accident which is common and realistic. Therefore, this paper introduces the joint ground and aerial delivery service optimization and planning (GADOP) framework. The framework explicitly incorporates uncertainty of drone package delivery, i.e., takeoff and breakdown conditions. The GADOP framework aims to minimize the total delivery cost given practical constraints, e.g., traveling distance limit. Specifically, we formulate the GADOP framework as a three-stage stochastic integer programming model. To deal with the high complexity issue of the problem, a decomposition method is adopted. Then, the performance of the GADOP framework is evaluated by using two data sets including Solomon benchmark suite and the real data from one of the Singapore logistics companies. The performance evaluation clearly shows that the GADOP framework can achieve significantly lower total payment than that of the baseline methods which do not take uncertainty into account.

cs.AI↗

arXiv2018

A Socially-Aware Incentive Mechanism for Mobile Crowdsensing Service Market

Mobile Crowdsensing has shown a great potential to address large-scale problems by allocating sensing tasks to pervasive Mobile Users (MUs). The MUs will participate in a Crowdsensing platform if they can receive satisfactory reward. In this paper, in order to effectively and efficiently recruit sufficient MUs, i.e., participants, we investigate an optimal reward mechanism of the monopoly Crowdsensing Service Provider (CSP). We model the rewarding and participating as a two-stage game, and analyze the MUs' participation level and the CSP's optimal reward mechanism using backward induction. At the same time, the reward is designed taking the underlying social network effects amid the mobile social network into account, for motivating the participants. Namely, one MU will obtain additional benefits from information contributed or shared by local neighbours in social networks. We derive the analytical expressions for the discriminatory reward as well as uniform reward with complete information, and approximations of reward incentive with incomplete information. Performance evaluation reveals that the network effects tremendously stimulate higher mobile participation level and greater revenue of the CSP. In addition, the discriminatory reward enables the CSP to extract greater surplus from this Crowdsensing service market.

cs.GT↗

arXiv2018

Dynamic Pricing for Revenue Maximization in Mobile Social Data Market with Network Effects

Mobile data demand is increasing tremendously in wireless social networks, and thus an efficient pricing scheme for social-enabled services is urgently needed. Though static pricing is dominant in the actual data market, price intuitively ought to be dynamically changed to yield greater revenue. The critical question is how to design the optimal dynamic pricing scheme, with prospects for maximizing the expected long-term revenue. In this paper, we study the sequential dynamic pricing scheme of a monopoly mobile network operator in the social data market. In the market, the operator, i.e., the seller, individually offers each mobile user, i.e., the buyer, a certain price in multiple time periods dynamically and repeatedly. The proposed scheme exploits the network effects in the mobile users' behaviors that boost the social data demand. Furthermore, due to limited radio resource, the impact of wireless network congestion is taken into account in the pricing scheme. Thereafter, we propose a modified sequential pricing policy in order to ensure social fairness among mobile users in terms of their individual utilities. We analytically demonstrate that the proposed sequential dynamic pricing scheme can help the operator gain greater revenue and mobile users achieve higher total utilities than those of the baseline static pricing scheme. To gain more insights, we further study a simultaneous dynamic pricing scheme in which the operator determines the pricing strategy at the beginning of each time period. Mobile users decide on their individual data demand in each time period simultaneously, considering the network effects in the social domain and the congestion effects in the network domain. We construct the social graph using Erdős-Rényi (ER) model and the real dataset based social network for performance evaluation.

cs.GT↗

arXiv2018

Game Theoretic Analysis for Joint Sponsored and Edge Caching Content Service Market

With a sponsored content scheme in a wireless network, a sponsored content service provider can pay to a network operator on behalf of the mobile users/subscribers to lower down the network subscription fees at the reasonable cost in terms of receiving some amount of advertisements. As such, content providers, network operators and mobile users are all actively motivated to participate in the sponsored content ecosystem. Meanwhile, in 5G cellular networks, caching technique is employed to improve content service quality, which stores potentially popular contents on edge networks nodes to serve mobile users. In this work, we propose the joint sponsored and edge caching content service market model. We investigate an interplay between the sponsored content service provider and the edge caching content service provider under the non-cooperative game framework. Furthermore, a three-stage Stackelberg game is formulated to model the interactions among the network operator, content service provider, and mobile users. Sub-game perfect equilibrium in each stage is analyzed by backward induction. The existence of Stackelberg equilibrium is validated by employing the bilevel optimization programming. Based on the game properties, we propose a sub-gradient based iterative algorithm, which ensures to converge to the Stackelberg equilibrium.

cs.GT↗

arXiv2018

A Hierarchical Game with Strategy Evolution for Mobile Sponsored Content and Service Markets

In sponsored content and service markets, the content and service providers are able to subsidize their target mobile users through directly paying the mobile network operator, to lower the price of the data/service access charged by the network operator to the mobile users. The sponsoring mechanism leads to a surge in mobile data and service demand, which in return compensates for the sponsoring cost and benefits the content/service providers. In this paper, we study the interactions among the three parties in the market, namely, the mobile users, the content/service providers and the network operator, as a two-level game with multiple Stackelberg (i.e., leader) players. Our study is featured by the consideration of global network effects owning to consumers' grouping. Since the mobile users may have bounded rationality, we model the service-selection process among them as an evolutionary-population follower sub-game. Meanwhile, we model the pricing-then-sponsoring process between the content/service providers and the network operator as a non-cooperative equilibrium searching problem. By investigating the structure of the proposed game, we reveal a few important properties regarding the equilibrium existence, and propose a distributed, projection-based algorithm for iterative equilibrium searching. Simulation results validate the convergence of the proposed algorithm, and demonstrate how sponsoring helps improve both the providers' profits and the users' experience.

cs.NI↗

arXiv2018

Market-Oriented Information Trading in Internet of Things (IoT) for Smart Cities

Internet of Things (IoT) technology is a fundamental infrastructure for information transmission and integration in smart city implementations to achieve effective fine-grained city management, efficient operations, and improved life quality of citizens. Smart-city IoT systems usually involve high volume and variety of information circulation. The information lifecycle also involves many parties, stakeholders, and entities such as individuals, businesses, and government agencies with their own objectives which needed to be incentivized properly. As such, recent studies have modeled smart-city IoT systems as a market, where information is treated as a commodity by market participants. In this work, we first present a general information-centric system architecture to analyze smart-city IoT systems. We then discuss features of market-oriented approaches in IoT, including market incentive, IoT service pattern, information freshness, and social impacts. System design chanlenges and related work are also reviewed. Finally, we optimize information trading in smart-city IoT systems, considering direct and indirect network externalities in a social domain.

cs.DC↗

arXiv2018

When Mobile Blockchain Meets Edge Computing

Blockchain, as the backbone technology of the current popular Bitcoin digital currency, has become a promising decentralized data management framework. Although blockchain has been widely adopted in many applications, e.g., finance, healthcare, and logistics, its application in mobile services is still limited. This is due to the fact that blockchain users need to solve preset proof-of-work puzzles to add new data, i.e., a block, to the blockchain. Solving the proof-of-work, however, consumes substantial resources in terms of CPU time and energy, which is not suitable for resource-limited mobile devices. To facilitate blockchain applications in future mobile Internet of Things systems, multiple access mobile edge computing appears to be an auspicious solution to solve the proof-of-work puzzles for mobile users. We first introduce a novel concept of edge computing for mobile blockchain. Then, we introduce an economic approach for edge computing resource management. Moreover, a prototype of mobile edge computing enabled blockchain systems is presented with experimental results to justify the proposed concept.

cs.DC↗

arXiv2018

Stackelberg Game for Distributed Time Scheduling in RF-Powered Backscatter Cognitive Radio Networks

In this paper, we study the transmission strategy adaptation problem in an RF-powered cognitive radio network, in which hybrid secondary users are able to switch between the harvest-then-transmit mode and the ambient backscatter mode for their communication with the secondary gateway. In the network, a monetary incentive is introduced for managing the interference caused by the secondary transmission with imperfect channel sensing. The sensing-pricing-transmitting process of the secondary gateway and the transmitters is modeled as a single-leader-multi-follower Stackelberg game. Furthermore, the follower sub-game among the secondary transmitters is modeled as a generalized Nash equilibrium problem with shared constraints. Based on our theoretical discoveries regarding the properties of equilibria in the follower sub-game and the Stackelberg game, we propose a distributed, iterative strategy searching scheme that guarantees the convergence to the Stackelberg equilibrium. The numerical simulations show that the proposed hybrid transmission scheme always outperforms the schemes with fixed transmission modes. Furthermore, the simulations reveal that the adopted hybrid scheme is able to achieve a higher throughput than the sum of the throughput obtained from the schemes with fixed transmission modes.

cs.NI↗

arXiv2018

Joint Communication, Computation, Caching, and Control in Big Data Multi-access Edge Computing

The concept of multi-access edge computing (MEC) has been recently introduced to supplement cloud computing by deploying MEC servers to the network edge so as to reduce the network delay and alleviate the load on cloud data centers. However, compared to a resourceful cloud, an MEC server has limited resources. When each MEC server operates independently, it cannot handle all of the computational and big data demands stemming from the users devices. Consequently, the MEC server cannot provide significant gains in overhead reduction due to data exchange between users devices and remote cloud. Therefore, joint computing, caching, communication, and control (4C) at the edge with MEC server collaboration is strongly needed for big data applications. In order to address these challenges, in this paper, the problem of joint 4C in big data MEC is formulated as an optimization problem whose goal is to maximize the bandwidth saving while minimizing delay, subject to the local computation capability of user devices, computation deadline, and MEC resource constraints. However, the formulated problem is shown to be non-convex. To make this problem convex, a proximal upper bound problem of the original formulated problem that guarantees descent to the original problem is proposed. To solve the proximal upper bound problem, a block successive upper bound minimization (BSUM) method is applied. Simulation results show that the proposed approach increases bandwidth-saving and minimizes delay while satisfying the computation deadlines.

cs.NI↗

arXiv2018

Optimal Stochastic Package Delivery Planning with Deadline: A Cardinality Minimization in Routing

Vehicle Routing Problem with Private fleet and common Carrier (VRPPC) has been proposed to help a supplier manage package delivery services from a single depot to multiple customers. Most of the existing VRPPC works consider deterministic parameters which may not be practical and uncertainty has to be taken into account. In this paper, we propose the Optimal Stochastic Delivery Planning with Deadline (ODPD) to help a supplier plan and optimize the package delivery. The aim of ODPD is to service all customers within a given deadline while considering the randomness in customer demands and traveling time. We formulate the ODPD as a stochastic integer programming, and use the cardinality minimization approach for calculating the deadline violation probability. To accelerate computation, the L-shaped decomposition method is adopted. We conduct extensive performance evaluation based on real customer locations and traveling time from Google Map.

cs.AI↗

arXiv2018

Edge Caching in Delay-Constrained Virtualized Cellular Networks: Analysis and Market

Caching of popular contents at cellular base stations, i.e., edge caching, in order to eliminate duplicate transmission through the backhaul can reduce the latency of data delivery in $5$G networks. However, since caching can only reduce the backhaul delay, techniques such as base station densification will also need to be used to reduce the fronthaul delay. In this paper, using results from stochastic geometry, we first model the effects of base station densification and cache size on the latency of the system. We then derive a tight approximation for the cache hit probability. To optimize the network cost due to the deployment of base station (BS) and cache storage, a minimization problem for the product of the BS intensity and cache size is formulated under probabilistic delay constraint, which is converted into a geometric program and solved analytically. The results are then used to analyze the economics of a cache-enabled virtualized cellular network where the network infrastructure, i.e., BSs and cache storage, owned by an infrastructure provider (InP) is shared among multiple mobile network operators (MNOs). For the pricing between the InP and the MNOs, we formulate a Stackelberg game with the InP as the leader and multiple MNOs as the followers. In this virtualized scenario, the common cost of renting the infrastructure is shared in a fair manner among the MNOs by using the Shapely value. An efficient algorithm is provided to divide the rent among MNOs.

cs.IT↗