SearcharxivSearch

arXiv subjects

Yanchen Zhu

Publications and source records attributed to Yanchen Zhu.

3 recordsLinked to original sources

A Game-Theoretic Spatio-Temporal Reinforcement Learning Framework for Collaborative Public Resource Allocation

Public resource allocation involves the efficient distribution of resources, including urban infrastructure, energy, and transportation, to effectively meet societal demands. However, existing methods focus on optimizing the movement of individual resources independently, without considering their capacity constraints. To address this limitation, we propose a novel and more practical problem: Collaborative Public Resource Allocation (CPRA), which explicitly incorporates capacity constraints and spatio-temporal dynamics in real-world scenarios. We propose a new framework called Game-Theoretic Spatio-Temporal Reinforcement Learning (GSTRL) for solving CPRA. Our contributions are twofold: 1) We formulate the CPRA problem as a potential game and demonstrate that there is no gap between the potential function and the optimal target, laying a solid theoretical foundation for approximating the Nash equilibrium of this NP-hard problem; and 2) Our designed GSTRL framework effectively captures the spatio-temporal dynamics of the overall system. We evaluate GSTRL on two real-world datasets, where experiments show its superior performance. Our source codes are available in the supplementary materials.

cs.LG

Reinforcement Learning for Hybrid Charging Stations Planning and Operation Considering Fixed and Mobile Chargers

The success of vehicle electrification relies on efficient and adaptable charging infrastructure. Fixed-location charging stations often suffer from underutilization or congestion due to fluctuating demand, while mobile chargers offer flexibility by relocating as needed. This paper studies the optimal planning and operation of hybrid charging infrastructures that combine both fixed and mobile chargers within urban road networks. We formulate the Hybrid Charging Station Planning and Operation (HCSPO) problem, jointly optimizing the placement of fixed stations and the scheduling of mobile chargers. A charging demand prediction model based on Model Predictive Control (MPC) supports dynamic decision-making. To solve the HCSPO problem, we propose a deep reinforcement learning approach enhanced with heuristic scheduling. Experiments on real-world urban scenarios show that our method improves infrastructure availability - achieving up to 244.4% increase in coverage - and reduces user inconvenience with up to 79.8% shorter waiting times, compared to existing solutions.

cs.AI

Reputation dependent pricing strategy: analysis based on a Chinese C2C marketplace

Most online markets establish reputation systems to assist building trust between sellers and buyers. Sellers' reputations not only provide guidelines for buyers but may also inform sellers their optimal pricing strategy. In this research, we assumed two types of buyer: informed buyers and uninformed buyers. Informed buyers know more about the reputation about the seller but may incur a search cost. Then we developed a benchmark model and a competition model. We found that high reputation sellers and low reputation sellers adapt different pricing strategy depending on the informativeness of buyers and the competition among sellers. With a large proportion of informed buyers, high reputation sellers may charge lower price than low reputation sellers, which exists a negative price premium effect, in contrast to conclusions of some previous studies. Empirical findings were in consistence with our theoretical models. We collected data of five categories of products, televisions, laptops, cosmetics, shoes, and beverages, from Taobao, a leading C2C Chinese online market. Negative price premium effect was observed for TVs, laptops, and cosmetics; price premium effect was observed for beverages; no significant trend was observed for shoes. We infer product value and market complexity are the main factors of buyer informativeness.

econ.GN