SearcharxivSearch

arXiv subjects

Hamidreza Tavafoghi

Publications and source records attributed to Hamidreza Tavafoghi.

10 recordsLinked to original sources

An Approach to Stochastic Dynamic Games with Asymmetric Information and Hidden Actions

We consider in discrete time, a general class of sequential stochastic dynamic games with asymmetric information with the following features. The underlying system has Markovian dynamics controlled by the agents' joint actions. Each agent's instantaneous utility depends on the current system state and the agents' joint actions. At each time instant each agent makes a private noisy observation of the current system state and the agents' actions in the previous time instant. In addition, at each time instant all agents have a common noisy observation of the current system state and their actions in the previous time instant. Each agent's actions are part of his private information. The objective is to determine Bayesian Nash Equilibrium (BNE) strategy profiles that are based on a compressed version of the agents' information and can be sequentially computed; such BNE strategy profiles may not always exist. We present an approach/methodology that achieves the above-stated objective, along with an instance of a game where BNE strategy profiles with the above-mentioned characteristics exist. We show that the methodology also works for the case where the agents have no common observations.

cs.MA

Safety Challenges for Autonomous Vehicles in the Absence of Connectivity

Autonomous vehicles (AVs) are promoted as a technology that will create a future with effortless driving and virtually no traffic accidents. AV companies claim that, when fully developed, the technology will eliminate 94% of all accidents that are caused by human error. These AVs will likely avoid the large number of crashes caused by impaired, distracted or reckless drivers. But there remains a significant proportion of crashes for which no driver is directly responsible. In particular, the absence of connectivity of an AV with its neighboring vehicles (V2V) and the infrastructure (I2V) leads to a lack of information that can induce such crashes. Since AV designs today do not require such connectivity, these crashes would persist in the future. Using prototypical examples motivated by the NHTSA pre-crash scenario typology, we show that fully autonomous vehicles cannot guarantee safety in the absence of connectivity. Combining theoretical models and empirical data, we also argue that such hazardous scenarios will occur with a significantly high probability. This suggests that incorporating connectivity is an essential step on the path towards safe AV technology.

cs.RO

Dynamic Games among Teams with Delayed Intra-Team Information Sharing

We analyze a class of stochastic dynamic games among teams with asymmetric information, where members of a team share their observations internally with a delay of $d$. Each team is associated with a controlled Markov Chain, whose dynamics are coupled through the players' actions. These games exhibit challenges in both theory and practice due to the presence of signaling and the increasing domain of information over time. We develop a general approach to characterize a subset of Nash Equilibria where the agents can use a compressed version of their information, instead of the full information, to choose their actions. We identify two subclasses of strategies: Sufficient Private Information Based (SPIB) strategies, which only compress private information, and Compressed Information Based (CIB) strategies, which compress both common and private information. We show that while SPIB-strategy-based equilibria always exist, the same is not true for CIB-strategy-based equilibria. We develop a backward inductive sequential procedure, whose solution (if it exists) provides a CIB strategy-based equilibrium. We identify some instances where we can guarantee the existence of a solution to the above procedure. Our results highlight the tension among compression of information, existence of (compression based) equilibria, and backward inductive sequential computation of such equilibria in stochastic dynamic games with asymmetric information.

cs.MA

A Queuing Approach to Parking: Modeling, Verification, and Prediction

We present a queuing model of parking dynamics and a model-based prediction method to provide real-time probabilistic forecasts of future parking occupancy. The queuing model has a non-homogeneous arrival rate and time-varying service time distribution. All statistical assumptions of the model are verified using data from 29 truck parking locations, each with between 55 and 299 parking spots. For each location and each spot the data specifies the arrival and departure times of a truck, for 16 months of operation. The modeling framework presented in this paper provides empirical support for queuing models adopted in many theoretical studies and policy designs. We discuss how our framework can be used to study parking problems in different environments. Based on the queuing model, we propose two prediction methods, a microscopic method and a macroscopic method, that provide a real-time probabilistic forecast of parking occupancy for an arbitrary forecast horizon. These model-based methods convert a probabilistic forecast problem into a parameter estimation problem that can be tackled using classical estimation methods such as regressions or pure machine learning algorithms. We characterize a lower bound for an arbitrary real-time prediction algorithm. We evaluate the performance of these methods using the truck data comparing the outcomes of their implementations with other model-based and model-free methods proposed in the literature.

cs.LG

Regulating TNCs: Should Uber and Lyft Set Their Own Rules?

We evaluate the impact of three proposed regulations of transportation network companies (TNCs) like Uber, Lyft and Didi: (1) a minimum wage for drivers, (2) a cap on the number of drivers or vehicles, and (3) a per-trip congestion tax. The impact is assessed using a queuing theoretic equilibrium model which incorporates the stochastic dynamics of the app-based ride-hailing matching platform, the ride prices and driver wages established by the platform, and the incentives of passengers and drivers. We show that a floor placed under driver earnings pushes the ride-hailing platform to hire more drivers and offer more rides, at the same time that passengers enjoy faster rides and lower total cost, while platform rents are reduced. Contrary to standard economic theory, enforcing a minimum wage for drivers benefits both drivers and passengers, and promotes the efficiency of the entire system. This surprising outcome holds for almost all model parameters, and it occurs because the wage floors curbs TNC labor market power. In contrast to a wage floor, imposing a cap on the number of vehicles hurts drivers, because the platform reaps all the benefits of limiting supply. The congestion tax has the expected impact: fares increase, wages and platform revenue decrease. We also construct variants of the model to briefly discuss platform subsidy, platform competition, and autonomous vehicles.

math.OC

A Unified Approach to Dynamic Decision Problems with Asymmetric Information - Part I: Non-Strategic Agents

We study a general class of dynamic multi-agent decision problems with asymmetric information and non-strategic agents, which includes dynamic teams as a special case. When agents are non-strategic, an agent's strategy is known to the other agents. Nevertheless, the agents' strategy choices and beliefs are interdependent over times, a phenomenon known as signaling. We introduce the notions of private information that effectively compresses the agents' information in a mutually consistent manner. Based on the notions of sufficient information, we propose an information state for each agent that is sufficient for decision making purposes. We present instances of dynamic multi-agent decision problems where we can determine an information state with a time-invariant domain for each agent. Furthermore, we present a generalization of the policy-independence property of belief in Partially Observed Markov Decision Processes (POMDP) to dynamic multi-agent decision problems. Within the context of dynamic teams with asymmetric information, the proposed set of information states leads to a sequential decomposition that decouples the interdependence between the agents' strategies and beliefs over time, and enables us to formulate a dynamic program to determine a globally optimal policy via backward induction.

cs.MA

A Unified Approach to Dynamic Decision Problems with Asymmetric Information - Part II: Strategic Agents

We study a general class of dynamic games with asymmetric information where agents' beliefs are strategy dependent, i.e. signaling occurs. We show that the notion of sufficient information, introduced in the companion paper team, can be used to effectively compress the agents' information in a mutually consistent manner that is sufficient for decision-making purposes. We present instances of dynamic games with asymmetric information where we can characterize a time-invariant information state for each agent. Based on the notion of sufficient information, we define a class of equilibria for dynamic games called Sufficient Information Based Perfect Bayesian Equilibrium (SIB-PBE). Utilizing the notion of SIB-PBE, we provide a sequential decomposition of dynamic games with asymmetric information over time; this decomposition leads to a dynamic program that determines SIB-PBE of dynamic games. Furthermore, we provide conditions under which we can guarantee the existence of SIB-PBE.

cs.MA

Dynamic Market Mechanisms for Wind Energy

We investigate the problem of market mechanism design for wind energy. We consider a dynamic two-step model with one strategic seller with wind generation and one buyer, who trade energy through a mechanism determined by a designer. The seller has private information about his technology and wind condition, which he learns dynamically over time. We consider (static) forward and real-time mechanisms that take place at time T=1 and T=2, respectively. We also propose a dynamic mechanism that provides a coupling between the outcomes of the forward and real-time markets. We show that the dynamic mechanism outperforms the forward and real-time mechanisms for a general objective of the designer. Therefore, we demonstrate the advantage of adopting dynamic market mechanisms over static market mechanisms for wind energy. The dynamic mechanism reveals information about wind generation in advance, and also provides flexibility for incorporation of new information arriving over time. We discuss how our results generalize to environments with many strategic sellers. We also study two variants of the dynamic mechanism that guarantee no penalty risk for the seller, and/or monitor the wind condition. We illustrate our results with a numerical example.

cs.GT

Dynamic Games with Asymmetric Information: Common Information Based Perfect Bayesian Equilibria and Sequential Decomposition

We formulate and analyze a general class of stochastic dynamic games with asymmetric information arising in dynamic systems. In such games, multiple strategic agents control the system dynamics and have different information about the system over time. Because of the presence of asymmetric information, each agent needs to form beliefs about other agents' private information. Therefore, the specification of the agents' beliefs along with their strategies is necessary to study the dynamic game. We use Perfect Bayesian equilibrium (PBE) as our solution concept. A PBE consists of a pair of strategy profile and belief system. In a PBE, every agent's strategy should be a best response under the belief system, and the belief system depends on agents' strategy profile when there is signaling among agents. Therefore, the circular dependence between strategy profile and belief system makes it difficult to compute PBE. Using the common information among agents, we introduce a subclass of PBE called common information based perfect Bayesian equilibria (CIB-PBE), and provide a sequential decomposition of the dynamic game. Such decomposition leads to a backward induction algorithm to compute CIB-PBE. We illustrate the sequential decomposition with an example of a multiple access broadcast game. We prove the existence of CIB-PBE for a subclass of dynamic games.

cs.GT

Optimal Energy Procurement from a Strategic Seller with Private Renewable and Conventional Generation

We consider a mechanism design problem for energy procurement, when there is one buyer and one seller, and the buyer is the mechanism designer. The seller can generate energy from conventional (deterministic) and renewable (random) plants, and has multi-dimensional private information which determines her production cost. The objective is to maximize the buyer's utility under the constraint that the seller voluntarily participates in the energy procurement process. We show that the optimal mechanism is a menu of contracts (nonlinear pricing) that the buyer offers to the seller, and the seller chooses one based on her private information.

math.OC