arXiv subjects

Junjie Qin

Publications and source records attributed to Junjie Qin.

29 records · Page 2Linked to original sources

arXiv2022

Electric Vehicle Battery Sharing Game for Mobile Energy Storage Provision in Power Networks

Electric vehicles (EVs) equipped with a bidirectional charger can provide valuable grid services as mobile energy storage. However, proper financial incentives need to be in place to enlist EV drivers to provide services to the grid. In this paper, we consider two types of EV drivers who may be willing to provide mobile storage service using their EVs: commuters taking a fixed route, and on-demand EV drivers who receive incentives from a transportation network company (TNC) and are willing to take any route. We model the behavior of each type of driver using game theoretic methods, and characterize the Nash equilibrium (NE) of an EV battery sharing game where each EV driver withdraws power from the grid to charge its EV battery at the origin of a route, travels from the origin to the destination, and then discharges power back to the grid at the destination of the route. The driver earns a payoff that depends on the participation of other drivers and power network conditions. We characterize the NE in three situations: when there are only commuters, when there are only on-demand TNC drivers, and when the two groups of drivers co-exist. In particular, we show that the equilibrium outcome supports the social welfare in each of these three cases.

eess.SY↗

arXiv2022

Optimal Ordering Policies for Multi-Echelon Supply Networks

In this paper, we formulate an optimal ordering policy as a stochastic control problem where each firm decides the amount of input goods to order from their upstream suppliers based on the current inventory level of its output good. For this purpose, we provide a closed-form solution for the optimal request of the raw materials for given a fixed production policy. We implement the proposed policy on a 15-firm acyclic network based on a real product supply chain. We first simulate ideal demand situations, and then we implement demand-side shocks (i.e., demand levels outside of those considered in the policy formulation) and supply-side shocks (i.e., halts in production for some suppliers) to evaluate the robustness of the proposed policies.

math.OC↗

arXiv2020

Off-Street Parking for TNC Vehicles to Reduce Cruising Traffic

This paper considers off-street parking for the cruising vehicles of transportation network companies (TNCs) to reduce the traffic congestion. We propose a novel business that integrates the shared parking service into the TNC platform. In the proposed model, the platform (a) provides interfaces that connect passengers, drivers and garage operators (commercial or private garages); (b) determines the ride fare, driver payment, and parking rates; (c) matches passengers to TNC vehicles for ride-hailing services; and (d) matches vacant TNC vehicles to unoccupied parking garages to reduce the cruising cost. A queuing-theoretic model is proposed to capture the matching process of passengers, drivers, and parking garages. A market-equilibrium model is developed to capture the incentives of the passengers, drivers, and garage operators. An optimization-based model is formulated to capture the optimal pricing of the TNC platform. Through a realistic case study, we show that the proposed business model will offer a Pareto improvement that benefits all stakeholders, which leads to higher passenger surplus, higher drivers surplus, higher garage operator surplus, higher platform profit, and reduced traffic congestion.

math.OC↗

arXiv2018

The Value of Distributed Energy Resources for Heterogeneous Residential Consumers

The presence of behind-the-meter rooftop photovoltaics and storage in the residential sector is poised to increase significantly. Here we quantify in detail the value of these technologies to consumers and service providers. We characterize the heterogeneity in household electricity cost savings under time-varying prices due to consumption behavior differences. Different pricing policies significantly alter how households fare with respect to one another. Furthermore, household savings in absolute terms are not strongly correlated with savings normalized by PV and storage system size. We characterize the financial value of improved forecasting capabilities for a household, finding that it is a relatively small fraction of a household's cost savings. Coordination services that combine the resources available at all households can reduce costs by an additional 10% to 15% of the original total cost. Surprisingly, coordination service providers will not encourage adoption beyond 35-55% within a group. We present a simple model that explains the value of coordination and its relationship to the pricing of distribution services.

eess.SY↗

arXiv2017

Flexible Market for Smart Grid: Coordinated Trading of Contingent Contracts

A coordinated trading process is proposed as a design for an electricity market with significant uncertainty, perhaps from renewables. In this process, groups of agents propose to the system operator (SO) a contingent buy and sell trade that is balanced, i.e. the sum of demand bids and the sum of supply bids are equal. The SO accepts the proposed trade if no network constraint is violated or curtails it until no violation occurs. Each proposed trade is accepted or curtailed as it is presented. The SO also provides guidance to help future proposed trades meet network constraints. The SO does not set prices, and there is no requirement that different trades occur simultaneously or clear at uniform prices. Indeed, there is no price-setting mechanism. However, if participants exploit opportunities for gain, the trading process will lead to an efficient allocation of energy and to the discovery of locational marginal prices (LMPs). The great flexibility in the proposed trading process and the low communication and control burden on the SO may make the process suitable for coordinating producers and consumers in the distribution system.

math.OC↗

arXiv2015

Online Modified Greedy Algorithm for Storage Control under Uncertainty

This paper studies the general problem of operating energy storage under uncertainty. Two fundamental sources of uncertainty are considered, namely the uncertainty in the unexpected fluctuation of the net demand process and the uncertainty in the locational marginal prices. We propose a very simple algorithm termed Online Modified Greedy (OMG) algorithm for this problem. A stylized analysis for the algorithm is performed, which shows that comparing to the optimal cost of the corresponding stochastic control problem, the sub-optimality of OMG is bounded and approaches zero in various scenarios. This suggests that, albeit simple, OMG is guaranteed to have good performance in some cases; and in other cases, OMG together with the sub-optimality bound can be used to provide a lower bound for the optimal cost. Such a lower bound can be valuable in evaluating other heuristic algorithms. For the latter cases, a semidefinite program is derived to minimize the sub-optimality bound of OMG. Numerical experiments are conducted to verify our theoretical analysis and to demonstrate the use of the algorithm.

math.OC↗

arXiv2015

Control of Generalized Energy Storage Networks

The integration of intermittent and volatile renewable energy resources requires increased flexibility in the operation of the electric grid. Storage, broadly speaking, provides the flexibility of shifting energy over time; network, on the other hand, provides the flexibility of shifting energy over geographical locations. The optimal control of general storage networks in uncertain environments is an important open problem. The key challenge is that, even in small networks, the corresponding constrained stochastic control problems with continuous spaces suffer from curses of dimensionality, and are intractable in general settings. For large networks, no efficient algorithm is known to give optimal or near-optimal performance. This paper provides an efficient and provably near-optimal algorithm to solve this problem in a very general setting. We study the optimal control of generalized storage networks, i.e., electric networks connected to distributed generalized storages. Here generalized storage is a unifying dynamic model for many components of the grid that provide the functionality of shifting energy over time, ranging from standard energy storage devices to deferrable or thermostatically controlled loads. An online algorithm is devised for the corresponding constrained stochastic control problem based on the theory of Lyapunov optimization. We prove that the algorithm is near-optimal, and construct a semidefinite program to min- imize the sub-optimality bound. The resulting bound is a constant that depends only on the parameters of the storage network and cost functions, and is independent of uncertainty realizations. Numerical examples are given to demonstrate the effectiveness of the algorithm.

math.OC↗

arXiv2014

Weighted Difference Approximation of Value Functions for Slow-Discounting Markov Decision Processes

Processes (MDPs) often require frequent decision making, that is, taking an action every microsecond, second, or minute. Infinite horizon discount reward formulation is still relevant for a large portion of these applications, because actual time span of these problems can be months or years, during which discounting factors due to e.g. interest rates are of practical concern. In this paper, we show that, for such MDPs with discount rate $α$ close to $1$, under a common ergodicity assumption, a weighted difference between two successive value function estimates obtained from the classical value iteration (VI) is a better approximation than the value function obtained directly from VI. Rigorous error bounds are established which in turn show that the approximation converges to the actual value function in a rate $(αβ)^k$ with $β<1$. This indicates a geometric convergence even if discount factor $α\to 1$. Furthermore, we explicitly link the convergence speed to the system behaviors of the MDP using the notion of $ε-$mixing time and extend our result to Q-functions. Numerical experiments are conducted to demonstrate the convergence properties of the proposed approximation scheme.

math.OC↗

arXiv2014

Distributed Online Modified Greedy Algorithm for Networked Storage Operation under Uncertainty

The integration of intermittent and stochastic renewable energy resources requires increased flexibility in the operation of the electric grid. Storage, broadly speaking, provides the flexibility of shifting energy over time; network, on the other hand, provides the flexibility of shifting energy over geographical locations. The optimal control of storage networks in stochastic environments is an important open problem. The key challenge is that, even in small networks, the corresponding constrained stochastic control problems on continuous spaces suffer from curses of dimensionality, and are intractable in general settings. For large networks, no efficient algorithm is known to give optimal or provably near-optimal performance for this problem. This paper provides an efficient algorithm to solve this problem with performance guarantees. We study the operation of storage networks, i.e., a storage system interconnected via a power network. An online algorithm, termed Online Modified Greedy algorithm, is developed for the corresponding constrained stochastic control problem. A sub-optimality bound for the algorithm is derived, and a semidefinite program is constructed to minimize the bound. In many cases, the bound approaches zero so that the algorithm is near-optimal. A task-based distributed implementation of the online algorithm relying only on local information and neighbor communication is then developed based on the alternating direction method of multipliers. Numerical examples verify the established theoretical performance bounds, and demonstrate the scalability of the algorithm.

math.OC↗

arXiv2013

Risk Limiting Dispatch with Ramping Constraints

Reliable operation in power systems is becoming more difficult as the penetration of random renewable resources increases. In particular, operators face the risk of not scheduling enough traditional generators in the times when renewable energies becomes lower than expected. In this paper we study the optimal trade-off between system and risk, and the cost of scheduling reserve generators. We explicitly model the ramping constraints on the generators. We model the problem as a multi-period stochastic control problem, and we show the structure of the optimal dispatch. We then show how to efficiently compute the dispatch using two methods: i) solving a surrogate chance constrained program, ii) a MPC-type look ahead controller. Using real world data, we show the chance constrained dispatch outperforms the MPC controller and is also robust to changes in the probability distribution of the renewables.

math.OC↗

arXiv2012

Risk Limiting Dispatch with Fast Ramping Storage

Risk Limiting Dispatch (RLD) was proposed recently as a mechanism that utilizes information and market recourse to reduce reserve capacity requirements, emissions and achieve other system operator objectives. It induces a set of simple dispatch rules that can be easily embedded into the existing dispatch systems to provide computationally efficient and reliable decisions. Storage is emerging as an alternative to mitigate the uncertainty in the grid. This paper extends the RLD framework to incorporate fast-ramping storage. It developed a closed form threshold rule for the optimal stochastic dispatch incorporating a sequence of markets and real-time information. An efficient algorithm to evaluate the thresholds is developed based on analysis of the optimal storage operation. Simple approximations that rely on continuous-time approximations of the solution for the discrete time control problem are also studied. The benefits of storage with respect to prediction quality and storage capacity are examined, and the overall effect on dispatch is quantified. Numerical experiments illustrate the proposed procedures.

math.OC↗