arXiv subjects

Yuta Yaegashi

Publications and source records attributed to Yuta Yaegashi.

3 recordsLinked to original sources

arXiv2021

Analytical and numerical solutions to ergodic control problems arising in environmental management

Environmental management optimizing a long-run objective is an ergodic control problem whose resolution can be achieved by solving an associated non-local Hamilton-Jacobi-Bellman (HJB) equation having an effective Hamiltonian. Focusing on sediment storage management as a modern engineering problem, we formulate, analyze, and compute a new ergodic control problem under discrete observations: a simple but non-trivial mathematical problem. We give optimality and comparison results of the corresponding HJB equation having unique non-smoothness and discontinuity. To numerically compute HJB equations, we propose a new fast-sweep method resorting to neither pseudo-time integration nor vanishing discount. The optimal policy and the effective Hamiltonian are then computed simultaneously. Convergence rate of numerical solutions is computationally analyzed. An advanced robust control counterpart where the dynamics involve uncertainties is also numerically considered.

math.OC↗

arXiv2021

Stochastic impulse control of non-smooth dynamics with partial observation and execution delay: application to an environmental restoration problem

Non-smooth dynamics driven by stochastic disturbance arise in a wide variety of engineering problems. Impulsive interventions are often employed to control stochastic systems; however, the modeling and analysis subject to execution delay have been less explored. In addition, continuously receiving information of the dynamics is not always possible. In this paper, with an application to an environmental restoration problem, a continuous-time stochastic impulse control problem subject to execution delay under discrete and random observations is newly formulated and analyzed. The dynamics have a non-smooth coefficient modulated by a Markov chain, and eventually attain an undesirable state like a depletion due to the non-smoothness. The goal of the control problem is to find the most cost-efficient policy that can prevent the dynamics from attaining the undesirable state. We demonstrate that finding the optimal policy reduces to solving a non-standard system of degenerate elliptic equations, the optimality equation, which is rigorously and analytically verified in a simplified case. The associated Fokker-Planck equation for the controlled dynamics is derived and solved explicitly as well. The model is finally applied to numerical computation of a recent river environmental restoration problem. The optimality and Fokker-Planck equations are successfully computed, and the optimal policy and the probability density functions are numerically obtained. The impacts of execution delay are discussed to deeper analyze the model.

math.OC↗

arXiv2020

A random observation-based management model of population dynamics and its ecological application

A new stochastic control problem of population dynamics under partial observation is formulated and analyzed both mathematically and numerically, with an emphasis on environmental and ecological problems. The decision-maker can only randomly and time-discretely observe and impulsively intervene the population dynamics governed by a regime-switching stochastic differential equation. The hybrid nature of the problem leads to an optimality equation containing an integro-differential equation and a static optimization problem. It is therefore different from the conventional Hamilton-Jacobi-Bellman equations. Existence and solvability issues of this optimality equation are analyzed in a viscosity sense. Its exact solution to a reduced but still nontrivial model is derived as well. The model is finally applied to a realistic environmental management problem in a river using a finite difference scheme.

math.OC↗