SearcharxivSearch

arXiv subjects

Wesley J. Marrero

Publications and source records attributed to Wesley J. Marrero.

2 recordsLinked to original sources

Spread of Chronic Wasting Disease under Stochastic Environmental Conditions and its Control using Deep Reinforcement Learning

Chronic wasting disease (CWD) is a fatal prion disease affecting deer, elk, moose, reindeer, muntjac, and other cervids. Because free-ranging cervid populations face environmental variability and randomness, deterministic models may miss important dynamics like stochastic fade-out. We develop a stochastic Susceptible-Infectious-Environmental model using differential equations with reflection to ensure the susceptible class remains non-negative. We examine how environmental variability influences cervid populations as CWD pressure and control measures increase. For the deterministic model, we derive the basic reproduction number as the sum of direct and environmental contributions, showing the endemic phase arises at R0=1. For the stochastic system, we establish local well-posedness, positivity, and the disease-free law. The top Lyapunov exponent for invasion remains unaffected by reflection. We evaluate CWD mitigation using a deep reinforcement learning agent trained with Proximal Policy Optimization in a hybrid action space, comparing hunting, decontamination, and combined strategies. In the deterministic case, hunting alone can control the disease but reduces the population by about 58%, while decontamination requires sustained effort. The combined policy more than doubles the cervid population and nearly eliminates infection and contamination. In the stochastic case, the policy contains the disease in about 80% of runs, with 10% experiencing large outbreaks; effectiveness decreases as noise increases. Across all scenarios, the agent consistently emphasizes environmental decontamination, the key control method.

q-bio.PE

Boosted Distributional Reinforcement Learning: Analysis and Healthcare Applications

Researchers and practitioners are increasingly considering reinforcement learning to optimize decisions in complex domains like robotics and healthcare. To date, these efforts have largely utilized expectation-based learning. However, relying on expectation-focused objectives may be insufficient for making consistent decisions in highly uncertain situations involving multiple heterogeneous groups. While distributional reinforcement learning algorithms have been introduced to model the full distributions of outcomes, they can yield large discrepancies in realized benefits among comparable agents. This challenge is particularly acute in healthcare settings, where physicians (controllers) must manage multiple patients (subordinate agents) with uncertain disease progression and heterogeneous treatment responses. We propose a Boosted Distributional Reinforcement Learning (BDRL) algorithm that optimizes agent-specific outcome distributions while enforcing comparability among similar agents and analyze its convergence. To further stabilize learning, we incorporate a post-update projection step formulated as a constrained convex optimization problem, which efficiently aligns individual outcomes with a high-performing reference within a specified tolerance. We apply our algorithm to manage hypertension in a large subset of the US adult population by categorizing individuals into cardiovascular disease risk groups. Our approach modifies treatment plans for median and vulnerable patients by mimicking the behavior of high-performing references in each risk group. Furthermore, we find that BDRL improves the number and consistency of quality-adjusted life years compared with reinforcement learning baselines.

cs.LG