arXiv subjects

Sirish L. Shah

Publications and source records attributed to Sirish L. Shah.

7 recordsLinked to original sources

arXiv2026

Model-Free Reinforcement Learning Control for Resilient Cyber-Physical Systems

This paper compares the performance of model-free controllers on a nonlinear system under cyberattacks, including false data injection and denial-of-service attacks. Four RL reward types are analyzed for accuracy, cost, and resilience. Results show that the Lyapunov reward offers the best resilience with low tracking error. Exponential mode also provides good trade-offs with acceptable resilience under moderate training conditions. Progressive and linear rewards converge faster but are less robust. RL-MPCs show strong steady-state resilience but require longer training times; RL-PID controllers are faster with significantly less training time. Proximal Policy Optimization outperforms Deep Deterministic Policy Gradient with a significant reduction in KPI variance. This study serves to highlight how well-designed RL rewards can improve performance and resilience against cyber threats.

eess.SY↗

arXiv2025

Sensitivity-Informed Parameter Selection for Improved Soil Moisture Estimation from Remote Sensing Data

Improving the accuracy of soil moisture estimation is required for advancing irrigation scheduling and water conservation efforts. Central to this task are soil hydraulic parameters, which govern moisture dynamics but are rarely known precisely and must therefore be inferred from observational data. In large-scale agricultural fields, estimating the complete set of these parameters is often impractical due to the sparse and noisy nature of available measurements. To address this challenge, this work develops a framework that uses sensitivity analysis and orthogonal projection to identify parameters that are both reliably estimable from available data. These parameters, together with the spatial distribution of soil moisture, are jointly estimated by assimilating observational data into a cylindrical-coordinate version of the Richards equation using an extended Kalman filter. The soil moisture measurements are obtained from microwave remote sensors mounted on center pivot irrigation systems - an emerging and practical technology for capturing field-scale variability. Numerical simulations and field experiments conducted on a large-scale site in Lethbridge, Alberta, Canada, demonstrate that the proposed method improves soil moisture estimation accuracy by 24-43% and enhances predictive model performance by 50%. Furthermore, the estimated parameters - particularly saturated hydraulic conductivity - exhibit good agreement with experimental measurements.

eess.SY↗

arXiv2024

ReLU Surrogates in Mixed-Integer MPC for Irrigation Scheduling

Efficient water management in agriculture is important for mitigating the growing freshwater scarcity crisis. Mixed-integer Model Predictive Control (MPC) has emerged as an effective approach for addressing the complex scheduling problems in agricultural irrigation. However, the computational complexity of mixed-integer MPC still poses a significant challenge, particularly in large-scale applications. This study proposes an approach to enhance the computational efficiency of mixed-integer MPC-based irrigation schedulers by employing ReLU surrogate models to describe the soil moisture dynamics of the agricultural field. By leveraging the mixed-integer linear representation of the ReLU operator, the proposed approach transforms the mixed-integer MPC-based scheduler with a quadratic cost function into a mixed-integer quadratic program, which is the simplest class of mixed-integer nonlinear programming problems that can be efficiently solved using global optimization solvers. The effectiveness of this approach is demonstrated through comparative studies conducted on a large-scale agricultural field across two growing seasons, involving other machine learning surrogate models, specifically Long Short-Term Memory (LSTM) networks, and the widely used triggered irrigation scheduling method. The ReLU-based approach significantly reduces solution times -- by up to 99.5\% -- while achieving comparable performance to the LSTM approach in terms of water savings and Irrigation Water Use Efficiency (IWUE). Moreover, the ReLU-based approach maintains enhanced performance in terms of total prescribed irrigation and IWUE compared to the widely-used triggered irrigation scheduling method.

eess.SY↗

arXiv2024

A semi-centralized multi-agent RL framework for efficient irrigation scheduling

This paper proposes a Semi-Centralized Multi-Agent Reinforcement Learning (SCMARL) approach for irrigation scheduling in spatially variable agricultural fields, where management zones address spatial variability. The SCMARL framework is hierarchical in nature, with a centralized coordinator agent at the top level and decentralized local agents at the second level. The coordinator agent makes daily binary irrigation decisions based on field-wide conditions, which are communicated to the local agents. Local agents determine appropriate irrigation amounts for specific management zones using local conditions. The framework employs state augmentation approach to handle non-stationarity in the local agents' environments. An extensive evaluation on a large-scale field in Lethbridge, Canada, compares the SCMARL approach with a learning-based multi-agent model predictive control scheduling approach, highlighting its enhanced performance, resulting in water conservation and improved Irrigation Water Use Efficiency (IWUE). Notably, the proposed approach achieved a 4.0% savings in irrigation water while enhancing the IWUE by 6.3%.

eess.SY↗

arXiv2023

Integrating machine learning paradigms and mixed-integer model predictive control for irrigation scheduling

The agricultural sector currently faces significant challenges in water resource conservation and crop yield optimization, primarily due to concerns over freshwater scarcity. Traditional irrigation scheduling methods often prove inadequate in meeting the needs of large-scale irrigation systems. To address this issue, this paper proposes a predictive irrigation scheduler that leverages the three paradigms of machine learning to optimize irrigation schedules. The proposed scheduler employs the k-means clustering approach to divide the field into distinct irrigation management zones based on soil hydraulic parameters and topology information. Furthermore, a long short-term memory network is employed to develop dynamic models for each management zone, enabling accurate predictions of soil moisture dynamics. Formulated as a mixed-integer model predictive control problem, the scheduler aims to maximize water uptake while minimizing overall water consumption and irrigation costs. To tackle the mixed-integer optimization challenge, the proximal policy optimization algorithm is utilized to train a reinforcement learning agent responsible for making daily irrigation decisions. To evaluate the performance of the proposed scheduler, a 26.4-hectare field in Lethbridge, Canada, was chosen as a case study for the 2015 and 2022 growing seasons. The results demonstrate the superiority of the proposed scheduler compared to a traditional irrigation scheduling method in terms of water use efficiency and crop yield improvement for both growing seasons. Notably, the proposed scheduler achieved water savings ranging from 6.4% to 22.8%, along with yield increases ranging from 2.3% to 4.3%.

eess.SY↗

arXiv2021

LSTM-based model predictive control with discrete inputs for irrigation scheduling

The development of well-devised irrigation scheduling methods is desirable from the perspectives of plant quality and water conservation. In this article, a model predictive control (MPC) with discrete actuators is developed for irrigation scheduling, where a long short-term memory (LSTM) model of the soil-water-atmosphere system is used to evaluate the objective of ensuring optimal water uptake in crops while minimizing total water consumption and irrigation costs. A heuristic method involving a sigmoid function is used in this framework to enhance the computational efficiency of the scheduler. The scheduling scheme is applied to homogeneous and spatially variable fields and the results indicate that the LSTM-based MPC with discrete actuators is able to prescribe optimal or near-optimal irrigation schedules that are typical of irrigation practice.

eess.SY↗

arXiv2020

Soil moisture map construction using microwave remote sensors and sequential data assimilation

Microwave remote sensors mounted on center pivot irrigation systems provide a feasible approach to obtain soil moisture information, in the form of water content maps, for the implementation of closed-loop irrigation. Major challenges such as significant time delays in the soil moisture measurements, the inability of the sensors to provide soil moisture information in instances where the center pivot is stationary, and the inability of the sensors to provide soil moisture information in the root zone reduce the usability of the water content maps in the effective implementation of closed-loop irrigation. In this paper, we seek to address the aforementioned challenges and consequently describe a water content map construction procedure that is suitable for the implementation of closed-loop irrigation. Firstly, we propose the cylindrical coordinates version of the Richards equation (field model) which naturally models fields equipped with a center pivot irrigation system. Secondly, measurements obtained from the microwave sensors are assimilated into the field model using the extended Kalman filter to form an information fusion system, which will provide frequent soil moisture estimates and predictions in the form of moisture content maps. The utility of the proposed information fusion system is first investigated with simulated microwave sensor measurements. The information fusion system is then applied to a real large-scale agriculture field where we demonstrate the its ability to address the challenges. Three performance evaluation criteria are used to validate the soil moisture estimates and predictions provided by the proposed information fusion system.

eess.SP↗