Searcharxiv⌕ Search

arXiv subjects

Levi D. Reyes Premer

Publications and source records attributed to Levi D. Reyes Premer.

7 recordsLinked to original sources

Scalable Supervisory HVAC Control for Linear Objectives

Advanced control of heating, ventilation, and air-conditioning (HVAC) systems can substantially reduce energy costs and pollution. However, real-world adoption of popular algorithms among researchers, such as model predictive control and reinforcement learning, remains limited due in part to their high deployment and commissioning costs. Here, we develop two nearly commissioning-free supervisory controllers tailored to objectives that depend linearly on the controlled thermal load, such as energy costs and pollution. The controllers require, at most, two easily-estimable thermal parameters, forecasts of energy prices and occupant temperature preferences over a prediction horizon, and an indoor temperature measurement. In residential cooling simulations, both controllers perform essentially as well under traditional time-invariant electricity pricing as an omniscient optimal controller with exact model information and perfect forecasts, and attain up to 86.6% of the omniscient cost savings under increasingly prevalent time-varying pricing. These results suggest that simple, structure-exploiting controllers may capture most of the attainable value of advanced supervisory HVAC control with linear objectives, while avoiding the data, modeling, tuning, and computational burdens that hinder real-world deployment.

eess.SY↗

Indirect data-driven predictive control and the state-space predictor

We define trajectory predictive control (TPC) as a class of indirect data-driven predictive control (DDPC) methods that represent future outputs as linear in past inputs/outputs and future inputs. TPC unifies many DDPC variants with different predictor structures. We introduce a predictor with a state-space representation and show that with it, TPC inherits the mature theory of linear model predictive control. In numerical experiments, the state-space predictor outperforms existing predictors, especially for small training datasets.

eess.SY↗

Comparative Field Deployment of Reinforcement Learning and Model Predictive Control for Residential HVAC

Model Predictive Control (MPC) has demonstrated significant performance improvements over today's control methods for residential Heating, Ventilation, and Air Conditioning (HVAC), but deploying MPC often requires substantial engineering effort. Reinforcement Learning (RL) may offer comparable performance with easier deployment, but its practical application for residential HVAC remains largely undemonstrated, leaving open questions related to occupant comfort and data requirements. To investigate these issues, we deployed one MPC variant and one model-based RL variant for one month each in an occupied house in a cold climate. The controllers adjusted an air-to-air heat pump's thermostat temperature setpoint based on measurements of the indoor temperature and the electric power used for heating. Relative to constant-setpoint operation, MPC saved 18.1\% (95\% confidence interval: 4.4 to 30.9\%) of weather-normalized heat pump energy and RL saved 20.9\% (2.6 to 38.3\%). MPC maintained acceptable occupant comfort. RL kept the house cooler, particularly during an initial adaptation phase, leading to three reports of occupant discomfort. The two algorithms had similar data requirements. We estimate that for a fresh deployment in another house, RL would take about one-third less engineering effort than MPC. While RL reduces deployment effort, it faces difficulties related to safe controller initialization and to mismatches between the modeled and true state and action spaces.

eess.SY↗

Model predictive control lowers barriers to adoption of heat-pump water heaters: A field study

Electric heat-pump water heaters (HPWHs) could reduce the energy costs, emissions, and power grid impacts associated with water heating, the second-largest energy use in United States housing. However, most HPWHs today require 240 V circuits to power the backup resistance heating elements they use to maintain comfort during large water draws. Installing a 240 V circuit can increase the up-front cost of a HPWH by half or more. This paper develops and field-tests the first control system that enables a 120 V HPWH to efficiently maintain comfort without resistance heating elements. The novel model predictive control (MPC) system enables pre-heating in anticipation of large water draws, which it forecasts using an ensemble of machine learning predictors. By shifting electrical load over time, MPC also reduces energy costs on average by 23% and 28% under time-of-use pricing and hourly pricing, respectively, relative to a 240 V HPWH with standard controls. Compared to the increasingly common practice in 120 V HPWHs of storing water at a constant, high temperature (60 °C) to ensure comfort, MPC saves 37% energy on average. In addition to demonstrating MPC's benefits in a real, occupied house, this paper discusses implementation challenges and costs. A simple payback analysis suggests that a 120 V HPWH, operated by the MPC system developed here, would be economically attractive in most installation scenarios.

eess.SY↗

Lessons learned from field demonstrations of model predictive control and reinforcement learning for residential and commercial HVAC: A review

A large body of simulation research suggests that model predictive control (MPC) and reinforcement learning (RL) for heating, ventilation, and air-conditioning (HVAC) in residential and commercial buildings could reduce energy costs, pollutant emissions, and strain on power grids. Despite this potential, neither MPC nor RL has seen widespread industry adoption. Field demonstrations could accelerate MPC and RL adoption by providing real-world data that support the business case for deployment. Here we review 24 papers that document field demonstrations of MPC and RL in residential buildings and 80 in commercial buildings. After presenting demographic information -- such as experiment scopes, locations, and durations -- this paper analyzes experiment protocols and their influence on performance estimates. We find that 71% of the reviewed field demonstrations use experiment protocols that may lead to unreliable performance estimates. Over the remaining 29% that we view as reliable, the weighted-average cost savings, weighted by experiment duration, are 16% in residential buildings and 13% in commercial buildings. While these savings are potentially attractive, making the business case for MPC and RL also requires characterizing the costs of deployment, operation, and maintenance. Only 13 of the 104 reviewed papers report these costs or discuss related challenges. Based on these observations, we recommend directions for future field research, including: Improving experiment protocols; reporting deployment, operation, and maintenance costs; designing algorithms and instrumentation to reduce these costs; controlling HVAC equipment alongside other distributed energy resources; and pursuing emerging objectives such as peak shaving, arbitraging wholesale energy prices, and providing power grid reliability services.

eess.SY↗

Protecting residential electrical panels and service through model predictive control: A field study

Residential electrification - replacing fossil-fueled appliances and vehicles with electric machines - can significantly reduce greenhouse gas emissions and air pollution. However, installing electric appliances or vehicle charging in a residential building can sharply increase its current draws. In older housing, high current draws can jeopardize electrical infrastructure, such as circuit breaker panels or electrical service (the wires that connect a building to the distribution grid). Upgrading electrical infrastructure can entail long delays and high costs, so poses a significant barrier to electrification. This paper develops and field-tests a control system that avoids the need for electrical upgrades by keeping an electrified home's total current draw within the safe limits of its panel and service. In the proposed control architecture, a high-level controller plans device set-points over a rolling prediction horizon. A low-level controller monitors real-time conditions and ramps down devices if necessary. The control system was tested in an occupied, electrified single-family house with code-minimum insulation, an air-to-air heat pump and backup resistance heat, a resistance water heater, and a plug-in hybrid electric vehicle with Level I charging. The field tests spanned 31 winter days with outdoor temperatures as low as -20 C. The control system maintained the whole-home current within the safe limits of electrical panels and service rated at 100 A, a common rating for older houses in North America, by adjusting only the temperature set-points of the heat pump and water heater. Simulations suggest that the same 100 A limit could accommodate a second electric vehicle with Level II charging. The proposed control system could allow older homes to safely electrify without upgrading electrical panels or service, saving a typical household on the order of $2,000 to $10,000.

eess.SY↗

Humidity-Aware Model Predictive Control for Residential Air Conditioning: A Field Study

Model predictive control of residential air conditioning could reduce energy costs and greenhouse gas emissions while maintaining or improving occupants' thermal comfort. However, most approaches to predictive air conditioning control either do not model indoor humidity or treat it as constant. This simplification stems from challenges with modeling indoor humidity dynamics, particularly the high-order, nonlinear equations that govern heat and mass transfer between the air conditioner's evaporator coil and the indoor air. This paper develops a machine-learning approach to modeling indoor humidity dynamics that is suitable for real-world deployment at scale. This study then investigates the value of humidity modeling in four field tests of predictive control in an occupied house. The four field tests evaluate two different building models: One with constant humidity and one with time-varying humidity. Each modeling approach is tested in two different predictive controllers: One that focuses on reducing energy costs and one that focuses on constraining electric power below a utility-specified threshold. The two models lead to similar performance for reducing energy costs. Combining the results of this study and a prior heating study of the same house, the estimated year-round energy cost savings were $340-497 or 22-31% (95% confidence intervals); these savings were consistent across both humidity models. However, in the demand response tests, the simplifying assumption of constant humidity led to far more frequent and severe violations of the power constraint. These results suggest that accurate building models are important for nonlinear objectives, such as reducing or constraining peak demand, while for linear objectives such as reducing energy costs or emissions, model accuracy is less important.

eess.SY↗