Modelling building HVAC control strategies using a deep reinforcement learning approach

Abstract

Heating, ventilation, and air-conditioning (HVAC) systems are responsible for a considerable proportion of total building energy consumption but are also vital for improved indoor temperature comfort, indoor air quality and well-being of building occupants. Thus, developing control strategies for HVAC systems is critical for the total life cycle of any building projects. Particularly, HVAC and building operations are not stationary but are filled with fuelled by environmental dynamisms and unexpected disruptions such as users' activities, weather conditions, occupancy rate, and operation of machinery and systems. This research aims to develop and propose a strategic control learning framework for HVAC systems using the deep reinforcement learning (DRL) approach. The results show that the proposed Phasic Policy Gradient (PPG) based method is more adaptive to changes in real building's environments. Notably, PPG performs better and more reliable than the conventional method for HVAC control optimization with about 2-14% in energy consumption reduction and indoor temperature comfort enhancement, along with a 66% faster convergence rate. Overall, our findings demonstrate that our proposed DRL approach is less resource intensive and much easier than the conventional approach in deriving solutions for HVAC control optimization driven by energy efficiency and indoor temperature comfort.