A Hybrid Control Strategy Combining Reinforcement Learning and MPC-LSTM for Energy Management in Building

Abstract

Aware of the nefarious effects of excessive exploitation of natural resources and the greenhouse gases emissions linked to building sector, the concept of smart buildings emerged, referring to a building that uses clean energy efficiently. This requires intelligent control systems to manage the use of residential energy consuming devices, namely the HVAC (Heating, Ventilation, Air-conditioning) system. This system consumes up to 50% of the total energy used by a building. In this paper, we introduce a RL (Reinforcement Learning) and MPC-LSTM (Model Predictive Control-Long-Short Term Memory) hybrid control system that combines DNNs (Deep Neural Networks), through RL, with LSTM’s long-short memory technique and MPC’s control characteristics. The goal of our model is to maintain thermal comfort of residents while optimizing energy consumption. Consequently, to train and test our model, we generate our own dataset using a building model of a corporate building in Casablanca, Morocco, combined with weather data of the same city. Simulations confirm the robustness of our model as it outperforms basic control methods in terms of thermal comfort and energy consumption especially during summer. Compared to conventional methods, our approach resulted in a 45.4% and 70.9% reduction in energy consumption, in winter and summer, respectively. Our approach also resulted in 26 less comfort violations during winter. On the other hand, during summer, our approach found a compromise between energy consumption and comfort with no more than 2.5 °C above ideal temperature limit.