Zero-Shot Building Control
Heating and cooling systems in buildings account for 31% of global energy
use, much of which are regulated by Rule Based Controllers (RBCs) that neither
maximise energy efficiency nor minimise emissions by interacting optimally with
the grid. Control via Reinforcement Learning (RL) has been shown to
significantly improve building energy efficiency, but existing solutions
require pre-training in simulators that are prohibitively expensive to obtain
for every building in the world. In response, we show it is possible to perform
safe, zero-shot control of buildings by combining ideas from system
identification and model-based RL. We call this combination PEARL
(Probabilistic Emission-Abating Reinforcement Learning) and show it reduces
emissions without pre-training, needing only a three hour commissioning period.
In experiments across three varied building energy simulations, we show PEARL
outperforms an existing RBC once, and popular RL baselines in all cases,
reducing building emissions by as much as 31% whilst maintaining thermal
comfort.