Intriguingly, hierarchical deep RL systems have in some cases been configured to operate at different time-scales at different levels, with slower updates at higher levels, an organizational principle that resonates with some neuroscientific evidence concerning hierarchically organized time-scales across cortex [1]}, [2]}.
