Having said this, it is also important to acknowledge that deep RL systems have not yet been proven to be capable of matching humans when it comes to flexible adaptation based on structured inference, leveraging a powerful store of background knowledge. Whether deep RL systems can close this gap is an open and exciting question. Some recent work suggests that deep RL systems can, under the right circumstances, capitalize on past learning to quickly adapt systematically to new situations that appear quite novel [1]}, but this does not invariably happen [2]}, and understanding the difference is of interest both to AI and neuroscience.
