Another area to explore involves the particulars of the DNC's external memory. It could be useful and interesting to analyzing the memory contents through the timesteps of simulations, to get a grasp on its inner workings as it moves through different parts (tasks) of an environment. It is also not certain what an adequate memory size is. Whereas we use the memory length, width and read heads settings used by [1]} universally, either smaller or larger memory sizes may be more optimal depending on the type of environment and tasks. This memory could also be exposed to the RL agent to provide it with potentially useful information the DNC is tracking while producing predictions.
