In this section, we describe various stack-augmented RNNs. Our models are motivated by neural systems designed to emulate state machines with pushdown dynamics [1]}, [2]}, [3]}, [4]}, [5]}, [6]}, [7]}. Unlike these previous models, ours are much simpler and can be trained and tested on real world tasks.
