To address this problem, [1]} dong2016language proposed an approach that generates code along the abstract syntax tree (AST) of a program, but their generation is still in the token level. More recent work generates programs by predicting the grammar rule or rewriting rule to apply at each step [2]}, [3]}, [4]}; thus, the generated programs are guaranteed to be syntactically correct. When neural network is used in those approaches, an RNN is used to capture the autoregressivenessBy “autoregressive,” we mean that, during decoding, a step of prediction is dependent on previous decoded steps. of predictions within the decoder.
<TABLE>