In Table REF , we compare our model's performance to the baselines described by [1]} and to our own reimplemented tree-to-tree and tree-to-sequence models with the architecture and hyperparameters described by Chen et. al. For the hyperparameters of the grammar model we simply used the tree-to-tree model's hyperparameters and did not try to optimize them. Each model was trained 5 times over half a million examples. We also ran one of each of our three models to convergence (30 epochs). Program accuracy was measured on the test set by counting the percentage of perfectly correct translated programs.
<FIGURE><TABLE><TABLE>