Our Model: For our RN and GNN based models, we use the Adam optimizer [1]} and set an initial learning rate of \(3e-4\) . For accelerated learning, we also test with a larger learning rate of \(1e-3\) .
Since the precondition model is trained on less data we use a smaller batch of size 8 only. We also decay the learning rate with 0.995 after every epoch.
