\begin{table}[t]
    \centering
    \caption{\textbf{Optimizer hyperparameters.}}
    \label{tab:optim_hyper}
    \begin{tabular}{l l | l l }
    \toprule
    Learning rate & $10^{-4}$ & Weight decay & $10^{-4}$\\
    Scheduler & Inverse square root & Warmup steps & 10\% of total steps\\
    Batch size per GPU & 512 & Gradient norm clip & 1.0\\
    Data loss weight $\alpha$ & 5.0 & Symbol loss weight $\beta$ & 1.0\\    
    \bottomrule
    \end{tabular}
\end{table}
Learning rate 10´4
Scheduler Inverse square root
Batch size per GPU 512
Data loss weight α 5.0 Weight decay 10´4
Warmup steps 10% of total steps
Gradient norm clip 1.0
Symbol loss weight β 1.0