We found that the despite it not being optimised, the 32-layer ResNet GP outperformed all other comparable architectures (Table REF ), including the NNGP in [1]}, which is state-of-the-art for non-convolutional networks, and convolutional GP [2]}, [3]}.
That said, our results have not reached state-of-the-art for methods that incorporate a parametric neural network, such as a standard ResNet [4]} and a Gaussian process with a deep neural network kernel [5]}.
<TABLE>