Different forms of networks ensembles have been shown to achieve state-of-the-art results [1]}, [2]}, [3]}, [4]}, [5]}. These ensembling techniques range from deep ensembles [2]}, which ensemble over the uniform distribution over random seeds, to ensembling over larger hypothesis spaces, architectures, and hyperparameters [7]}, [8]}, [9]}, [10]}, [11]}.
