fig:encoding-perf-layersA shows the average voxel prediction performance across the whole cortex for each encoding model. Across layers, this analysis reveals a consistent trend — upper-middle layers of every model have the best encoding performance, with lower performance for the shallowest and deepest layers.
This trend is most evident in wav2vec 2.0, HuBERT, and Deep Speech 2, and is consistent with previous literature in higher-level language encoding models that also found best performance in the upper-middle layers [1]}, [2]}, [3]}, [4]}.
