HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units
Paper
•
2106.07447
•
Published
•
2
HuBERT
A collection of checkpoints from the HuBERT release, a speech encoder that learns powerful representations from unlabelled audio data.
Note The HuBERT paper, accepted at IEEE/ACM Transactions on Audio, Speech and Language Processing Volume 29.
facebook/hubert-base-ls960
Feature Extraction • Updated • 103k • 49Note The "base" HuBERT model fine-tuned on 960 hours of LibriSpeech ASR data.
facebook/hubert-large-ll60k
Feature Extraction • Updated • 13.2k • 25Note The "large" HuBERT model pre-trained on LibriVox 60k hours.
facebook/hubert-large-ls960-ft
Automatic Speech Recognition • Updated • 445k • 61Note A fine-tuned version of hubert-large-ll60k, fine-tuned on 960 hours of LibriSpeech ASR data.
facebook/hubert-xlarge-ll60k
Feature Extraction • Updated • 311 • 5Note The "extra-large" HuBERT model pre-trained on LibriVox 60k hours.
facebook/hubert-xlarge-ls960-ft
Automatic Speech Recognition • Updated • 6.12k • 11Note A fine-tuned version of hubert-xlarge-ll60k, fine-tuned on 960 hours of LibriSpeech ASR data. This is the most performant HuBERT checkpoint in the release, achieving a WER of 1.8/2.9% on the LibriSpeech test clean/other subsets respectively.