README.md

Graphcore and Hugging Face are working together to make training of Transformer models on IPUs fast and easy. Learn more about how to take advantage of the power of Graphcore IPUs to train Transformers models at hf.co/hardware/graphcore.

Wav2Vec2 Base model IPU config

This model contains just the IPUConfig files for running the Wav2Vec2 base model (e.g. wav2vec2-base) on Graphcore IPUs.

This model contains no model weights, only an IPUConfig.

Model description

From wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations,

“Wave2vec2 is a framework for self-supervised learning of speech representations. It masks the speech input in the latent space and solves a contrastive task defined over a quantization of the latent representations which are jointly learned.”

Usage

from optimum.graphcore import IPUConfig
ipu_config = IPUConfig.from_pretrained("Graphcore/wav2vec2-base-ipu")