phonemetransformers
/

GPT2-85M-BPE-PHON

Model card Files Files and versions Community

No model card

New: Create and edit this model card directly on the website!

Contribute a Model Card

Downloads last month: 3

Safetensors

Model size

97.5M params

Tensor type

F32

·

Inference API

Unable to determine this model's library. Check the docs .

Collection including phonemetransformers/GPT2-85M-BPE-PHON

From Babble to Words

The models, tokenizers and datasets used for our submission for BabyLM 2024, investigating the viability of training LLMs on phoneme streams. • 17 items • Updated 14 days ago