Nathan Brown

This collection hosts the models and datasets released as part of BOTS-LM, the Bilingual Open Tswana Suite of Language Models.

Various efficient attention encoder-style architectures distilled into student models with half the hidden layers, plus a long-context NER dataset