Multilingual Support

#5
by Mistsink - opened

Thank you very much for your work. This small model is really great for me. Although the model tag only says English, I also tried Korean and Japanese in the web demo, and the model can output text in the corresponding languages. Can you tell me specifically which languages are supported?

Hugging Face TB Research org

We mainly train on data from FineWeb, which is English-only. Other languages might be present due to language detection errors. We'll support additional languages once a multilingual version of FineWeb is available :)

Sign up or log in to comment