Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
nilq
/
baby-tokenizer
like
1
nilq/babylm-100M
English
babylm
tokenizer
License:
mit
Model card
Files
Files and versions
Community
nilq
commited on
Jan 21
Commit
11d0588
•
1 Parent(s):
7fe1984
Update README.md
Browse files
Files changed (1)
hide
show
README.md
+1
-0
README.md
CHANGED
Viewed
@@ -5,6 +5,7 @@ language:
5
tags:
6
- babylm
7
- tokenizer
8
---
9
10
## Baby Tokenizer
5
tags:
6
- babylm
7
- tokenizer
8
+
library_name: transformers
9
---
10
11
## Baby Tokenizer