codegen-scala / tokenizer.json
blastwind's picture
50k vocab size instead of 200k to match gpt-2
2a1f4da
raw
history contribute delete
2.23 MB
File too large to display, you can check the raw version instead.