Text Generation
Transformers
PyTorch
Safetensors
English
hf_olmo
custom_code
OLMo-7B-Twin-2T / tokenization_olmo_fast.py
akshitab's picture
initial files
a8d97bf
raw
history blame
61 Bytes
from hf_olmo.tokenization_olmo_fast import OLMoTokenizerFast