codex-like-tokenizer / tokenizer_config.json

Commit History

add codex like tokenizer files
09e32c3

SaulLu commited on