Spaces:

xu-song
/

tokenizer-arena

Running

App Files Files Community

tokenizer-arena / requirements.txt

Commit History

remove vocabs; update compression_app; add character_app;

2bd606a

xu-song commited on May 21

add compress rate

814ee6b

xu-song commited on Apr 22

requi

6b70021

xu-song commited on Mar 13

requi

510279b

xu-song commited on Mar 13

requi

7b522e7

xu-song commited on Mar 13

add olmo tokenizer

bbefe94

xu-song commited on Feb 28

add more tokenizer

5425d5d

xu-song commited on Feb 22

add more tokenizer

c75633b

xu-song commited on Jan 31

update

7aaa101

xu-song commited on Dec 1, 2023

add more tokenizers

f4973d4

xu-song commited on Dec 1, 2023

update

a173fe5

xu-song commited on Sep 3, 2023

update

1ee0570

xu-song commited on Sep 1, 2023

update

751936e

xu-song commited on Aug 30, 2023