Spaces:

5w4n
/

burmese-tokenizers

Runtime error

App Files Files Community

burmese-tokenizers / app.py

Commit History

Update chart

a57f878

5w4n commited on May 19

Add new sample button

f25131d

5w4n commited on May 19

Add cohere multilingual v3

bfa0a38

5w4n commited on May 19

Add cohere multilingual tokenizer

fc19172

5w4n commited on May 19

Add simbolo tokenizers

52f4fdb

5w4n commited on May 19

Update about the project

45abc63

5w4n commited on May 19

Add error handling for no tokenizer selected

9acdffa

5w4n commited on May 19

Add token distribution chart and token count variability

6841f1c

5w4n commited on May 19

Format the output

0158b9f

5w4n commited on May 19

Fix bug

3e67b95

5w4n commited on May 18

Make the code to use precalculated tokens from the dataset

34eb18c

5w4n commited on May 18

Move the token results from sidebar

116574f

5w4n commited on May 18

Update dataset

b1e9d2d

5w4n commited on May 18

Init

daa27ce

5w4n commited on May 18