Updated model with better training and evaluation. Test and val data included as pickle files. Older Legacy files were removed to avoid confusion.
f4e3085
| model.safetensors filter=lfs diff=lfs merge=lfs -text | |
| .git/lfs/objects/48/8a/488aa4746aae10652265c4f48d8ddaaf8e302e6fbd4a5db9da494309eaa8eeac filter=lfs diff=lfs merge=lfs -text | |
| .git/lfs/objects/41/a5/41a56826146b5cb12d144aa0b713be15bf0a64b42901cd7dc202a9d0bce6af49 filter=lfs diff=lfs merge=lfs -text | |
| test_data.pickle filter=lfs diff=lfs merge=lfs -text | |
| val_data.pickle filter=lfs diff=lfs merge=lfs -text | |
| sentencepiece.bpe.model filter=lfs diff=lfs merge=lfs -text | |