Tanuki-8x8B-dpo-v1.0 / tokenizer.json

Commit History

トークナイザーに全角記号・数字のNKFC正規化を追加 (#2)
88992a1
verified

kanhatakeyama misdelivery commited on

Duplicate from team-hatakeyama-phase2/Tanuki-8x8B-dpo-v1.0
46a4471
verified

kanhatakeyama kazutaka commited on