zfzhang-thu commited on
Commit
a705c6b
1 Parent(s): 26344cf

add sentencepiece package for LlamaTokenizer

Browse files
Files changed (1) hide show
  1. requirements.txt +1 -0
requirements.txt CHANGED
@@ -6,3 +6,4 @@ peft==0.12.0
6
  timm==1.0.8
7
  torch==2.3.1
8
  transformers==4.40.2
 
 
6
  timm==1.0.8
7
  torch==2.3.1
8
  transformers==4.40.2
9
+ sentencepiece==0.2.0