ZzWater commited on
Commit
cb37282
1 Parent(s): 6b04cf2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -56,6 +56,10 @@ cd viitor-voice
56
  conda create -n viitor_voice python=3.10
57
  conda activate viitor_voice
58
  pip install -r requirements.txt
 
 
 
 
59
  ```
60
 
61
  ---
 
56
  conda create -n viitor_voice python=3.10
57
  conda activate viitor_voice
58
  pip install -r requirements.txt
59
+
60
+ ### Due to the issue with vllm's tokenizer length calculation, the token limit cannot take effect.
61
+ python_package_path=`pip show pip | egrep Location | awk -F ' ' '{print $2}'`
62
+ cp viitor_voice/utils/patch.py $python_package_path/vllm/entrypoints/openai/logits_processors.py
63
  ```
64
 
65
  ---