vllm reply garbled
#29
by
SongXiaoMao
- opened
vllm can be started correctly, but the answers are all repeated !!!!!!!!!!!!!!!!!!!!!
Model behavior. It can easily into a thinking loop...
Any question you enter will be output!!!!!!