Spaces:

BridgeEight
/

internlm-20B-chat-w4-turbomind

Runtime error

BridgeEight commited on Jan 19

Commit

57b2f33

•

1 Parent(s): 448bdc5

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -4,7 +4,7 @@ import gradio as gr
 from lmdeploy.serve.gradio.app import *
 os.system('sh download.sh')
-InterFace.async_engine = AsyncEngine(model_path='turbomind-internlm-chat-20b-w4',
                                         instance_num=2,
                                         tp=1)

 from lmdeploy.serve.gradio.app import *
 os.system('sh download.sh')
+InterFace.async_engine = AsyncEngine(model_path='internlm2-chat-20b-4bits',
                                         instance_num=2,
                                         tp=1)