Spaces:
Runtime error
Runtime error
ffreemt
commited on
Commit
•
bdaa897
1
Parent(s):
e0faa34
Update paused
Browse files
app.py
CHANGED
@@ -351,6 +351,8 @@ with gr.Blocks(
|
|
351 |
gr.Markdown(
|
352 |
"""<h4><center>mpt-30b-chat-ggml (q4_1)</center></h4>
|
353 |
|
|
|
|
|
354 |
This demo is of [TheBloke/mpt-30B-chat-GGML](https://huggingface.co/TheBloke/mpt-30B-chat-GGML).
|
355 |
|
356 |
Try to refresh the browser and try again when occasionally errors occur.
|
@@ -359,8 +361,8 @@ with gr.Blocks(
|
|
359 |
""",
|
360 |
elem_classes="xsmall",
|
361 |
)
|
362 |
-
|
363 |
-
chatbot = gr.Chatbot(scroll_to_output=True).style(height=700) # 500
|
364 |
buff = gr.Textbox(show_label=False)
|
365 |
with gr.Row():
|
366 |
with gr.Column(scale=1):
|
@@ -440,6 +442,7 @@ with gr.Blocks(
|
|
440 |
)
|
441 |
|
442 |
_ = """
|
|
|
443 |
submit_event = msg.submit(
|
444 |
fn=conversation.user_turn,
|
445 |
inputs=[msg, chatbot],
|
@@ -529,4 +532,5 @@ with gr.Blocks(
|
|
529 |
|
530 |
# concurrency_count=5, max_size=20
|
531 |
# max_size=36, concurrency_count=14
|
|
|
532 |
block.queue(concurrency_count=5, max_size=20).launch(debug=True)
|
|
|
351 |
gr.Markdown(
|
352 |
"""<h4><center>mpt-30b-chat-ggml (q4_1)</center></h4>
|
353 |
|
354 |
+
To run, a minimum of CPU UNGRADE hf instance is required. It takes around 60 seconds for initial response to appear. It can take a few minutes to complete a reply of decent length.
|
355 |
+
|
356 |
This demo is of [TheBloke/mpt-30B-chat-GGML](https://huggingface.co/TheBloke/mpt-30B-chat-GGML).
|
357 |
|
358 |
Try to refresh the browser and try again when occasionally errors occur.
|
|
|
361 |
""",
|
362 |
elem_classes="xsmall",
|
363 |
)
|
364 |
+
|
365 |
+
chatbot = gr.Chatbot(value=[], scroll_to_output=True).style(height=700) # 500
|
366 |
buff = gr.Textbox(show_label=False)
|
367 |
with gr.Row():
|
368 |
with gr.Column(scale=1):
|
|
|
442 |
)
|
443 |
|
444 |
_ = """
|
445 |
+
conversation = Chat()
|
446 |
submit_event = msg.submit(
|
447 |
fn=conversation.user_turn,
|
448 |
inputs=[msg, chatbot],
|
|
|
532 |
|
533 |
# concurrency_count=5, max_size=20
|
534 |
# max_size=36, concurrency_count=14
|
535 |
+
|
536 |
block.queue(concurrency_count=5, max_size=20).launch(debug=True)
|