Spaces:

Abhaykoul
/

HelpingAI2

Running on Zero

Abhaykoul commited on Aug 5

Commit

374c5de

•

1 Parent(s): b628d4a

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -43,7 +43,7 @@ def respond(
             flash_attn=True,
             n_gpu_layers=81,
             n_batch=1024,
-            n_ctx=4096,
         )
         llm_model = model

             flash_attn=True,
             n_gpu_layers=81,
             n_batch=1024,
+            n_ctx=8192,
         )
         llm_model = model