OliP
/

Phi-3-mini-128k-instruct-awq

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

OliP commited on Jul 9

Commit

b256a7c

•

1 Parent(s): e6ca7e2

Upload folder using huggingface_hub

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -134,7 +134,7 @@
       2.8999999999999977,
       3.049999999999997
     ],
-    "type": "su"
   },
   "rope_theta": 10000.0,
   "sliding_window": 262144,

       2.8999999999999977,
       3.049999999999997
     ],
+    "type": "longrope"
   },
   "rope_theta": 10000.0,
   "sliding_window": 262144,