Qwen
/

Qwen2.5-3B-Instruct-GPTQ-Int8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

feihu.hf commited on Sep 18

Commit

e0f0651

•

1 Parent(s): 4882fb9

update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -48,4 +48,4 @@
   "use_cache": true,
   "use_sliding_window": false,
   "vocab_size": 151936
-}

   "use_cache": true,
   "use_sliding_window": false,
   "vocab_size": 151936
+}