Qwen
/

Qwen2.5-3B-Instruct-GPTQ-Int4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

feihu.hf commited on Sep 18

Commit

ce7fc2d

•

1 Parent(s): 4820e93

update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -48,4 +48,4 @@
   "use_cache": true,
   "use_sliding_window": false,
   "vocab_size": 151936
-}

   "use_cache": true,
   "use_sliding_window": false,
   "vocab_size": 151936
+}