Qwen
/

Qwen2.5-0.5B-Instruct-GPTQ-Int8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

feihu.hf commited on Sep 18

Commit

2a6af4f

•

1 Parent(s): 86aaec2

update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -48,4 +48,4 @@
   "use_cache": true,
   "use_sliding_window": false,
   "vocab_size": 151936
-}

   "use_cache": true,
   "use_sliding_window": false,
   "vocab_size": 151936
+}