shuyuej
/

Llama-3.2-3B-Instruct-GPTQ

4-bit precision

Model card Files Files and versions Community

shuyuej commited on 4 days ago

Commit

dd5a311

•

1 Parent(s): cf7c666

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -9,7 +9,7 @@ Link: [https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct](https://huggingf
 ## Quantization Configurations
 ```
-"quantization_config": {
     "batch_size": 1,
     "bits": 4,
     "block_name_to_quantize": null,

 ## Quantization Configurations
 ```
+  "quantization_config": {
     "batch_size": 1,
     "bits": 4,
     "block_name_to_quantize": null,