NeuML
/

Llama-3.1_OpenScholar-8B-AWQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

davidmezzetti commited on 15 days ago

Commit

ef5845c

•

1 Parent(s): cfda801

Update README

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -14,8 +14,9 @@ tags:
 This is [Llama-3.1_OpenScholar-8B](https://huggingface.co/OpenScholar/Llama-3.1_OpenScholar-8B) with AWQ Quantization applied using the following code.
 ```python
-# Based on example: https://github.com/casper-hansen/AutoAWQ/blob/main/examples/quantize.py
 import torch
 from awq import AutoAWQForCausalLM

 This is [Llama-3.1_OpenScholar-8B](https://huggingface.co/OpenScholar/Llama-3.1_OpenScholar-8B) with AWQ Quantization applied using the following code.
+_Based on this [example code](https://github.com/casper-hansen/AutoAWQ/blob/main/examples/quantize.py)_
 ```python
 import torch
 from awq import AutoAWQForCausalLM