dahara1
/

ELYZA-japanese-Llama-2-7b-instruct-AWQ

Text Generation

text-generation-inference

Model card Files Files and versions Community

dahara1 commited on Sep 10, 2023

Commit

96a4ba8

•

1 Parent(s): a4cf0fa

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -29,12 +29,14 @@ This model has better ability to follow instructions than the [GPTQ version](htt
 [AWQ version Colab sample A100 only](https://github.com/webbigdata-jp/python_sample/blob/main/ELYZA_japanese_Llama_2_7b_instruct_AWQ_sample.ipynb)
-local PC
 install Library.
 ```
 pip install autoawq
 ```
 from awq import AutoAWQForCausalLM
 from transformers import AutoTokenizer

 [AWQ version Colab sample A100 only](https://github.com/webbigdata-jp/python_sample/blob/main/ELYZA_japanese_Llama_2_7b_instruct_AWQ_sample.ipynb)
+for local PC script.
 install Library.
 ```
 pip install autoawq
+```
+script example.
 ```
 from awq import AutoAWQForCausalLM
 from transformers import AutoTokenizer