TheBloke
/

koala-13B-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

TheBloke commited on Apr 9, 2023

Commit

561dac2

•

1 Parent(s): 15b2a30

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -86,7 +86,7 @@ PYTHON_PATH="${PWD}:$PYTHONPATH" python \
 --streaming=True
 PYTHON_PATH="${PWD}:$PYTHONPATH" python \
--m EasyLM.models.llama.convert_easylm_to_hf --model_size=7b \
 --output_dir=/content/koala-13B-HF \
 --load_checkpoint='params::/content/koala_13b.diff.weights' \
 --tokenizer_path=/content/llama-13b/tokenizer.model

 --streaming=True
 PYTHON_PATH="${PWD}:$PYTHONPATH" python \
+-m EasyLM.models.llama.convert_easylm_to_hf --model_size=13b \
 --output_dir=/content/koala-13B-HF \
 --load_checkpoint='params::/content/koala_13b.diff.weights' \
 --tokenizer_path=/content/llama-13b/tokenizer.model