Upload VMware/open-llama-7b-open-instruct ctranslate fp16 weights

README.md

@@ -17,21 +17,11 @@ Speedup inference while reducing memory by 2x-4x using int8 inference in C++ on
 
 quantized version of [VMware/open-llama-7b-open-instruct](https://huggingface.co/VMware/open-llama-7b-open-instruct)
 ```bash
-pip install hf-hub-ctranslate2>=2.0.8 ctranslate2>=3.16.0
+pip install hf-hub-ctranslate2>=2.10.0 ctranslate2>=3.16.0
 ```
-Converted on 2023-06-15 using
-```
-ct2-transformers-converter --model VMware/open-llama-7b-open-instruct --output_dir ~/tmp-ct2fast-open-llama-7b-open-instruct --force --copy_files README.md tokenizer_config.json generation_config.json special_tokens_map.json .gitattributes --quantization int8_float16 --trust_remote_code
-```
-
-Checkpoint compatible to [ctranslate2>=3.16.0](https://github.com/OpenNMT/CTranslate2)
-and [hf-hub-ctranslate2>=2.0.8](https://github.com/michaelfeil/hf-hub-ctranslate2)
-- `compute_type=int8_float16` for `device="cuda"`
-- `compute_type=int8`  for `device="cpu"`
 
 ```python
-from transformers import AutoTokenizer
-
+# from transformers import AutoTokenizer
 model_name = "michaelfeil/ct2fast-open-llama-7b-open-instruct"
 
 from hf_hub_ctranslate2 import GeneratorCT2fromHfHub
@@ -50,6 +40,16 @@ outputs = model.generate(
 print(outputs)
 ```
 
+Checkpoint compatible to [ctranslate2>=3.16.0](https://github.com/OpenNMT/CTranslate2)
+and [hf-hub-ctranslate2>=2.10.0](https://github.com/michaelfeil/hf-hub-ctranslate2)
+- `compute_type=int8_float16` for `device="cuda"`
+- `compute_type=int8`  for `device="cpu"`
+
+Converted on 2023-06-16 using
+```
+ct2-transformers-converter --model VMware/open-llama-7b-open-instruct --output_dir ~/tmp-ct2fast-open-llama-7b-open-instruct --force --copy_files README.md tokenizer_config.json generation_config.json special_tokens_map.json .gitattributes --quantization int8_float16 --trust_remote_code
+```
+
 # Licence and other remarks:
 This is just a quantized version. Licence conditions are intended to be idential to original huggingface repo.