fakezeta
/

gemma-2-9b-it-SimPO-ov-int4

alignment-handbook

Generated from Trainer

Model card Files Files and versions Community

fakezeta commited on Sep 16

Commit

ead812e

•

1 Parent(s): b4b37bf

Update README.md

Files changed (1) hide show

README.md +5 -2

README.md CHANGED Viewed

@@ -14,7 +14,7 @@ license: mit
 # OpenVINO IR model with int4 quantization
 Model definition for LocalAI:
-```
 name: gemma-2-9b-it-SimPO
 backend: transformers
 parameters:
@@ -23,10 +23,13 @@ context_size: 8192
 type: OVModelForCausalLM
 template:
   use_tokenizer_template: true
 ```
 To run the model directly with LocalAI:
-```
 local-ai run huggingface://fakezeta/gemma-2-9b-it-SimPO-ov-int4/model.yaml
 ```

 # OpenVINO IR model with int4 quantization
 Model definition for LocalAI:
+```yaml
 name: gemma-2-9b-it-SimPO
 backend: transformers
 parameters:
 type: OVModelForCausalLM
 template:
   use_tokenizer_template: true
+stopwords:
+- "<eos>"
+- "<end_of_turn>"
 ```
 To run the model directly with LocalAI:
+```shell
 local-ai run huggingface://fakezeta/gemma-2-9b-it-SimPO-ov-int4/model.yaml
 ```