Text Generation
Transformers
PyTorch
Safetensors
English
stripedhyena
custom_code
Zymrael commited on
Commit
fd3ae29
1 Parent(s): 9dd09a5

chore: prompt format

Browse files
Files changed (1) hide show
  1. README.md +11 -0
README.md CHANGED
@@ -28,6 +28,17 @@ StripedHyena is a hybrid architecture composed of multi-head, grouped-query atte
28
  - Improvement to training and inference-optimal scaling laws, compared to optimized Transformer architectures such as Llama-2.
29
  - Trained on sequences of up to 32k, allowing it to process longer prompts.
30
 
 
 
 
 
 
 
 
 
 
 
 
31
  ### Disclaimer
32
 
33
  To use StripedHyena outside of the playground, you will need to install custom kernels. Please follow the instructions from the [standalone repository](https://github.com/togethercomputer/stripedhyena).
 
28
  - Improvement to training and inference-optimal scaling laws, compared to optimized Transformer architectures such as Llama-2.
29
  - Trained on sequences of up to 32k, allowing it to process longer prompts.
30
 
31
+ ### Prompt Format
32
+
33
+ StripedHyena-Nous 7B uses ChatML as the prompt format:
34
+
35
+ ```
36
+ <|im_start|>user
37
+ Hello!<|im_end|>
38
+ <|im_start|>assistant
39
+ Hi there!<|im_end|>
40
+ ```
41
+
42
  ### Disclaimer
43
 
44
  To use StripedHyena outside of the playground, you will need to install custom kernels. Please follow the instructions from the [standalone repository](https://github.com/togethercomputer/stripedhyena).