Upload 10 files

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,126 @@
+---
+inference: false
+library_name: transformers
+language:
+- en
+- fr
+- de
+- es
+- it
+- pt
+- ja
+- ko
+- zh
+- ar
+- el
+- fa
+- pl
+- id
+- cs
+- he
+- hi
+- nl
+- ro
+- ru
+- tr
+- uk
+- vi
+license: cc-by-nc-4.0
+extra_gated_prompt: "By submitting this form, you agree to the [License Agreement](https://cohere.com/c4ai-cc-by-nc-license)  and acknowledge that the information you provide will be collected, used, and shared in accordance with Cohere’s [Privacy Policy]( https://cohere.com/privacy). You’ll receive email updates about C4AI and Cohere research, events, products and services. You can unsubscribe at any time." 
+extra_gated_fields:
+ Name: text
+ Affiliation: text
+ Country: country
+ I agree to use this model for non-commercial use ONLY: checkbox
+---
+
+# Model Card for Aya-Expanse-32B
+
+<img src="aya-expanse-32B.png" width="650" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
+
+Aya Expanse is an open-weight research release of a model with highly advanced multilingual capabilities. It focuses on pairing a highly performant pre-trained [Command family](https://huggingface.co/CohereForAI/c4ai-command-r-plus) of models with the result of a year’s dedicated research from [Cohere For AI](https://cohere.for.ai/), including [data arbitrage](https://arxiv.org/pdf/2408.14960), [multilingual preference training](https://arxiv.org/abs/2407.02552), [safety tuning](https://arxiv.org/abs/2406.18682), and [model merging](https://arxiv.org/abs/2410.10801). The result is a powerful multilingual large language model serving 23 languages.
+
+We cover 23 languages: Arabic, Chinese (simplified & traditional), Czech, Dutch, English, French, German, Greek, Hebrew, Hebrew, Hindi, Indonesian, Italian, Japanese, Korean, Persian, Polish, Portuguese, Romanian, Russian, Spanish, Turkish, Ukrainian, and Vietnamese
+
+This model card corresponds to the 32-billion version of the Aya Expanse model. We also released an 8-billion version which you can find [here](https://huggingface.co/CohereForAI/aya-expanse-8B).
+
+- Developed by: [Cohere For AI](https://cohere.for.ai/) 
+- Point of Contact: Cohere For AI: [cohere.for.ai](https://cohere.for.ai/)
+- License: [CC-BY-NC](https://cohere.com/c4ai-cc-by-nc-license), requires also adhering to [C4AI's Acceptable Use Policy](https://docs.cohere.com/docs/c4ai-acceptable-use-policy)
+- Model: Aya Expanse 32B
+- Model Size: 32 billion parameters
+
+**Try Aya Expanse**
+
+Before downloading the weights, you can try out Aya Expanse (32B) in our hosted [Hugging Face Space](https://huggingface.co/spaces/CohereForAI/aya_expanse).
+
+
+### Usage
+
+Please install transformers from the source repository.
+
+```python
+# pip install 'git+https://github.com/huggingface/transformers.git'
+from transformers import AutoTokenizer, AutoModelForCausalLM
+
+model_id = "CohereForAI/aya-expanse-32b"
+tokenizer = AutoTokenizer.from_pretrained(model_id)
+model = AutoModelForCausalLM.from_pretrained(model_id)
+
+# Format message with the chat template
+messages = [{"role": "user", "content": "Anneme onu ne kadar sevdiğimi anlatan bir mektup yaz"}]
+input_ids = tokenizer.apply_chat_template(messages, tokenize=True, add_generation_prompt=True, return_tensors="pt")
+## <BOS_TOKEN><|START_OF_TURN_TOKEN|><|USER_TOKEN|>Anneme onu ne kadar sevdiğimi anlatan bir mektup yaz<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>
+
+gen_tokens = model.generate(
+    input_ids, 
+    max_new_tokens=100, 
+    do_sample=True, 
+    temperature=0.3,
+    )
+
+gen_text = tokenizer.decode(gen_tokens[0])
+print(gen_text)
+```
+
+### Example Notebooks
+
+**Fine-Tuning**:
+- [This notebook](https://colab.research.google.com/drive/1ryPYXzqb7oIn2fchMLdCNSIH5KfyEtv4) showcases a detailed use of fine-tuning Aya Expanse on more languages.
+
+**Example Use cases**:
+
+The following notebooks contributed by *Cohere For AI Community* members show how Aya Expanse can be used for different use cases:
+
+- [Mulitlingual Writing Assistant](https://colab.research.google.com/drive/1SRLWQ0HdYN_NbRMVVUHTDXb-LSMZWF60#scrollTo=qBK1H7WO9UHG)
+- [AyaMCooking](https://colab.research.google.com/drive/1-cnn4LXYoZ4ARBpnsjQM3sU7egOL_fLB?usp=sharing#scrollTo=ukHwdlrgXSdI)
+- [Multilingual Question-Answering System](https://colab.research.google.com/drive/1bbB8hzyzCJbfMVjsZPeh4yNEALJFGNQy?usp=sharing)
+
+
+## Model Details
+
+**Input**: Models input text only.
+
+**Output**: Models generate text only.
+
+**Model Architecture**: Aya Expanse 32B is an auto-regressive language model that uses an optimized transformer architecture. Post-training includes supervised finetuning, preference training, and model merging.
+
+**Languages covered**: The model is particularly optimized for multilinguality and supports the following languages: Arabic, Chinese (simplified & traditional), Czech, Dutch, English, French, German, Greek, Hebrew, Hindi, Indonesian, Italian, Japanese, Korean, Persian, Polish, Portuguese, Romanian, Russian, Spanish, Turkish, Ukrainian, and Vietnamese
+
+**Context length**: 128K
+
+### Evaluation
+
+<img src="winrates_marenahard.png" width="650" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
+
+### Model Card Contact
+
+For errors or additional questions about details in this model card, contact [email protected].
+
+### Terms of Use
+
+We hope that the release of this model will make community-based research efforts more accessible, by releasing the weights of a highly performant multilingual model to researchers all over the world. This model is governed by a [CC-BY-NC](https://cohere.com/c4ai-cc-by-nc-license) License with an acceptable use addendum, and also requires adhering to [C4AI's Acceptable Use Policy](https://docs.cohere.com/docs/c4ai-acceptable-use-policy).
+
+### Try the model today
+
+You can try Aya Expanse in the Cohere [playground](https://dashboard.cohere.com/playground/chat) here. You can also use it in our dedicated Hugging Face Space [here](https://huggingface.co/spaces/CohereForAI/aya_expanse).

config.json

@@ -0,0 +1,39 @@
+{
+    "_name_or_path": "sanity/hf_ckpt/sanity_35b_i3_main_3k_20241020_063420_most_basket/ckpt-1149",
+    "architectures": [
+        "CohereForCausalLM"
+    ],
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "bos_token_id": 5,
+    "eos_token_id": 255001,
+    "hidden_act": "silu",
+    "hidden_size": 8192,
+    "initializer_range": 0.02,
+    "intermediate_size": 24576,
+    "layer_norm_eps": 1e-05,
+    "logit_scale": 0.0625,
+    "max_position_embeddings": 8192,
+    "model_type": "cohere",
+    "num_attention_heads": 64,
+    "num_hidden_layers": 40,
+    "num_key_value_heads": 8,
+    "pad_token_id": 0,
+    "rope_theta": 4000000,
+    "torch_dtype": "float16",
+    "transformers_version": "4.44.0",
+    "use_cache": true,
+    "use_qk_norm": false,
+    "vocab_size": 256000,
+    "quantization_config": {
+        "quant_method": "exl2",
+        "version": "0.2.3",
+        "bits": 4.0,
+        "head_bits": 6,
+        "calibration": {
+            "rows": 115,
+            "length": 2048,
+            "dataset": "(default)"
+        }
+    }
+}

generation_config.json

@@ -0,0 +1,7 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 5,
+  "eos_token_id": 255001,
+  "pad_token_id": 0,
+  "transformers_version": "4.44.0"
+}

huggingface-metadata.txt

@@ -0,0 +1,19 @@
+url: https://huggingface.co/CohereForAI/aya-expanse-32b
+branch: main
+download date: 2024-10-26 20:15:38
+sha256sum:
+    6f949230e7b55297fc58a24f481ffa388954a6436f0c5e1c419a94c8548487c9 model-00001-of-00014.safetensors
+    f207bc12c590241be199649d983d51a17f34963635d9c06c991c4b88472f01ff model-00002-of-00014.safetensors
+    e183a8aad7d527986df34f2c40489ce9cd9027d515b63dcdb3779b9b2032e886 model-00003-of-00014.safetensors
+    30667d1d885ce5660588594e2e41428ad07427b8e618fc20795b783a32e9ed78 model-00004-of-00014.safetensors
+    4c6876f75e168b62a95a7035c39d7732b442f5b1fe52ef364bc8633396a8bcfe model-00005-of-00014.safetensors
+    7b4466898c4d526d3b539780d4d611ca6636321690f3007c09b04f7e40f88e1f model-00006-of-00014.safetensors
+    8ea8556aaef9b0abe1ca1fea7f163c62ffa6f7f3183aded4d2c01ad84b91c18b model-00007-of-00014.safetensors
+    f189e4478009795ee63b56d1c03653f9734d802a14ea44acc46ea7670d6fc693 model-00008-of-00014.safetensors
+    ffac21f772dc3153b27b583ff92ecc715c8c076f25075667ceace2fcfd2dd8fc model-00009-of-00014.safetensors
+    3649b6d1df6f45e747e6e3d1ccfd861133741b7adf9bb43ba60094186c57f83a model-00010-of-00014.safetensors
+    bf7672e7b6457c80e298e1f6275c1e351d87f95b2cc19c58d8bf5e5e5af8830d model-00011-of-00014.safetensors
+    f46d73cd4242a6fb55373a960580a0cfbb1585124a6367d414711fb9ed23f70c model-00012-of-00014.safetensors
+    8d08950d61bb5b9ca5f0a21dd0f710e647b12dc50649981173dadd6f05633e4b model-00013-of-00014.safetensors
+    5c93d2b482022cd44b532e0b66f90e7a68a9b44d9f9d32ed631029f3ce48f570 model-00014-of-00014.safetensors
+    c69a7ea6c0927dfac8c349186ebcf0466a4723c21cbdb2e850cf559f0bee92b8 tokenizer.json

model.safetensors.index.json

@@ -0,0 +1,329 @@
+{
+  "metadata": {
+    "total_size": 64592953344
+  },
+  "weight_map": {
+    "model.embed_tokens.weight": "model-00001-of-00014.safetensors",
+    "model.layers.0.input_layernorm.weight": "model-00002-of-00014.safetensors",
+    "model.layers.0.mlp.down_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.0.mlp.gate_proj.weight": "model-00001-of-00014.safetensors",
+    "model.layers.0.mlp.up_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.0.self_attn.k_proj.weight": "model-00001-of-00014.safetensors",
+    "model.layers.0.self_attn.o_proj.weight": "model-00001-of-00014.safetensors",
+    "model.layers.0.self_attn.q_proj.weight": "model-00001-of-00014.safetensors",
+    "model.layers.0.self_attn.v_proj.weight": "model-00001-of-00014.safetensors",
+    "model.layers.1.input_layernorm.weight": "model-00002-of-00014.safetensors",
+    "model.layers.1.mlp.down_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.1.mlp.gate_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.1.mlp.up_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.1.self_attn.k_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.1.self_attn.o_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.1.self_attn.q_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.1.self_attn.v_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.10.input_layernorm.weight": "model-00005-of-00014.safetensors",
+    "model.layers.10.mlp.down_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.10.mlp.gate_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.10.mlp.up_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.10.self_attn.k_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.10.self_attn.o_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.10.self_attn.q_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.10.self_attn.v_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.11.input_layernorm.weight": "model-00005-of-00014.safetensors",
+    "model.layers.11.mlp.down_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.11.mlp.gate_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.11.mlp.up_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.11.self_attn.k_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.11.self_attn.o_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.11.self_attn.q_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.11.self_attn.v_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.12.input_layernorm.weight": "model-00005-of-00014.safetensors",
+    "model.layers.12.mlp.down_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.12.mlp.gate_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.12.mlp.up_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.12.self_attn.k_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.12.self_attn.o_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.12.self_attn.q_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.12.self_attn.v_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.13.input_layernorm.weight": "model-00006-of-00014.safetensors",
+    "model.layers.13.mlp.down_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.13.mlp.gate_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.13.mlp.up_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.13.self_attn.k_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.13.self_attn.o_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.13.self_attn.q_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.13.self_attn.v_proj.weight": "model-00005-of-00014.safetensors",
+    "model.layers.14.input_layernorm.weight": "model-00006-of-00014.safetensors",
+    "model.layers.14.mlp.down_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.14.mlp.gate_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.14.mlp.up_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.14.self_attn.k_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.14.self_attn.o_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.14.self_attn.q_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.14.self_attn.v_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.15.input_layernorm.weight": "model-00006-of-00014.safetensors",
+    "model.layers.15.mlp.down_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.15.mlp.gate_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.15.mlp.up_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.15.self_attn.k_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.15.self_attn.o_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.15.self_attn.q_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.15.self_attn.v_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.16.input_layernorm.weight": "model-00007-of-00014.safetensors",
+    "model.layers.16.mlp.down_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.16.mlp.gate_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.16.mlp.up_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.16.self_attn.k_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.16.self_attn.o_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.16.self_attn.q_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.16.self_attn.v_proj.weight": "model-00006-of-00014.safetensors",
+    "model.layers.17.input_layernorm.weight": "model-00007-of-00014.safetensors",
+    "model.layers.17.mlp.down_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.17.mlp.gate_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.17.mlp.up_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.17.self_attn.k_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.17.self_attn.o_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.17.self_attn.q_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.17.self_attn.v_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.18.input_layernorm.weight": "model-00007-of-00014.safetensors",
+    "model.layers.18.mlp.down_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.18.mlp.gate_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.18.mlp.up_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.18.self_attn.k_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.18.self_attn.o_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.18.self_attn.q_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.18.self_attn.v_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.19.input_layernorm.weight": "model-00007-of-00014.safetensors",
+    "model.layers.19.mlp.down_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.19.mlp.gate_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.19.mlp.up_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.19.self_attn.k_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.19.self_attn.o_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.19.self_attn.q_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.19.self_attn.v_proj.weight": "model-00007-of-00014.safetensors",
+    "model.layers.2.input_layernorm.weight": "model-00002-of-00014.safetensors",
+    "model.layers.2.mlp.down_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.2.mlp.gate_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.2.mlp.up_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.2.self_attn.k_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.2.self_attn.o_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.2.self_attn.q_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.2.self_attn.v_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.20.input_layernorm.weight": "model-00008-of-00014.safetensors",
+    "model.layers.20.mlp.down_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.20.mlp.gate_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.20.mlp.up_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.20.self_attn.k_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.20.self_attn.o_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.20.self_attn.q_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.20.self_attn.v_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.21.input_layernorm.weight": "model-00008-of-00014.safetensors",
+    "model.layers.21.mlp.down_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.21.mlp.gate_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.21.mlp.up_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.21.self_attn.k_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.21.self_attn.o_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.21.self_attn.q_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.21.self_attn.v_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.22.input_layernorm.weight": "model-00008-of-00014.safetensors",
+    "model.layers.22.mlp.down_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.22.mlp.gate_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.22.mlp.up_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.22.self_attn.k_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.22.self_attn.o_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.22.self_attn.q_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.22.self_attn.v_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.23.input_layernorm.weight": "model-00009-of-00014.safetensors",
+    "model.layers.23.mlp.down_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.23.mlp.gate_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.23.mlp.up_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.23.self_attn.k_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.23.self_attn.o_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.23.self_attn.q_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.23.self_attn.v_proj.weight": "model-00008-of-00014.safetensors",
+    "model.layers.24.input_layernorm.weight": "model-00009-of-00014.safetensors",
+    "model.layers.24.mlp.down_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.24.mlp.gate_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.24.mlp.up_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.24.self_attn.k_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.24.self_attn.o_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.24.self_attn.q_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.24.self_attn.v_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.25.input_layernorm.weight": "model-00009-of-00014.safetensors",
+    "model.layers.25.mlp.down_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.25.mlp.gate_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.25.mlp.up_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.25.self_attn.k_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.25.self_attn.o_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.25.self_attn.q_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.25.self_attn.v_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.26.input_layernorm.weight": "model-00010-of-00014.safetensors",
+    "model.layers.26.mlp.down_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.26.mlp.gate_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.26.mlp.up_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.26.self_attn.k_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.26.self_attn.o_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.26.self_attn.q_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.26.self_attn.v_proj.weight": "model-00009-of-00014.safetensors",
+    "model.layers.27.input_layernorm.weight": "model-00010-of-00014.safetensors",
+    "model.layers.27.mlp.down_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.27.mlp.gate_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.27.mlp.up_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.27.self_attn.k_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.27.self_attn.o_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.27.self_attn.q_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.27.self_attn.v_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.28.input_layernorm.weight": "model-00010-of-00014.safetensors",
+    "model.layers.28.mlp.down_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.28.mlp.gate_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.28.mlp.up_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.28.self_attn.k_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.28.self_attn.o_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.28.self_attn.q_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.28.self_attn.v_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.29.input_layernorm.weight": "model-00011-of-00014.safetensors",
+    "model.layers.29.mlp.down_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.29.mlp.gate_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.29.mlp.up_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.29.self_attn.k_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.29.self_attn.o_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.29.self_attn.q_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.29.self_attn.v_proj.weight": "model-00010-of-00014.safetensors",
+    "model.layers.3.input_layernorm.weight": "model-00003-of-00014.safetensors",
+    "model.layers.3.mlp.down_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.3.mlp.gate_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.3.mlp.up_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.3.self_attn.k_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.3.self_attn.o_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.3.self_attn.q_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.3.self_attn.v_proj.weight": "model-00002-of-00014.safetensors",
+    "model.layers.30.input_layernorm.weight": "model-00011-of-00014.safetensors",
+    "model.layers.30.mlp.down_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.30.mlp.gate_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.30.mlp.up_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.30.self_attn.k_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.30.self_attn.o_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.30.self_attn.q_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.30.self_attn.v_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.31.input_layernorm.weight": "model-00011-of-00014.safetensors",
+    "model.layers.31.mlp.down_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.31.mlp.gate_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.31.mlp.up_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.31.self_attn.k_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.31.self_attn.o_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.31.self_attn.q_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.31.self_attn.v_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.32.input_layernorm.weight": "model-00011-of-00014.safetensors",
+    "model.layers.32.mlp.down_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.32.mlp.gate_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.32.mlp.up_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.32.self_attn.k_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.32.self_attn.o_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.32.self_attn.q_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.32.self_attn.v_proj.weight": "model-00011-of-00014.safetensors",
+    "model.layers.33.input_layernorm.weight": "model-00012-of-00014.safetensors",
+    "model.layers.33.mlp.down_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.33.mlp.gate_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.33.mlp.up_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.33.self_attn.k_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.33.self_attn.o_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.33.self_attn.q_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.33.self_attn.v_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.34.input_layernorm.weight": "model-00012-of-00014.safetensors",
+    "model.layers.34.mlp.down_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.34.mlp.gate_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.34.mlp.up_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.34.self_attn.k_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.34.self_attn.o_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.34.self_attn.q_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.34.self_attn.v_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.35.input_layernorm.weight": "model-00012-of-00014.safetensors",
+    "model.layers.35.mlp.down_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.35.mlp.gate_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.35.mlp.up_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.35.self_attn.k_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.35.self_attn.o_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.35.self_attn.q_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.35.self_attn.v_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.36.input_layernorm.weight": "model-00013-of-00014.safetensors",
+    "model.layers.36.mlp.down_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.36.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.36.mlp.up_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.36.self_attn.k_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.36.self_attn.o_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.36.self_attn.q_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.36.self_attn.v_proj.weight": "model-00012-of-00014.safetensors",
+    "model.layers.37.input_layernorm.weight": "model-00013-of-00014.safetensors",
+    "model.layers.37.mlp.down_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.37.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.37.mlp.up_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.37.self_attn.k_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.37.self_attn.o_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.37.self_attn.q_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.37.self_attn.v_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.38.input_layernorm.weight": "model-00013-of-00014.safetensors",
+    "model.layers.38.mlp.down_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.38.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.38.mlp.up_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.38.self_attn.k_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.38.self_attn.o_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.38.self_attn.q_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.38.self_attn.v_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.39.input_layernorm.weight": "model-00014-of-00014.safetensors",
+    "model.layers.39.mlp.down_proj.weight": "model-00014-of-00014.safetensors",
+    "model.layers.39.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.39.mlp.up_proj.weight": "model-00014-of-00014.safetensors",
+    "model.layers.39.self_attn.k_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.39.self_attn.o_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.39.self_attn.q_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.39.self_attn.v_proj.weight": "model-00013-of-00014.safetensors",
+    "model.layers.4.input_layernorm.weight": "model-00003-of-00014.safetensors",
+    "model.layers.4.mlp.down_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.4.mlp.gate_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.4.mlp.up_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.4.self_attn.k_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.4.self_attn.o_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.4.self_attn.q_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.4.self_attn.v_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.5.input_layernorm.weight": "model-00003-of-00014.safetensors",
+    "model.layers.5.mlp.down_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.5.mlp.gate_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.5.mlp.up_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.5.self_attn.k_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.5.self_attn.o_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.5.self_attn.q_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.5.self_attn.v_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.6.input_layernorm.weight": "model-00003-of-00014.safetensors",
+    "model.layers.6.mlp.down_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.6.mlp.gate_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.6.mlp.up_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.6.self_attn.k_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.6.self_attn.o_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.6.self_attn.q_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.6.self_attn.v_proj.weight": "model-00003-of-00014.safetensors",
+    "model.layers.7.input_layernorm.weight": "model-00004-of-00014.safetensors",
+    "model.layers.7.mlp.down_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.7.mlp.gate_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.7.mlp.up_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.7.self_attn.k_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.7.self_attn.o_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.7.self_attn.q_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.7.self_attn.v_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.8.input_layernorm.weight": "model-00004-of-00014.safetensors",
+    "model.layers.8.mlp.down_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.8.mlp.gate_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.8.mlp.up_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.8.self_attn.k_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.8.self_attn.o_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.8.self_attn.q_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.8.self_attn.v_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.9.input_layernorm.weight": "model-00004-of-00014.safetensors",
+    "model.layers.9.mlp.down_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.9.mlp.gate_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.9.mlp.up_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.9.self_attn.k_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.9.self_attn.o_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.9.self_attn.q_proj.weight": "model-00004-of-00014.safetensors",
+    "model.layers.9.self_attn.v_proj.weight": "model-00004-of-00014.safetensors",
+    "model.norm.weight": "model-00014-of-00014.safetensors"
+  }
+}

output-00001-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:72de385d0afef02596f5afc1da6d6e1b24e58b3a9a974630ea3e0e3bf552df73
+size 8550289076

output-00003-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:048ce8ba307fe2a9099100a04be8257e18dd587c2822df43883f75387d8e737d
+size 4891644456

special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<BOS_TOKEN>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|END_OF_TURN_TOKEN|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<PAD>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c69a7ea6c0927dfac8c349186ebcf0466a4723c21cbdb2e850cf559f0bee92b8
+size 12777433

tokenizer_config.json

@@ -0,0 +1,330 @@
+{
+  "add_bos_token": true,
+  "add_eos_token": false,
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<PAD>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<UNK>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "<CLS>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "3": {
+      "content": "<SEP>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "4": {
+      "content": "<MASK_TOKEN>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "5": {
+      "content": "<BOS_TOKEN>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "6": {
+      "content": "<EOS_TOKEN>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "7": {
+      "content": "<EOP_TOKEN>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "255000": {
+      "content": "<|START_OF_TURN_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255001": {
+      "content": "<|END_OF_TURN_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "255002": {
+      "content": "<|YES_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255003": {
+      "content": "<|NO_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255004": {
+      "content": "<|GOOD_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255005": {
+      "content": "<|BAD_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255006": {
+      "content": "<|USER_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255007": {
+      "content": "<|CHATBOT_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255008": {
+      "content": "<|SYSTEM_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255009": {
+      "content": "<|USER_0_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255010": {
+      "content": "<|USER_1_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255011": {
+      "content": "<|USER_2_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255012": {
+      "content": "<|USER_3_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255013": {
+      "content": "<|USER_4_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255014": {
+      "content": "<|USER_5_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255015": {
+      "content": "<|USER_6_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255016": {
+      "content": "<|USER_7_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255017": {
+      "content": "<|USER_8_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255018": {
+      "content": "<|USER_9_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255019": {
+      "content": "<|EXTRA_0_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255020": {
+      "content": "<|EXTRA_1_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255021": {
+      "content": "<|EXTRA_2_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255022": {
+      "content": "<|EXTRA_3_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255023": {
+      "content": "<|EXTRA_4_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255024": {
+      "content": "<|EXTRA_5_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255025": {
+      "content": "<|EXTRA_6_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255026": {
+      "content": "<|EXTRA_7_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255027": {
+      "content": "<|EXTRA_8_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "255028": {
+      "content": "<|EXTRA_9_TOKEN|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "bos_token": "<BOS_TOKEN>",
+  "chat_template": [
+    {
+      "name": "default",
+      "template": "{{ bos_token }}{% if messages[0]['role'] == 'system' %}{% set loop_messages = messages[1:] %}{% set system_message = messages[0]['content'] %}{% elif false == true %}{% set loop_messages = messages %}{% set system_message = 'You are Aya, a brilliant, sophisticated, multilingual AI-assistant trained to assist human users by providing thorough responses. You are able to interact and respond to questions in 23 languages and you are powered by a multilingual model built by Cohere For AI.' %}{% else %}{% set loop_messages = messages %}{% set system_message = false %}{% endif %}{% if system_message != false %}{{ '<|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|>' + system_message + '<|END_OF_TURN_TOKEN|>' }}{% endif %}{% for message in loop_messages %}{% if (message['role'] == 'user') != (loop.index0 % 2 == 0) %}{{ raise_exception('Conversation roles must alternate user/assistant/user/assistant/...') }}{% endif %}{% set content = message['content'] %}{% if message['role'] == 'user' %}{{ '<|START_OF_TURN_TOKEN|><|USER_TOKEN|>' + content.strip() + '<|END_OF_TURN_TOKEN|>' }}{% elif message['role'] == 'assistant' %}{{ '<|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>'  + content.strip() + '<|END_OF_TURN_TOKEN|>' }}{% endif %}{% endfor %}{% if add_generation_prompt %}{{ '<|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>' }}{% endif %}"
+    },
+    {
+      "name": "tool_use",
+      "template": "{{ bos_token }}{% if messages[0]['role'] == 'system' %}{% set loop_messages = messages[1:] %}{% set system_message = messages[0]['content'] %}{% else %}{% set loop_messages = messages %}{% set system_message = '## Task and Context\\nYou help people answer their questions and other requests interactively. You will be asked a very wide array of requests on all kinds of topics. You will be equipped with a wide range of search engines or similar tools to help you, which you use to research your answer. You should focus on serving the user\\'s needs as best you can, which will be wide-ranging.\\n\\n## Style Guide\\nUnless the user asks for a different style of answer, you should answer in full sentences, using proper grammar and spelling.' %}{% endif %}{{ '<|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|>' }}{{ '# Safety Preamble' }}{{ '\nThe instructions in this section override those in the task description and style guide sections. Don\\'t answer questions that are harmful or immoral.' }}{{ '\n\n# System Preamble' }}{{ '\n## Basic Rules' }}{{ '\nYou are a powerful conversational AI trained by Cohere to help people. You are augmented by a number of tools, and your job is to use and consume the output of these tools to best help the user. You will see a conversation history between yourself and a user, ending with an utterance from the user. You will then see a specific instruction instructing you what kind of response to generate. When you answer the user\\'s requests, you cite your sources in your answers, according to those instructions.' }}{{ '\n\n# User Preamble' }}{{ '\n' + system_message }}{{'\n\n## Available Tools\nHere is a list of tools that you have available to you:\n\n'}}{% for tool in tools %}{% if loop.index0 != 0 %}{{ '\n\n'}}{% endif %}{{'```python\ndef ' + tool.name + '('}}{% for param_name, param_fields in tool.parameter_definitions.items() %}{% if loop.index0 != 0 %}{{ ', '}}{% endif %}{{param_name}}: {% if not param_fields.required %}{{'Optional[' + param_fields.type + '] = None'}}{% else %}{{ param_fields.type }}{% endif %}{% endfor %}{{ ') -> List[Dict]:\n    \"\"\"'}}{{ tool.description }}{% if tool.parameter_definitions|length != 0 %}{{ '\n\n    Args:\n        '}}{% for param_name, param_fields in tool.parameter_definitions.items() %}{% if loop.index0 != 0 %}{{ '\n        ' }}{% endif %}{{ param_name + ' ('}}{% if not param_fields.required %}{{'Optional[' + param_fields.type + ']'}}{% else %}{{ param_fields.type }}{% endif %}{{ '): ' + param_fields.description }}{% endfor %}{% endif %}{{ '\n    \"\"\"\n    pass\n```' }}{% endfor %}{{ '<|END_OF_TURN_TOKEN|>'}}{% for message in loop_messages %}{% set content = message['content'] %}{% if message['role'] == 'user' %}{{ '<|START_OF_TURN_TOKEN|><|USER_TOKEN|>' + content.strip() + '<|END_OF_TURN_TOKEN|>' }}{% elif message['role'] == 'system' %}{{ '<|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|>' + content.strip() + '<|END_OF_TURN_TOKEN|>' }}{% elif message['role'] == 'assistant' %}{{ '<|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>'  + content.strip() + '<|END_OF_TURN_TOKEN|>' }}{% endif %}{% endfor %}{{'<|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|>Write \\'Action:\\' followed by a json-formatted list of actions that you want to perform in order to produce a good response to the user\\'s last input. You can use any of the supplied tools any number of times, but you should aim to execute the minimum number of necessary actions for the input. You should use the `directly-answer` tool if calling the other tools is unnecessary. The list of actions you want to call should be formatted as a list of json objects, for example:\n```json\n[\n    {\n        \"tool_name\": title of the tool in the specification,\n        \"parameters\": a dict of parameters to input into the tool as they are defined in the specs, or {} if it takes no parameters\n    }\n]```<|END_OF_TURN_TOKEN|>'}}{% if add_generation_prompt %}{{ '<|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>' }}{% endif %}"
+    },
+    {
+      "name": "rag",
+      "template": "{{ bos_token }}{% if messages[0]['role'] == 'system' %}{% set loop_messages = messages[1:] %}{% set system_message = messages[0]['content'] %}{% else %}{% set loop_messages = messages %}{% set system_message = '## Task and Context\\nYou help people answer their questions and other requests interactively. You will be asked a very wide array of requests on all kinds of topics. You will be equipped with a wide range of search engines or similar tools to help you, which you use to research your answer. You should focus on serving the user\\'s needs as best you can, which will be wide-ranging.\\n\\n## Style Guide\\nUnless the user asks for a different style of answer, you should answer in full sentences, using proper grammar and spelling.' %}{% endif %}{{ '<|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|>' }}{{ '# Safety Preamble' }}{{ '\nThe instructions in this section override those in the task description and style guide sections. Don\\'t answer questions that are harmful or immoral.' }}{{ '\n\n# System Preamble' }}{{ '\n## Basic Rules' }}{{ '\nYou are a powerful conversational AI trained by Cohere to help people. You are augmented by a number of tools, and your job is to use and consume the output of these tools to best help the user. You will see a conversation history between yourself and a user, ending with an utterance from the user. You will then see a specific instruction instructing you what kind of response to generate. When you answer the user\\'s requests, you cite your sources in your answers, according to those instructions.' }}{{ '\n\n# User Preamble' }}{{ '\n' + system_message }}{{ '<|END_OF_TURN_TOKEN|>'}}{% for message in loop_messages %}{% set content = message['content'] %}{% if message['role'] == 'user' %}{{ '<|START_OF_TURN_TOKEN|><|USER_TOKEN|>' + content.strip() + '<|END_OF_TURN_TOKEN|>' }}{% elif message['role'] == 'system' %}{{ '<|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|>' + content.strip() + '<|END_OF_TURN_TOKEN|>' }}{% elif message['role'] == 'assistant' %}{{ '<|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>'  + content.strip() + '<|END_OF_TURN_TOKEN|>' }}{% endif %}{% endfor %}{{ '<|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|>'}}{{ '<results>' }}{% for document in documents %}{{ '\nDocument: ' }}{{ loop.index0 }}\n{% for key, value in document.items() %}{{ key }}: {{value}}\n{% endfor %}{% endfor %}{{ '</results>'}}{{ '<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|>' }}{{ 'Carefully perform the following instructions, in order, starting each with a new line.\n' }}{{ 'Firstly, Decide which of the retrieved documents are relevant to the user\\'s last input by writing \\'Relevant Documents:\\' followed by comma-separated list of document numbers. If none are relevant, you should instead write \\'None\\'.\n' }}{{ 'Secondly, Decide which of the retrieved documents contain facts that should be cited in a good answer to the user\\'s last input by writing \\'Cited Documents:\\' followed a comma-separated list of document numbers. If you dont want to cite any of them, you should instead write \\'None\\'.\n' }}{% if citation_mode=='accurate' %}{{ 'Thirdly, Write \\'Answer:\\' followed by a response to the user\\'s last input in high quality natural english. Use the retrieved documents to help you. Do not insert any citations or grounding markup.\n' }}{% endif %}{{ 'Finally, Write \\'Grounded answer:\\' followed by a response to the user\\'s last input in high quality natural english. Use the symbols <co: doc> and </co: doc> to indicate when a fact comes from a document in the search result, e.g <co: 0>my fact</co: 0> for a fact from document 0.' }}{{ '<|END_OF_TURN_TOKEN|>' }}{% if add_generation_prompt %}{{ '<|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>' }}{% endif %}"
+    }
+  ],
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|END_OF_TURN_TOKEN|>",
+  "legacy": true,
+  "merges_file": null,
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "<PAD>",
+  "sp_model_kwargs": {},
+  "spaces_between_special_tokens": false,
+  "tokenizer_class": "CohereTokenizer",
+  "unk_token": null,
+  "use_default_system_prompt": false,
+  "vocab_file": null
+}