Upload folder using huggingface_hub

README.md

@@ -8,6 +8,23 @@ license: apache-2.0
 language:
 - en
 ---
+**Exllamav2** quant (**exl2** / **5.0 bpw**) made with ExLlamaV2 v0.0.21
+
+Other EXL2 quants:
+| **Quant** | **Model Size** | **lm_head** |
+| ----- | ---------- | ------- |
+|<center>**[2.2](https://huggingface.co/Zoyd/giannisan_Mistral-10.7B-Instruct-v0.3-depth-upscaling-2_2bpw_exl2)**</center> | <center>3134 MB</center> | <center>6</center> |
+|<center>**[2.5](https://huggingface.co/Zoyd/giannisan_Mistral-10.7B-Instruct-v0.3-depth-upscaling-2_5bpw_exl2)**</center> | <center>3478 MB</center> | <center>6</center> |
+|<center>**[3.0](https://huggingface.co/Zoyd/giannisan_Mistral-10.7B-Instruct-v0.3-depth-upscaling-3_0bpw_exl2)**</center> | <center>4101 MB</center> | <center>6</center> |
+|<center>**[3.5](https://huggingface.co/Zoyd/giannisan_Mistral-10.7B-Instruct-v0.3-depth-upscaling-3_5bpw_exl2)**</center> | <center>4724 MB</center> | <center>6</center> |
+|<center>**[3.75](https://huggingface.co/Zoyd/giannisan_Mistral-10.7B-Instruct-v0.3-depth-upscaling-3_75bpw_exl2)**</center> | <center>5034 MB</center> | <center>6</center> |
+|<center>**[4.0](https://huggingface.co/Zoyd/giannisan_Mistral-10.7B-Instruct-v0.3-depth-upscaling-4_0bpw_exl2)**</center> | <center>5350 MB</center> | <center>6</center> |
+|<center>**[4.25](https://huggingface.co/Zoyd/giannisan_Mistral-10.7B-Instruct-v0.3-depth-upscaling-4_25bpw_exl2)**</center> | <center>5662 MB</center> | <center>6</center> |
+|<center>**[5.0](https://huggingface.co/Zoyd/giannisan_Mistral-10.7B-Instruct-v0.3-depth-upscaling-5_0bpw_exl2)**</center> | <center>6591 MB</center> | <center>6</center> |
+|<center>**[6.0](https://huggingface.co/Zoyd/giannisan_Mistral-10.7B-Instruct-v0.3-depth-upscaling-6_0bpw_exl2)**</center> | <center>7873 MB</center> | <center>8</center> |
+|<center>**[6.5](https://huggingface.co/Zoyd/giannisan_Mistral-10.7B-Instruct-v0.3-depth-upscaling-6_5bpw_exl2)**</center> | <center>8496 MB</center> | <center>8</center> |
+|<center>**[8.0](https://huggingface.co/Zoyd/giannisan_Mistral-10.7B-Instruct-v0.3-depth-upscaling-8_0bpw_exl2)**</center> | <center>9888 MB</center> | <center>8</center> |
+
 # mistral-7b-instruct-v0.3-depth-upscaling
 
 ![image/png](https://cdn-uploads.huggingface.co/production/uploads/643eab4f05a395e2b1c727e3/elcrExK_Q5MQjcdAjYi9V.png)