Hugging Face's logo

Kooten
/
BagelMIsteryTour-v2-8x7B-5bpw-exl2

Text Generation
Transformers
Safetensors
mixtral
mergekit
Merge
text-generation-inference
Inference Endpoints
Model card Files Community
Kooten commited on
Commit
bae2f02
•
1 Parent(s): 97b7368

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -12,12 +12,12 @@ tags:
12
  license: cc-by-nc-4.0
13
  ---
14
 
15
- # BagelMIsteryTour-v2-8x7B 3.5bpw
16
  Exllama quant of [ycros/BagelMIsteryTour-v2-8x7B](https://huggingface.co/ycros/BagelMIsteryTour-v2-8x7B)
17
 
18
  ## Other quants:
19
 
20
- EXL2: [5bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-5bpw-exl2), [3.5bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-3.5bpw-exl2)
21
 
22
  ## Prompt format: Alpaca
23
  It is noted to also work with mistral
 
12
  license: cc-by-nc-4.0
13
  ---
14
 
15
+ # BagelMIsteryTour-v2-8x7B 5bpw
16
  Exllama quant of [ycros/BagelMIsteryTour-v2-8x7B](https://huggingface.co/ycros/BagelMIsteryTour-v2-8x7B)
17
 
18
  ## Other quants:
19
 
20
+ EXL2: [8bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-4bpw-exl2), [3.5bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-3.5bpw-exl2)
21
 
22
  ## Prompt format: Alpaca
23
  It is noted to also work with mistral