Hugging Face's logo

lodrick-the-lafted
/
Olethros-8B

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
lodrick-the-lafted commited on
Commit
9db251f
•
1 Parent(s): 8749fd6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -20,10 +20,11 @@ L3-8b-Instruct tuned on roughly 6000 Opus generations in the hopes of adding a b
20
  <br />
21
 
22
  # Quants
23
- Exl2 and AWQ available right now.
24
 
25
  | Type | Misc | Author |
26
  | ----- | ----- | ----- |
 
27
  [AWQ](https://huggingface.co/lodrick-the-lafted/Olethros-8B-AWQ)| | lodrick |
28
  [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.25-exl2)| 2.25bpw | blockblockblock |
29
  [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.5-exl2)| 2.5bpw | blockblockblock |
 
20
  <br />
21
 
22
  # Quants
23
+ GGUF, Exl2 and AWQ available right now.
24
 
25
  | Type | Misc | Author |
26
  | ----- | ----- | ----- |
27
+ [GGUF](https://huggingface.co/mradermacher/Olethros-8B-GGUF)| Static GGUF Quants | mradermacher |
28
  [AWQ](https://huggingface.co/lodrick-the-lafted/Olethros-8B-AWQ)| | lodrick |
29
  [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.25-exl2)| 2.25bpw | blockblockblock |
30
  [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.5-exl2)| 2.5bpw | blockblockblock |