File size: 308 Bytes
03c8d56
 
 
9d589cd
03c8d56
 
 
 
1
2
3
4
5
6
7
8
---
tags:
- merge
license: apache-2.0
---
GGUF quants of [TeeZee/Kyllene-34B-v1.1](https://huggingface.co/TeeZee/Kyllene-34B-v1.1),
remeber to set your max context length to proper length for your hardware, 4096 is fine.
Default context length is 200k so it will eat RAM or VRAM like crazy if left unchecked.