license: other | |
license_name: yi-license | |
license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE | |
tags: | |
- merge | |
GGUF quants of [TeeZee/Kyllene-34B-v1.1](https://huggingface.co/TeeZee/Kyllene-34B-v1.1), | |
remeber to set your max context length to proper length for your hardware, 4096 is fine. | |
Default context length is 200k so it will eat RAM or VRAM like crazy if left unchecked. |