metadata
license: cc-by-nc-4.0
language:
- en
Fimbulvetr-10.7B-v1
exllamav2 quant for Sao10K/Fimbulvetr-10.7B-v1Sao10K/Fimbulvetr-10.7B-v1
Runs smoothly on single 3090 in webui with context length set to 4096, ExLlamav2_HF loader and cache_8bit=True
All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel:
