How I select models ? First, I bench them, to trim the overfit & dumbified models. Then, I test them. The smartest to my taste end-up here.
Nexes the Old
Nexesenex
AI & ML interests
Playing with the latest features of KoboldCPP and quants of LlamaCPP.
Sharing my favorite models quants with everyone.
Organizations
Collections
2
models
55
Nexesenex/Meta-Llama-3-70B-Instruct.GGUF
Updated
•
106
Nexesenex/MIstral-QUantized-70b_Miqu-1-70b-iMat.GGUF
Updated
•
1.55k
•
67
Nexesenex/mlabonne_Beyonder-4x7B-v3_iMat_Custom_Quant_Stategies-GGUF
Updated
Nexesenex/NousResearch_Llama-2-7b-hf_iMat_Custom_Quant_Stategies-GGUF
Updated
Nexesenex/princeton-nlp_Sheared-LLaMA-2.7B_iMat_Custom_Quant_Stategies-GGUF
Updated
Nexesenex/Google_Gemma-2-9b-it_iMat_Custom_Quant_Stategies-GGUF
Updated
•
202
Nexesenex/Meta_Llama-3.1-8b-it_iMat_Custom_Quant_Stategies-GGUF
Updated
•
39
•
2
Nexesenex/llama-3-70B-Instruct-abliterated-CQ-GGUF
Updated
•
66
•
1
Nexesenex/L3-70B-daybreak-abliterated-v0.4-GGUF-BF16
Updated
•
34
Nexesenex/alchemonaut_QuartetAnemoi-70B-iMat.GGUF
Updated
•
345
•
10
datasets
None public yet