Hugging Face's logo
Iwan Kawrakow's picture
13

Iwan Kawrakow

ikawrakow
Handgun1773's profile picture sirakr's profile picture Badl7's profile picture
·

AI & ML interests

None yet

Organizations

None yet

ikawrakow's activity

New activity in ikawrakow/validation-datasets-for-llama.cpp about 2 months ago

Error with test data

7
#2 opened 2 months ago by fedric95
New activity in ikawrakow/various-2bit-sota-gguf 8 months ago

What 2bit quantization approach are you using?

1
#13 opened 8 months ago by ingridstevens
New activity in ikawrakow/mixtral-instruct-8x7b-quantized-gguf 9 months ago

Dataset for importance matrix?

4
#3 opened 9 months ago by RamoreRemora
New activity in ikawrakow/mixtral-8x7b-quantized-gguf 9 months ago

Broken M quants

1
#2 opened 9 months ago by Artefact2
New activity in ikawrakow/various-2bit-sota-gguf 10 months ago

What -ctx and -chunks parameters did you use to make the iMatrix of the Lllama 2 70b?

1
#9 opened 10 months ago by Nexesenex

Would love a deepseekcode 2bit quant. I bet others would love it too :)

2
#6 opened 10 months ago by subiculumforge

[Model request] Saily 100b, Saily 220b

1
#5 opened 10 months ago by Perpetuity7

Could We combine AWQ and Importance Matrix calculation together to further improve perplexity.

3
#4 opened 10 months ago by shing3232
New activity in ikawrakow/mixtral-instruct-8x7b-quantized-gguf 10 months ago

mixtral-instruct-8x7b-q3k-medium.gguf

4
#2 opened 10 months ago by cmh
New activity in ikawrakow/open-hermes-2.5-mistral-7b-quantized-gguf 10 months ago

SOTA 2-Quant of Nous-Heremes-Solar-10.7B and Nous-Hermes-2-Yi-34B, Please 🙏

4
#1 opened 10 months ago by Joseph717171
New activity in ikawrakow/various-2bit-sota-gguf 10 months ago

Please 3b model rocket 2bit?

17
#1 opened 10 months ago by Shqmil
New activity in ikawrakow/mixtral-instruct-8x7b-quantized-gguf 10 months ago

Q5_1 & Q5_K_M quant

3
#1 opened 10 months ago by muzika38
New activity in ikawrakow/mixtral-8x7b-quantized-gguf 10 months ago

Mixtral Instruct quant

3
#1 opened 10 months ago by cmh

Mixtral Instruct quant

3
#1 opened 10 months ago by cmh
New activity in ikawrakow/various-2bit-sota-gguf 10 months ago

Please 3b model rocket 2bit?

17
#1 opened 10 months ago by Shqmil

Please 3b model rocket 2bit?

17
#1 opened 10 months ago by Shqmil