Hugging Face's logo
DAN™'s picture
70 3 26

DAN™

dranger003
FarisHijazi's profile picture Cran-May's profile picture HailJebus's profile picture
·

AI & ML interests

None yet

Organizations

None yet

dranger003's activity

New activity in OpenGVLab/InternVL2-40B 4 months ago

Multiple GPUs for inference error

8
#2 opened 5 months ago by Mostudy
New activity in dranger003/bagel-34b-v0.2-iMat.GGUF 5 months ago

Update README.md with license information
#1 opened 5 months ago by Chen-01AI
New activity in dranger003/bagel-34b-v0.4-iMat.GGUF 5 months ago

Update README.md with license information
#1 opened 5 months ago by Chen-01AI
New activity in dranger003/bagel-dpo-34b-v0.5-iMat.GGUF 5 months ago

Update README.md with license information
#1 opened 5 months ago by Chen-01AI
New activity in dranger003/Smaug-34B-v0.1-iMat.GGUF 5 months ago

Update README.md with license information
#2 opened 5 months ago by Chen-01AI
New activity in microsoft/Phi-3-vision-128k-instruct 6 months ago

How to enable streaming for phi 3 vision model ?

6
#15 opened 6 months ago by bhimrazy
New activity in dranger003/c4ai-command-r-plus-iMat.GGUF 6 months ago

I'm generating a imatrix using `groups_merged.txt` if you want me to run any tests?

19
#15 opened 7 months ago by jukofyork
New activity in dranger003/c4ai-command-r-v01-iMat.GGUF 6 months ago

Is the KV cache of these models unusually high?

1
#6 opened 6 months ago by Hugsanir
New activity in dranger003/c4ai-command-r-plus-iMat.GGUF 7 months ago

How about a quantized version that fits in 16 GB of memory like wizardlm?

3
#19 opened 7 months ago by Zibri
New activity in dranger003/c4ai-command-r-v01-iMat.GGUF 7 months ago

Update chat templates

2
#5 opened 7 months ago by CISCai
New activity in dranger003/c4ai-command-r-plus-iMat.GGUF 7 months ago

Will you redo quants after your bpe pr gets merged?

2
#18 opened 7 months ago by ggnoy
New activity in dranger003/dbrx-instruct-iMat.GGUF 7 months ago

can't use llama load gguf model

2
#6 opened 7 months ago by Tianyi000
New activity in dranger003/CausalLM-34b-beta-iMat.GGUF 7 months ago

35B-beta is realeased

4
#3 opened 7 months ago by tastypear
New activity in dranger003/c4ai-command-r-plus-iMat.GGUF 7 months ago

Update chat templates

6
#17 opened 7 months ago by CISCai

Can't merge files with gguf

7
#16 opened 7 months ago by zedmango
New activity in dranger003/SFR-Embedding-Mistral-GGUF 7 months ago

is it possible to use this model with LM Studio ??

2
#1 opened 7 months ago by michabbb
New activity in dranger003/c4ai-command-r-plus-iMat.GGUF 7 months ago

Can we get a Q4 without the IMat?

2
#14 opened 7 months ago by yehiaserag
New activity in dranger003/dbrx-instruct-iMat.GGUF 7 months ago

Reuse your `ggml-dbrx-instruct-16x12b-q8_0-imatrix.dat` file?

20
#1 opened 8 months ago by jukofyork
New activity in dranger003/c4ai-command-r-v01-iMat.GGUF 8 months ago

prompt eval too slow

2
#4 opened 8 months ago by lfjmgs
New activity in dranger003/dbrx-instruct-iMat.GGUF 8 months ago

Very sensitve to any repetition penalty!

2
#2 opened 8 months ago by jukofyork