Q6 & Q8

by bigstorm - opened Jun 10

Discussion

bigstorm

Jun 10

Good afternoon,

Thank you for your contributions to gradients compute, and creating these models.

Is there a reason you did not produce Q6 and Q8 versions? Thanks!

3thn

Crusoe AI org Jun 10

Hey @bigstorm - I'll upload those, at the time of these generations I didn't have gguf-split set up for files over the HF 50GB limit. But I do now! :D

bigstorm

Jun 10

You're the best. Thank you so much! I'll check back this afternoon and see if they made it on. My 3090s are already smiling. :D

3thn

Crusoe AI org Jun 10

@bigstorm all uploaded, enjoy!

3thn changed discussion status to closed Jun 10

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment