Adding `safetensors` variant of this model
#11 opened about 1 month ago
by
SFconvertbot
Adding Evaluation Results
#10 opened about 1 year ago
by
leaderboard-pr-bot
[AUTOMATED] Model Memory Requirements
#9 opened about 1 year ago
by
model-sizer-bot
The model weights are not tied. Please use the `tie_weights` method before using the `infer_auto_device` function.
1
#8 opened over 1 year ago
by
carlosmoises
GPTQ 4bit 128g
#7 opened over 1 year ago
by
pszemraj
3B Model
#6 opened over 1 year ago
by
aszfcxcgszdx
GGML f16, q4_0, q4_1, q4_2, q4_3
#4 opened over 1 year ago
by
oeathus
Can anyone make ggml 4bit q4_0 version?
3
#3 opened over 1 year ago
by
4eJIoBek