What framework do you use to quantize this model?
#8 opened 2 months ago
by
sipie800
I would like to get the embedding vector as ouput. Is it supported?
2
#7 opened 4 months ago
by
iwonder87
Fix task name
#6 opened 5 months ago
by
merve
Logits Extraction
1
#5 opened 5 months ago
by
Romnags
can we use lora to finetuning this int4 model?
1
#3 opened 6 months ago
by
khangnh
report for local try run
2
#2 opened 6 months ago
by
kennyx
Look forward to the GGUF version of this model
7
#1 opened 6 months ago
by
jian2023