[AUTOMATED] Model Memory Requirements
pinned#12 opened 4 months ago
by
model-sizer-bot
ValueError: Trying to set a tensor of shape torch.Size([1024, 8192]) in "weight" (which has shape torch.Size([8192, 8192])), this look incorrect.
1
#11 opened 4 months ago
by
Dongsz
请问加载这个模型要多少GPU?我24000+的提示out of memory
1
#10 opened 5 months ago
by
zyc1128
Request: DOI
4
#9 opened 5 months ago
by
luxen1234
没有在线体验的demo吗?
4
#8 opened 6 months ago
by
jansen-liu
请问能否提供EXL2量化版本?
1
#7 opened 6 months ago
by
Orion-zhen
能不能提供awq或gptq量化模型
5
#6 opened 6 months ago
by
bujido
请问能提供GPTQ-Int8版本吗?
4
#5 opened 6 months ago
by
worldggg
Can you provide the Q5_k_s.gguf model? Thank you.
#4 opened 6 months ago
by
juexing2024
perfect!!!
2
#3 opened 6 months ago
by
bluestarry