Hugging Face's logo

TheBloke
/
guanaco-33B-GPTQ

Text Generation
Transformers
Safetensors
llama
text-generation-inference
4-bit precision
gptq
Model card Files Community
16
New discussion

Adding Evaluation Results
#16 opened 12 months ago by leaderboard-pr-bot

get this error, running on mac book air m2

1
#14 opened over 1 year ago by ezhuwork

Request: DOI

2
#13 opened over 1 year ago by ryzzlestrizzle

running this on a single RTX 4090 - optimizations / CUDA
#11 opened over 1 year ago by ArbitrationCity

How to finetune the model

10
#10 opened over 1 year ago by clause-crahm

Infinite loop loading tokenizer (specific to 33B-GPTQ repo)

3
#9 opened over 1 year ago by gongy

Sharded Model request!
#8 opened over 1 year ago by J001

Could this model be loaded in 3090 GPU?

24
#6 opened over 1 year ago by Exterminant

Correct prompt?

2
#5 opened over 1 year ago by mancub

Model Hallucinating while loading and generating text through AutoGPTQ

1
#4 opened over 1 year ago by sauravm8

Excellent results so far

10
#3 opened over 1 year ago by Latent-Dreamscape

Error no file named pytorch_model.bin

3
#2 opened over 1 year ago by Boffy

guanaco-65b

6
#1 opened over 1 year ago by bodaay