Hugging Face's logo

TheBloke
/
Llama-2-70B-Chat-AWQ

Text Generation
Transformers
Safetensors
PyTorch
English
llama
facebook
meta
llama-2
text-generation-inference
4-bit precision
awq
Model card Files Community
5
New discussion

Max length 2048 error

2
#5 opened about 1 year ago by abhatia2

[AUTOMATED] Model Memory Requirements
#4 opened about 1 year ago by model-sizer-bot

Performance and latency vs. GPTQ

1
#3 opened about 1 year ago by krumeto

Deployment via Sagemaker

13
#2 opened about 1 year ago by abhatia2

Multi-turn chat?
#1 opened about 1 year ago by mukundtibrewala