TheBloke
/

Llama-2-70B-Chat-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Resources

View closed (0)

Max length 2048 error

#5 opened 12 months ago by

[AUTOMATED] Model Memory Requirements

#4 opened 12 months ago by

model-sizer-bot

Performance and latency vs. GPTQ

#3 opened about 1 year ago by

Deployment via Sagemaker

#2 opened about 1 year ago by

Multi-turn chat?

#1 opened about 1 year ago by

mukundtibrewala