julep-ai
/

dolphin-2.9.1-llama-3-70b-awq

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

dolphin-2.9.1-llama-3-70b-awq / README.md

diwank's picture

Update README.md

cca428a verified 6 months ago

|

history blame contribute delete

274 Bytes

metadata

library_name: transformers
tags: []

Model Card for dolphin-2.9.1-llama-3-70b-awq

AWQ Quantized version of cognitivecomputations/dolphin-2.9.1-llama-3-70b.

For use with vllm and other inference engines.