OliP
/

Phi-3-mini-128k-instruct-awq

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Phi-3-mini-128k-instruct-awq / README.md

OliP's picture

Update README.md

e6ca7e2 verified 5 months ago

|

history blame contribute delete

299 Bytes

Phi-3-mini-128k-instruct-awq is a quantized version of the June'24 version of Phi-3-mini-128k-instruct created by AutoAWQ. Requires vllm>=v0.5.1.