Model Depot
Collection
Leading generative models packaged in OpenVino format optimized for use on AI PCs
•
50 items
•
Updated
•
2
teknium-open-hermes-2.5-mistral-ov is an OpenVino int4 quantized version of teknium's popular open hermes finetune of mistral, providing a very fast, very small inference implementation, optimized for AI PCs using Intel GPU, CPU and NPU.
teknium-open-hermes-2.5-mistral is a leading chat finetuned version of mistral 7b.
Base model
mistralai/Mistral-7B-v0.1