legraphista
/

RoMistral-7b-Instruct-GGUF

Text Generation

Model card Files Files and versions Community

Edit model card

RoMistral-7b-Instruct-GGUF

This is GGUF quantized version of OpenLLM-Ro/RoMistral-7b-Instruct created using llama.cpp

Downloads last month: 144

GGUF

Model size

7.24B params

Architecture

llama

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for legraphista/RoMistral-7b-Instruct-GGUF

Base model

mistralai/Mistral-7B-v0.1

Finetuned

OpenLLM-Ro/RoMistral-7b-Instruct

Quantized

(3)

this model

Collection including legraphista/RoMistral-7b-Instruct-GGUF

RoMistral GGUF

GGUF variants of https://huggingface.co/collections/OpenLLM-Ro/romistral-6647241bf2cbbe9fd8c2afa4 • 2 items • Updated Aug 5