pbatralx
/

Hermes-2-Pro-Mistral-7B-GGUF

transformers - safetensors - mistral - text-generation - Mistral - instruct - finetune - chatml - DPO - RLHF - gpt4 - synthetic data - distillation - function calling - json mode - conversational - en - dataset:teknium/OpenHermes-2.5 - base_model:mistralai/Mistral-7B-v0.1 - base_model:finetune:mistralai/Mistral-7B-v0.1 - license:apache-2.0 - autotrain_compatible - text-generation-inference - endpoints_compatible - region:us

Model card Files Files and versions Community

Edit model card

Hermes-2-Pro-Mistral-7B

This repository contains quantized versions of the model from the original repository: NousResearch/Hermes-2-Pro-Mistral-7B.

Name	Quantization Method	Size (GB)
hermes-2-pro-mistral-7b.Q8_0.gguf	q8_0	7.17

Downloads last month: 3

GGUF

Model size

7.24B params

Architecture

llama

8-bit

Inference API

Inference API (serverless) has been turned off for this model.

Model tree for pbatralx/Hermes-2-Pro-Mistral-7B-GGUF

Base model

mistralai/Mistral-7B-v0.1

Finetuned

NousResearch/Hermes-2-Pro-Mistral-7B

Quantized

(16)

this model

Dataset used to train pbatralx/Hermes-2-Pro-Mistral-7B-GGUF