transformers gguf mistral instruct finetune chatml gpt4 synthetic data distillation dpo rlhf en dataset:mlabonne/chatml_dpo_pairs base_model:mlabonne/NeuralHermes-2.5-Mistral-7B base_model:quantized:mlabonne/NeuralHermes-2.5-Mistral-7B license:apache-2.0 text-generation-inference region:us conversational
{"model_type": "mistral"}