transformers gguf mistral dpo rlaif preference ultrafeedback text-generation en dataset:argilla/ultrafeedback-binarized-preferences base_model:argilla/notus-7b-v1 base_model:quantized:argilla/notus-7b-v1 license:mit model-index text-generation-inference region:us conversational
{"model_type": "mistral"}