CapybaraHermes-2.5-Mistral-7B
This model was converted to MLX format from argilla/CapybaraHermes-2.5-Mistral-7B.
Refer to the original model card for more details on the model.
Use with mlx
pip install mlx
git clone https://github.com/ml-explore/mlx-examples.git
cd mlx-examples/llms/hf_llm
python generate.py --model mlx-community/CapybaraHermes-2.5-Mistral-7B --prompt "My name is"
- Downloads last month
- 3
Model tree for mlx-community/CapybaraHermes-2.5-Mistral-7B
Base model
mistralai/Mistral-7B-v0.1
Finetuned
teknium/OpenHermes-2.5-Mistral-7B
Dataset used to train mlx-community/CapybaraHermes-2.5-Mistral-7B
Evaluation results
- normalized accuracy on AI2 Reasoning Challenge (25-Shot)test set Open LLM Leaderboard65.780
- normalized accuracy on HellaSwag (10-Shot)validation set Open LLM Leaderboard85.450
- accuracy on MMLU (5-Shot)test set Open LLM Leaderboard63.130
- mc2 on TruthfulQA (0-shot)validation set Open LLM Leaderboard56.910
- accuracy on Winogrande (5-shot)validation set Open LLM Leaderboard78.300
- accuracy on GSM8k (5-shot)test set Open LLM Leaderboard59.290