metadata
license: other
Overview
Mistral 7B, a 7-billion-parameter Large Language Model by Mistral AI. Designed for efficiency and performance, it suits real-time applications requiring swift responses.
Variants
| No | Variant | Cortex CLI command |
|---|---|---|
| 1 | 7b-gguf | cortex run mistral:7b-gguf |
| 2 | tensorrt-llm | cortex run mistral:tensorrt-llm |
| 3 | 7b-onnx | cortex run mistral:7b-onnx |
Use it with Jan (UI)
- Install Jan using Quickstart
- Use in Jan model Hub:
cortexhub/mistral
Use it with Cortex (CLI)
- Install Cortex using Quickstart
- Run the model with command:
cortex run mistral
Credits
- Author: MistralAI
- Converter: Homebrew
- Original License: Licence
- Papers: Mistral paper