multilingual-e5-small-mlx
This model was converted to MLX format from intfloat/multilingual-e5-small.
Refer to the original model card for more details on the model.
Use with mlx
pip install mlx
git clone https://github.com/ml-explore/mlx-examples.git
cd mlx-examples/llms/hf_llm
python generate.py --model mlx-community/multilingual-e5-small-mlx --prompt "My name is"
- Downloads last month
- 30
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Space using mlx-community/multilingual-e5-small-mlx 1
Evaluation results
- accuracy on MTEB AmazonCounterfactualClassification (en)test set self-reported73.791
- ap on MTEB AmazonCounterfactualClassification (en)test set self-reported37.000
- f1 on MTEB AmazonCounterfactualClassification (en)test set self-reported67.955
- accuracy on MTEB AmazonCounterfactualClassification (de)test set self-reported71.649
- ap on MTEB AmazonCounterfactualClassification (de)test set self-reported82.119
- f1 on MTEB AmazonCounterfactualClassification (de)test set self-reported69.880
- accuracy on MTEB AmazonCounterfactualClassification (en-ext)test set self-reported75.810
- ap on MTEB AmazonCounterfactualClassification (en-ext)test set self-reported24.469
- f1 on MTEB AmazonCounterfactualClassification (en-ext)test set self-reported63.001
- accuracy on MTEB AmazonCounterfactualClassification (ja)test set self-reported64.186