zeroshot commited on
Commit
5c610f6
1 Parent(s): b487f01

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -1621,8 +1621,6 @@ language:
1621
 
1622
  # bge-small-en-v1.5-quant
1623
 
1624
- This is the quantized (INT8) ONNX variant of the [bge-small-en-v1.5](https://huggingface.co/BAAI/bge-small-en-v1.5) embeddings model accelerated with [Sparsify](https://github.com/neuralmagic/sparsify) for quantization and [DeepSparseSentenceTransformers](https://github.com/neuralmagic/deepsparse/tree/main/src/deepsparse/sentence_transformers) for inference.
1625
-
1626
  Current list of compressed bge ONNX models:
1627
  | Links | Compression Method |
1628
  | --------------------------------------------------------------------------------------------------- | ---------------------- |
@@ -1633,6 +1631,9 @@ Current list of compressed bge ONNX models:
1633
  | [zeroshot/bge-small-en-v1.5-sparse](https://huggingface.co/zeroshot/bge-small-en-v1.5-sparse) | Quantization (INT8) & 50% Pruning |
1634
  | [zeroshot/bge-small-en-v1.5-quant](https://huggingface.co/zeroshot/bge-small-en-v1.5-quant) | Quantization (INT8) |
1635
 
 
 
 
1636
 
1637
  ```bash
1638
  pip install -U deepsparse-nightly[sentence_transformers]
 
1621
 
1622
  # bge-small-en-v1.5-quant
1623
 
 
 
1624
  Current list of compressed bge ONNX models:
1625
  | Links | Compression Method |
1626
  | --------------------------------------------------------------------------------------------------- | ---------------------- |
 
1631
  | [zeroshot/bge-small-en-v1.5-sparse](https://huggingface.co/zeroshot/bge-small-en-v1.5-sparse) | Quantization (INT8) & 50% Pruning |
1632
  | [zeroshot/bge-small-en-v1.5-quant](https://huggingface.co/zeroshot/bge-small-en-v1.5-quant) | Quantization (INT8) |
1633
 
1634
+ ## Usage
1635
+
1636
+ This is the quantized (INT8) ONNX variant of the [bge-small-en-v1.5](https://huggingface.co/BAAI/bge-small-en-v1.5) embeddings model accelerated with [Sparsify](https://github.com/neuralmagic/sparsify) for quantization and [DeepSparseSentenceTransformers](https://github.com/neuralmagic/deepsparse/tree/main/src/deepsparse/sentence_transformers) for inference.
1637
 
1638
  ```bash
1639
  pip install -U deepsparse-nightly[sentence_transformers]