README.md

---
base_model: echarlaix/distilbert-base-uncased-distilled-squad-openvino
datasets:
- squad
language: en
license: apache-2.0
tags:
- openvino
- openvino
widget:
- text: Which name is also used to describe the Amazon rainforest in English?
  context: 'The Amazon rainforest (Portuguese: Floresta Amazônica or Amazônia; Spanish:
    Selva Amazónica, Amazonía or usually Amazonia; French: Forêt amazonienne; Dutch:
    Amazoneregenwoud), also known in English as Amazonia or the Amazon Jungle, is
    a moist broadleaf forest that covers most of the Amazon basin of South America.
    This basin encompasses 7,000,000 square kilometres (2,700,000 sq mi), of which
    5,500,000 square kilometres (2,100,000 sq mi) are covered by the rainforest. This
    region includes territory belonging to nine nations. The majority of the forest
    is contained within Brazil, with 60% of the rainforest, followed by Peru with
    13%, Colombia with 10%, and with minor amounts in Venezuela, Ecuador, Bolivia,
    Guyana, Suriname and French Guiana. States or departments in four nations contain
    "Amazonas" in their names. The Amazon represents over half of the planet''s remaining
    rainforests, and comprises the largest and most biodiverse tract of tropical rainforest
    in the world, with an estimated 390 billion individual trees divided into 16,000
    species.'
- text: How many square kilometers of rainforest is covered in the basin?
  context: 'The Amazon rainforest (Portuguese: Floresta Amazônica or Amazônia; Spanish:
    Selva Amazónica, Amazonía or usually Amazonia; French: Forêt amazonienne; Dutch:
    Amazoneregenwoud), also known in English as Amazonia or the Amazon Jungle, is
    a moist broadleaf forest that covers most of the Amazon basin of South America.
    This basin encompasses 7,000,000 square kilometres (2,700,000 sq mi), of which
    5,500,000 square kilometres (2,100,000 sq mi) are covered by the rainforest. This
    region includes territory belonging to nine nations. The majority of the forest
    is contained within Brazil, with 60% of the rainforest, followed by Peru with
    13%, Colombia with 10%, and with minor amounts in Venezuela, Ecuador, Bolivia,
    Guyana, Suriname and French Guiana. States or departments in four nations contain
    "Amazonas" in their names. The Amazon represents over half of the planet''s remaining
    rainforests, and comprises the largest and most biodiverse tract of tropical rainforest
    in the world, with an estimated 390 billion individual trees divided into 16,000
    species.'
---

This model is a quantized version of [`echarlaix/distilbert-base-uncased-distilled-squad-openvino`](https://huggingface.co/echarlaix/distilbert-base-uncased-distilled-squad-openvino) and is converted to the OpenVINO format. This model was obtained via the [nncf-quantization](https://huggingface.co/spaces/echarlaix/nncf-quantization) space with [optimum-intel](https://github.com/huggingface/optimum-intel).

First make sure you have `optimum-intel` installed:

```bash
pip install optimum[openvino]
```

To load your model you can do as follows:

```python
from optimum.intel import OVModelForQuestionAnswering

model_id = "echarlaix/distilbert-base-uncased-distilled-squad-openvino-8bit"
model = OVModelForQuestionAnswering.from_pretrained(model_id)
```