
# INT8 bert-large-uncased-rte-int8-dynamic

## Post-training dynamic quantization

### PyTorch

This is an INT8  PyTorch model quantized with [Intel® Neural Compressor](https://github.com/intel/neural-compressor). 

The original fp32 model comes from the fine-tuned model [yoshitomo-matsubara/bert-large-uncased-rte](https://huggingface.co/yoshitomo-matsubara/bert-large-uncased-rte).

#### Test result

|   |INT8|FP32|
|---|:---:|:---:|
| **Accuracy (eval-f1)** |0.7076|0.7401|
| **Model size (MB)**  |766|1349|

#### Load with Intel® Neural Compressor:

```python
from optimum.intel.neural_compressor.quantization import IncQuantizedModelForSequenceClassification

int8_model = IncQuantizedModelForSequenceClassification.from_pretrained(
    "Intel/bert-large-uncased-rte-int8-dynamic",
)
```

{"language": "en", "license": "apache-2.0", "tags": ["bert", "rte", "glue", "torchdistill", "nlp", "int8", "neural-compressor", "Intel\u00ae Neural Compressor", "text-classfication", "PostTrainingDynamic"], "datasets": ["rte"], "metrics": ["f1"]}
transformers pytorch bert text-classification rte glue torchdistill nlp int8 neural-compressor Intel® Neural Compressor text-classfication PostTrainingDynamic en dataset:rte license:apache-2.0 autotrain_compatible endpoints_compatible region:us
TAGS
#transformers #pytorch #bert #text-classification #rte #glue #torchdistill #nlp #int8 #neural-compressor #Intel® Neural Compressor #text-classfication #PostTrainingDynamic #en #dataset-rte #license-apache-2.0 #autotrain_compatible #endpoints_compatible #region-us 

INT8 bert-large-uncased-rte-int8-dynamic
========================================


Post-training dynamic quantization
----------------------------------


### PyTorch


This is an INT8 PyTorch model quantized with Intel® Neural Compressor.


The original fp32 model comes from the fine-tuned model yoshitomo-matsubara/bert-large-uncased-rte.


#### Test result



#### Load with Intel® Neural Compressor:



### PyTorch


This is an INT8 PyTorch model quantized with Intel® Neural Compressor.


The original fp32 model comes from the fine-tuned model yoshitomo-matsubara/bert-large-uncased-rte. #### Test result #### Load with Intel® Neural Compressor:
TAGS
#transformers #pytorch #bert #text-classification #rte #glue #torchdistill #nlp #int8 #neural-compressor #Intel® Neural Compressor #text-classfication #PostTrainingDynamic #en #dataset-rte #license-apache-2.0 #autotrain_compatible #endpoints_compatible #region-us 
 ### PyTorch


This is an INT8 PyTorch model quantized with Intel® Neural Compressor.


The original fp32 model comes from the fine-tuned model yoshitomo-matsubara/bert-large-uncased-rte. #### Test result #### Load with Intel® Neural Compressor: