BoDong's picture
upload the model
6ceffc4
metadata
license: apache-2.0

Sparse DISTILBERT model (uncased)

Finetuned model pruned to 1:4 structured sparsity.

Intended Use

The model can be used for inference with sparsity optimization. For further details on the model and its usage will be soon available.

Evaluation Results

We get the following results on the SQuADv1.1 tasks development set:

Task SQuADv1.1 (F1)
87.00