Deberta v3 large model for QA (SQuAD 2.0)
This is the deberta-v3-large model, fine-tuned using the SQuAD2.0 dataset. It's been trained on question-answer pairs, including unanswerable questions, for the task of Question Answering.
Training Data
The models have been trained on the SQuAD 2.0 dataset.
It can be used for question answering task.
Usage and Performance
The trained model can be used like this:
from transformers import AutoModelForQuestionAnswering, AutoTokenizer, pipeline
# Load model & tokenizer
deberta_model = AutoModelForQuestionAnswering.from_pretrained('navteca/deberta-v3-large-squad2')
deberta_tokenizer = AutoTokenizer.from_pretrained('navteca/deberta-v3-large-squad2')
# Get predictions
nlp = pipeline('question-answering', model=deberta_model, tokenizer=deberta_tokenizer)
result = nlp({
'question': 'How many people live in Berlin?',
'context': 'Berlin had a population of 3,520,031 registered inhabitants in an area of 891.82 square kilometers.'
})
print(result)
#{
# "answer": "3,520,031"
# "end": 36,
# "score": 0.96186668,
# "start": 27,
#}
Author
- Downloads last month
- 72
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Dataset used to train navteca/deberta-v3-large-squad2
Evaluation results
- Exact Match on squad_v2validation set self-reported88.088
- F1 on squad_v2validation set self-reported91.162
- Exact Match on squadvalidation set self-reported89.237
- F1 on squadvalidation set self-reported95.057