README.md

metadata

language: en
tags:
  - pytorch
  - question-answering
datasets:
  - squad_v2
  - squad2
license: cc-by-4.0
metrics:
  - squad_v2
  - exact
  - f1
widget:
  - text: >-
      By what main attribute are computational problems classified utilizing
      computational complexity theory?
    context: >-
      Computational complexity theory is a branch of the theory of computation
      in theoretical computer science that focuses on classifying computational
      problems according to their inherent difficulty, and relating those
      classes to each other. A computational problem is understood to be a task
      that is in principle amenable to being solved by a computer, which is
      equivalent to stating that the problem may be solved by mechanical
      application of mathematical steps, such as an algorithm.

Performance

This ensemble was evaluated on SQuAD 2.0 with the following results:

{'HasAns_exact': 52.5472334682861,
 'HasAns_f1': 67.94939813758602,
 'HasAns_total': 5928,
 'NoAns_exact': 91.75777964676199,
 'NoAns_f1': 91.75777964676199,
 'NoAns_total': 5945,
 'best_exact': 72.16373283921503,
 'best_exact_thresh': 0.0,
 'best_f1': 79.85378860941708,
 'best_f1_thresh': 0.0,
 'exact': 72.1805777815211,
 'f1': 79.87063355172326,
 'total': 11873
 }