TREC 2016 Total Recall Track Overview
The primary purpose of the Total Recall Track is to evaluate, through controlled simulation, methods designed to achieve very high recall as close as practicable to 100% with a human assessor in the loop. Motivating applications include, among others, electronic discovery in legal proceedings [3] systematic review in evidencebased medicine [6] and the creation of fully labeled test collections for information retrieval "IR" evaluation [5] A secondary, but no less important, purpose is to develop a sandboxed virtual test environment within which IR systems may be tested, while preventing the disclosure of sensitive test data to participants. At the same time, the test environment also operates as a "black box," affording participants confidence that their proprietary systems cannot easily be reverse engineered. The task to be solved in the Total Recall Track is the following:
TREC