This measure does not take into account non-understanding, that is the classifier's determination that the best response is not good enough<cite> (Leuski et al., 2006)</cite> , since this capability was not implemented; however, since all of our test questions are known to have at least one appropriate response, any non-understanding of a question would necessarily count against accuracy anyway.