Mechanical Turk & user testing data?
systemtrigger: > Would you not release an update until your UI passed the 10 out of 10 test?No. You cannot expect 100% of unqualified users to grok any UI.> Should I worry about the 3 in which our UI failed them?You should want to know why these 3 didn't pass your test.To say much beyond this in the way of advice I think we need to know about your UI, the test and the worker incentives. What exactly did your HIT Description say?