Evaluating digital poetry: Insights from the CAT
We test the Consensual Assessment Technique on recent digital poetry, using graduate students in Experimental Digital Media as judges. Our judges display good interrater agreement for the best and worst poems, but disagree on others. The CAT by itself may not be suitable for use on digital poetry; however, the behavior of quasi expert judges when attempting this task gives us clues towards evidence based, domain specific evaluation. We discuss the role of product base evaluation in digital poetry, and produce a set of desiderata based on our judges' written responses: Reaction, Meaning, Novelty, and Craft.
ICCC