A virtuous circle: the positive evaluation phenomenon in arts audience research
Arts impact evaluation is the subject of widespread criticism, ranging from a detailed critique of methodology to a wholesale rejection of the very purpose of the endeavour. In particular, it is often identified that audience evaluations are almost always positive. Yet whatever the critique, arts impact evaluation is becoming more and not less prevalent as a condition of public and philanthropic funding. This article explores both the methodological and conceptual problems that contribute to the perceived positive character of social impact research, in two parts: (1) an investigation of the critical literature on audience evaluation, particularly in relation to the argument that evaluation is inevitably positive and as such leads to a confusion between the goals of evaluation and arts advocacy; (2) a reflection on our practices as audience researchers in the performing arts and the practical factors that contribute to the dominance of the positive in audience evaluation.
“Good” organisational reasons for “ineffectual” research: Evaluating summative evaluation of museums and galleries
New displays, galleries and exhibitions in museums and galleries are increasingly subject to summative evaluations, wide-ranging investigations that examine how visitors respond to and engage with particular initiatives. These evaluations provide insights into the behaviour and attitudes of visitors and the ways in which particular exhibitions, exhibits and information resources facilitate engagement, participation and learning. Unfortunately, however, summative evaluation has relatively little impact either on the particular initiative or more generally in contributing to our knowledge of visitor behaviour and understanding of best practice. In this paper, we suggest that the relative lack of impact of summative evaluation is not primarily due to any methodological shortcomings or the idiosyncrasies of some of the approaches that are used. Rather, the organisational and institutional context in which summative evaluation is commissioned, undertaken and received can impose contradictory demands and undermine the opportunity of learning from and applying the findings of evaluation.
Computer Simulation Modeling
Computer simulation as a research methodology is presented as the intersection of modeling, simulation, and computer analysis. Five component parts of simulation models are identified: input variables, output variables, assumptions, algorithms, and parameters. Computer simulation (CSM) has two primary uses for those interested in the study of organizations or who work within them: theory development and policy planning. The advantages and disadvantages of CSM for each of these purposes are examined and recent examples for each are explored.