Evaluation, politics & advocacy

No previous manifestation of cultural policy, particularly UK cultural policy, has been so resolute about the importance of outcomes and accountability. Funders in both the private and public sectors now look for what difference - or impact - projects and organisations as a whole are making, and they expect evaluations to evidence effective project delivery and the meeting of organisational goals.

However 'evidence' will also be called upon to play a role of justification and persuasion in the development of policy/programmes; which often explains the political use of evaluation/research results (and by players from all sides) for advocacy purposes. Also, it is presumed that the impact of particular problems can be identified and captured by quantitative and/or qualitative research. But, this is not necessarily so.

In this module you will critically examine the context within which impact, evaluation and monitoring form different perspectives. The module also explores the design and specification of impact assessments and evaluation and any relevant methodological issues as well as the constructive use of the results of evaluation.

Indicative content

• Introduction to the political context: accountability, evidence, policy drivers, instrumentalism
• Current practice: critiquing examples of monitoring, evaluation, impact reports
• and their political constructions
• The learning organisation: monitoring, evaluation, impact - opportunities and approaches
• Funding and policy bodies: central and regional/local government; funders; regeneration bodies etc
• Monitoring systems: desk studies and management use
• Evaluation and impact assessment techniques: comparison and practical exercises
• Assessing impact: designing research projects; demonstrating impact: findings, evidence and validity issues.
  
  

Recommended reading

• Belfiore, E. and Bennett, O. (2007).'Rethinking the social impacts of the arts International'. Journal of Cultural Policy 13.2: pp.135-151
• Clarke, A. (1999). Evaluation research: an introduction to principles, methods and practice. London, Sage
• Matarasso, F (1997). Use or Ornament: The Social Impact of Participation in the Arts. Stroud, Comedia. Available from: http://www.comedia.org.uk/
• Majone, G. (1989). Evidence, argument, and persuasion in the policy process. New Haven, Yale University Press
• McLaughlin, K., Osborne, S. P. and Ferlie, E. (2002). The new public management: current trends and future prospects. London, Routledge
• Merli, P. (2004). 'Evaluating the social impact of participation in arts activities: A critical review of François Matarasso's Use or Ornament?' Variant, Vol. 19, Spring 2004. Available from: http://www.variant.org.uk/19texts/socinc19.html
• Nutley, S., Walter, I. and Davies, H. T. O. (2007). Using evidence. How research can inform public services. Bristol, Policy Press
• Parsons, W. (2001). Public policy. An introduction to the theory and practice of policy analysis. Cheltenham, Edward Elgar
• Reeves M. (2002). Measuring the economic and social impact of the arts. Research report 24. http://www.artscouncil.org.uk/media/uploads/documents/publications/340.pdf
• Selwood, S .1999. 'Access, Efficiency and Excellence: Measuring non-economic performance in the English subsidised cultural sector', Cultural Trends No 35, pp87-141
• Selwood S . 2004. 'The Politics of Data Collection: Gathering, analysing and using data in the subsidised cultural sector in England'. Cultural Trends, No 47, pp13-84.