Assessing the impact of research on society, economy and culture in the Humanities and Social sciences: a case study on a UK university campus




Valutazione, Impatto sociale della ricerca, REF, Studio di caso, Scienze sociali ed umane


The  aim  of  this  paper  is  to  describe  the  impact  of  research  on  society,  economy  and culture in the Humanities and Social sciences. In the first part of the paper, we describe the principal characteristics  of  the  evaluation  of  research  impact  in  the  United  Kingdom  (UK),  with  a  special focus on the new national exercise of research evaluation: the ‘Research Excellence Framework’ (REF2014). In the second part of the paper we present a case study in a British university campus where good practices of impact evaluation have been recently introduced. The main results of this study show that impact evaluation of Social sciences and Humanities research is a today’s key challenge  for  the  academia,  especially  due  to the  difficulty  in  identifying  the  appropriate  indicators for research impact measurement. Finally, we present the main themes of the current debate about the evaluation of the impacts in different fields of research

Author Biography

Maria Cristina Matteucci, University of Bologna

Dipartimento di Psicologia


Albercrombie, Nicholas, Hill Stephen, Turner Bryan (1984) The penguin dictionary of sociology, London: Penguin books.

Baccini, Alberto (2010) Valutare la ricerca scientifica. Uso e abuso degli indicatori bibliometrici, Bologna, Il Mulino.

Bornmann, Lutz (2013a) What is societal impact of research and how can it be assessed? A literature survey. Journal of the American Society of Information Science and Technology, 64(2), 217–233.

Bornmann, Lutz, Marx, Werner(2013b). ‘How should the societal impact of research be generated and measured? A proposal for a simple and practicable approach to allow interdisciplinary comparisons’, Scientometrics, 98, 211–219.

Donovan, Claire (2008) ‘The Australian Research Quality Framework: A live experiment in capturing the social, economic, environmental, and cultural returns of publicly funded research’, New Directions for Evaluation, 118, 47–60.

Donovan, Claire (2011) ‘State of the art in assessing research impact: introduction to a special issue’. Research Evaluation, 20(3), 175-179.

Donovan, Claire, Hanney, Stephen (2011) ‘The ‘Payback Framework’ explained’. Research Evaluation,, 20(3), 181-183.

Duncan, Sophie, Spicer, Suzanne (2010), The engaging researcher. Careers Research and Advisory Centre (CRAC), Estratto il 21.11.2011 da

European Commission (2010), Interim evaluation of the seventh framework programme, report of the expert group, Estratto il 21.01.2015 da:

Gibbons, Michael, Limoges, Camille, Nowotny, Helga, Schwartzmann, Simon, Scott, Peter, Trow, Martin (1994), The New Production of Knowledge. The Dynamics of Science and Research in Contemporary Societies. London: Sage.

Higher Education Funding College of England (HEFCE) (2006) Beacons for Public Engagement: Invitation to apply for funds. Estratto il 15/01/15 da:

Higher Education Funding College of England (HEFCE) (2011), Ref 2014. Assessment Framework, guidance on submissions, Estratto il 21.11.2011 da

Higher Education Funding College of England (HEFCE) (2011), Ref 2014. Consultation on draft panel criteria and working methods, Estratto il 21.11.2011 da

Higher Education Funding College of England (HEFCE) (2011), Ref 2014. Consultation on draft panel criteria and working methods. Part 2D: Draft statement of Main Panel D. Estratto il 21.11.2011 da

Holbrook, J,.Britt., Frodeman, Robert (2011) ‘Peer review and the ex ante assessment of societal impacts’. Research Evaluation, 20(3), 239–246.

Lipsett, Anthea (2011) ‘Universities braced for heavier research burden’. 01.03.2011 Estratto il 21.11.2011 da

Kearnes, Matthew, Wienroth, Matthias (2011) ‘Tools of the Trade: UK Research Intermediaries and the Politics of Impacts’. Minerva, 49, 53–174.

London Mathematical Society (2011) Impact in Mathematical Science in REF 2014. Estratto il 07.12.2011 da:

Martin, Ben, R. (2007) Assessing the impact of basic research on society and the economy. Paper presented at the Rethinking the impact of basic research on society and the economy (WF-EST International Conference, 11 May 2007), Vienna, Austria.

Martin, Ben, R.(2011) ‘The Research Excellence Framework and the ‘impact agenda’: Are we creating a Frankenstein monster?’ Research Evaluation, 20(3), 247–254.

Mintzberg, Henry (2011) La progettazione dell’organizzazione aziendale. Bologna. Il Mulino.

Morris, Zoë, Slote, Wooding, Steven, Grant, Jonathan (2011) ‘The answer is 17 years, what is the question: understanding time lags in translational research’ Journal of the Royal Society of Medicine, 104(12) 510–520.

Oswald, Andrew (2009) ‘REF should stay out of the game’. The Indipendent 26.11.2009. Estratto il 24-11-2011 da

Public Policy Group, LSE (2011) Maximizing the impacts of your research: a handbook for social scientists. London School of Economics and Political Science, London, UK. Estratto il 24-11-2011 da

RAND, Corporation. Capturing research impacts, a review of international practice (2010). Estratto il 07.12.2011 da

Scott, Anna (2013), ‘Impact evaluation: which way forward?’ The guardian 10.05.2013. Estratto il 18.01.2015 da:

Shepherd, Jessica (2009) ‘Humanities research threatened by demands for 'economic impact'. The guardian 13.10.2009. Estratto il 24-11-2011 da

Simons, Judy (2010) ‘REF Pilot: humanities impact is evident and can be measured’. Times Higher Education, 11.11.2010. Estratto il 21.11.2011 da

Social Policy Association (2010) Piloting the Assessment of Research Impact in Social Policy and Social Work, Estratto il 21.11.2011 da

University of Exeter (2010), Research Knowledge & Transfer (RKT). Making an impact together, Estratto il 21.11.2011 da

Yin, Robert, K.(2003), Case studies research. Design and methods, Thousand Oaks, California: Sage Publications.





Note & Documentazione/Notes & Documents