Assessing the impact of research on society, economy and culture in the Humanities and Social sciences: a case study on a UK university campus
Keywords:Valutazione, Impatto sociale della ricerca, REF, Studio di caso, Scienze sociali ed umane
AbstractThe aim of this paper is to describe the impact of research on society, economy and culture in the Humanities and Social sciences. In the first part of the paper, we describe the principal characteristics of the evaluation of research impact in the United Kingdom (UK), with a special focus on the new national exercise of research evaluation: the ‘Research Excellence Framework’ (REF2014). In the second part of the paper we present a case study in a British university campus where good practices of impact evaluation have been recently introduced. The main results of this study show that impact evaluation of Social sciences and Humanities research is a today’s key challenge for the academia, especially due to the difficulty in identifying the appropriate indicators for research impact measurement. Finally, we present the main themes of the current debate about the evaluation of the impacts in different fields of research
Albercrombie, Nicholas, Hill Stephen, Turner Bryan (1984) The penguin dictionary of sociology, London: Penguin books.
Baccini, Alberto (2010) Valutare la ricerca scientifica. Uso e abuso degli indicatori bibliometrici, Bologna, Il Mulino.
Bornmann, Lutz (2013a) What is societal impact of research and how can it be assessed? A literature survey. Journal of the American Society of Information Science and Technology, 64(2), 217–233.
Bornmann, Lutz, Marx, Werner(2013b). ‘How should the societal impact of research be generated and measured? A proposal for a simple and practicable approach to allow interdisciplinary comparisons’, Scientometrics, 98, 211–219.
Donovan, Claire (2008) ‘The Australian Research Quality Framework: A live experiment in capturing the social, economic, environmental, and cultural returns of publicly funded research’, New Directions for Evaluation, 118, 47–60.
Donovan, Claire (2011) ‘State of the art in assessing research impact: introduction to a special issue’. Research Evaluation, 20(3), 175-179.
Donovan, Claire, Hanney, Stephen (2011) ‘The ‘Payback Framework’ explained’. Research Evaluation,, 20(3), 181-183.
Duncan, Sophie, Spicer, Suzanne (2010), The engaging researcher. Careers Research and Advisory Centre (CRAC), Estratto il 21.11.2011 da http://www.bris.ac.uk/researchstaff/yourcareer/vitae-booklets/engaging-researcher.pdf
European Commission (2010), Interim evaluation of the seventh framework programme, report of the expert group, Estratto il 21.01.2015 da: http://ec.europa.eu/research/evaluations/pdf/archive/other_reports_studies_and_documents/fp7_interim_evaluation_expert_group_report.pdf#view=fit&pagemode=none
Gibbons, Michael, Limoges, Camille, Nowotny, Helga, Schwartzmann, Simon, Scott, Peter, Trow, Martin (1994), The New Production of Knowledge. The Dynamics of Science and Research in Contemporary Societies. London: Sage.
Higher Education Funding College of England (HEFCE) (2006) Beacons for Public Engagement: Invitation to apply for funds. Estratto il 15/01/15 da: http://webarchive.nationalarchives.gov.uk/20100202100434/http://www.hefce.ac.uk/pubs/hefce/2006/06_49/06_49.pdf
Higher Education Funding College of England (HEFCE) (2011), Ref 2014. Assessment Framework, guidance on submissions, Estratto il 21.11.2011 da http://www.hefce.ac.uk/research/ref/pubs/2011/03_11/
Higher Education Funding College of England (HEFCE) (2011), Ref 2014. Consultation on draft panel criteria and working methods, Estratto il 21.11.2011 da http://www.hefce.ac.uk/research/ref/pubs/2011/03_11/
Higher Education Funding College of England (HEFCE) (2011), Ref 2014. Consultation on draft panel criteria and working methods. Part 2D: Draft statement of Main Panel D. Estratto il 21.11.2011 da http://www.hefce.ac.uk/research/ref/pubs/2011/03_11/
Holbrook, J,.Britt., Frodeman, Robert (2011) ‘Peer review and the ex ante assessment of societal impacts’. Research Evaluation, 20(3), 239–246.
Lipsett, Anthea (2011) ‘Universities braced for heavier research burden’. 01.03.2011 Estratto il 21.11.2011 da http://www.guardian.co.uk/education/2011/mar/01/research-excellence-framework-academics.
Kearnes, Matthew, Wienroth, Matthias (2011) ‘Tools of the Trade: UK Research Intermediaries and the Politics of Impacts’. Minerva, 49, 53–174.
London Mathematical Society (2011) Impact in Mathematical Science in REF 2014. Estratto il 07.12.2011 da: http://www.lms.ac.uk/sites/default/files/Mathematics/policy_responses/RPCimpact8.pdf
Martin, Ben, R. (2007) Assessing the impact of basic research on society and the economy. Paper presented at the Rethinking the impact of basic research on society and the economy (WF-EST International Conference, 11 May 2007), Vienna, Austria.
Martin, Ben, R.(2011) ‘The Research Excellence Framework and the ‘impact agenda’: Are we creating a Frankenstein monster?’ Research Evaluation, 20(3), 247–254.
Mintzberg, Henry (2011) La progettazione dell’organizzazione aziendale. Bologna. Il Mulino.
Morris, Zoë, Slote, Wooding, Steven, Grant, Jonathan (2011) ‘The answer is 17 years, what is the question: understanding time lags in translational research’ Journal of the Royal Society of Medicine, 104(12) 510–520.
Oswald, Andrew (2009) ‘REF should stay out of the game’. The Indipendent 26.11.2009. Estratto il 24-11-2011 da http://www.independent.co.uk/news/education/higher/andrew-oswald-ref-should-stay-out-of-the-game-1827306.html
Public Policy Group, LSE (2011) Maximizing the impacts of your research: a handbook for social scientists. London School of Economics and Political Science, London, UK. Estratto il 24-11-2011 da http://eprints.lse.ac.uk/35758/1/Handbook_PDF_for_the_LSE_impact_blog_April_2011.pdf
RAND, Corporation. Capturing research impacts, a review of international practice (2010). Estratto il 07.12.2011 da http://www.rand.org/pubs/documented_briefings/DB578.html:
Scott, Anna (2013), ‘Impact evaluation: which way forward?’ The guardian 10.05.2013. Estratto il 18.01.2015 da: http://www.theguardian.com/global-development-professionals-network/2013/may/10/impact-evaluation-guidance
Shepherd, Jessica (2009) ‘Humanities research threatened by demands for 'economic impact'. The guardian 13.10.2009. Estratto il 24-11-2011 da http://www.guardian.co.uk/education/2009/oct/13/research-funding-economic-impact-humanities
Simons, Judy (2010) ‘REF Pilot: humanities impact is evident and can be measured’. Times Higher Education, 11.11.2010. Estratto il 21.11.2011 da http://www.timeshighereducation.co.uk/story.asp?storycode=414173.
Social Policy Association (2010) Piloting the Assessment of Research Impact in Social Policy and Social Work, Estratto il 21.11.2011 da http://www.social-policy.org.uk/downloads/REF%20impact%20pilot.pdf.
University of Exeter (2010), Research Knowledge & Transfer (RKT). Making an impact together, Estratto il 21.11.2011 da http://www.exeter.ac.uk/media/universityofexeter/researchandknowledgetransfer/generalpdfs/RKT_Annual_Report_09.pdf
Yin, Robert, K.(2003), Case studies research. Design and methods, Thousand Oaks, California: Sage Publications.
LicenseAuthors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).