There is increasing pressure from science policy-makers and funders to evaluate the societal impact that research activities create, related to pressures these policy makers themselves are under to justify the resources they receive. Evaluating the impact of research is therefore regarded as being an important mechanism to demonstrate, but impact as a phenomenon is something that researchers themselves are not always well-positioned to create or report. Spain has recently introduced an individual knowledge transfer activity evaluation, where each researcher is compelled to submit details of five individual transfer activities in the preceding six year period (the sexenio).
The aim of this STSM is to create a more comprehensive definition of evidence that corroborates impact created that can be used in evaluation systems to reduce burden and maximise the breadth of activities covered. In this STSM we explore what are the antecedent conditions to creating impact focusing on transfer activities that take place through publication activities including both popular science/ engagement but also producing professional materials (e.g guidelines). This activity is led by Elena Castro Martínez (INGENIO, Spain) supported by Julia Olmos Peñuela (University of Valencia, Spain), Paul Benneworth (Høgskulen på Vestlandet, Norway) and Elea Giménez Toledo (ILIA, Spain).
Objectives:
The STSM aims to create a set of guidelines to assist evaluators in evaluating the potential for activities and outcomes to produce eventual impact, strongly rooted in a conceptual understanding of the creation of research impact. The STSM seeks to support policy-makers to better stimulate the contributions that SSH research makes in society, and to stimulate the flow of that knowledge to society at large (WG2 task 3). The Guidelines represent a clear set of measures for valuing SSH (Task 5), by ensuring that SSH research that is better committed to creating societal impact is funded. By undertaking the work in the context of a new evaluation system (the sexenio), and creating a concrete set of guidelines of use to policy-makers for evaluating impact, the STSM contributes to the overall goals of the Action to create policy impact.
We undertake a small scoping study of c. ten SSH researchers in Spain to explore the ways in which they create a credibility trail through their efforts in conducting transfer activities around two transfer activities, books targeted at professionals and guidelines/ protocols for professional practice, from the idea generation to the dissemination and publicity activities. We identify the researchers characteristics (behaviours and practices) are associated with credible impact creation process, and provide a first typology of the forms of evidence that could be used to corroborate a broad reading of impact. This typology provides the basis for us to refine our overall framework, and also to improve guidance provided to evaluators in ensuring that broader perspectives to evaluating research impact are taken.
Special criteria for this STSM:
The applicant should have a broad knowledge of science studies and scientific evaluation processes, ideally with some knowledge about ex ante evaluation of research proposals (either academic or practical). The candidate must be capable of undertaking the research tasks required for this project in an independent manner, including carrying out background research (websites, policy reports), interviewing and qualitative data analysis.
Because much of the data for this work is only available in Spanish, the applicant must be competent in reading and speaking Spanish.
Results: The proposed STSM will provide guidelines assist evaluators in evaluating the potential for activities and outcomes to produce eventual impact, strongly rooted in a conceptual understanding of the creation of research impact. As far as possible, the guidelines will be formulated in such a way that they may be used as a conceptual framework for ex post evaluation of societal impact in research proposals more generally, not limited to projects within SSH.
Practical details:
Working group: WG2 (Societal impact and relevance of SSH Research).
Duration and timing: between 2 weeks and 2 months from 23th October to 2019 to 30th January 2020.
Because of the volume of work necessary to complete this task, preference will be given to candidates seeking longer rather than shorter placements.
Location: CSIC INGENIO, Valencia, Spain.
Contact: Elena Castro Martínez (ecastrom@ingenio.upv.es)