Data-Driven R&D&I Management for Societal Impacts: Introduction and Application of AgroRadarEval

Daniela Maciel; Adriana Bin; Marie Ferré; James A Turner; Geraldo Stachetti Rodrigues; María Magdalena Costa; Miguel Sierra Pereiro; Juan Mechelk; Aurelle de Romemont; Kevin Heaune

doi:10.4067/S0718-27242024000400089

Authors

Daniela Maciel Embrapa Territorial & Scientific and Technological Policy (PPG-PCT), University of Campinas, Brazil.
Adriana Bin School of Applied Sciences, University of Campinas
Marie Ferré French Agricultural Research Centre for International Development (Cirad)
James A Turner Ethical Agriculture, AgResearch Ltd.
Geraldo Stachetti Rodrigues Embrapa Meio Ambiente
María Magdalena Costa Instituto Nacional de Investigación Agropecuaria (INIA)
Miguel Sierra Pereiro Instituto Nacional de Investigación Agropecuaria (INIA)
Juan Mechelk Instituto Nacional de Investigación Agropecuaria (INIA)
Aurelle de Romemont French Agricultural Research Centre for International Development (Cirad)
Kevin Heaune Evaluation Unit, Teagasc Mellows Campus

DOI:

https://doi.org/10.4067/S0718-27242024000400089

Keywords:

Use of evaluations results, Agricultural R&D management, Research Impact, Organizational management, Impact Assessment.

Abstract

Recognizing evaluation results as a crucial source of information to support RD&I management, this article introduces 'AgroRadarEval’, an interactive tool aimed at fulfilling theoretical, conceptual, and practical gaps concerning the systematization of the use of evaluation results in agricultural RD&I. Aligned with the principles of Responsible Research and Innovation (RRI) and Responsible Research Assessment (RRA), AgroRadarEval aims to support leaders and managers of RD&I in reflecting on the strengths and weaknesses of organizational capacities, culture, collaborations, processes, and communications that underlie the use of evaluation results in agricultural RD&I. AgroRadarEval is built along three support pillars: Evaluation Capacity Building, Impact-Oriented Evaluation Culture, and Reflective Learning, and is operationalized through eight interconnected dimensions: 1. participation and collaboration, 2. skills development, 3. promotion of an evaluation culture, 4. continuous feedback and adaptation, 5. integration with strategic planning, 6. monitoring, 7. influences of the external environment, and 8. communication. This study describes the development of the tool, its characteristics, illustrating its application in an agricultural RD&I organization. The study is targeted at leaders and managers of agricultural RD&I, evaluators, and researchers interested in research evaluation and enhancing the impact of RD&I.

Downloads

Download data is not yet available.

Author Biographies

Adriana Bin, School of Applied Sciences, University of Campinas

Associate professor at the School of Applied Sciences at the University of Campinas (FCA/UNICAMP) in the field of management. Full professor in the Graduate Programs in Management and in Science and Technology Policy (DPCT/IG/UNICAMP), collaborator in the Interdisciplinary Master's in Human and Social Sciences (FCA/UNICAMP), and associate coordinator of the Laboratory for Studies on Research and Innovation Organization (Lab-GEOPI). Engaged in research and extension projects in planning and management, evaluation, and foresight in science, technology, and innovation.

Marie Ferré, French Agricultural Research Centre for International Development (Cirad)

Agricultural and environmental economist by background. My research interests include factors driving behavioural change with regard to ecosystem management; impact from research and its evaluation, socio-economic analysis of catchment solutions, peatlands, agricultural interventions

James A Turner, Ethical Agriculture, AgResearch Ltd.

James is a social scientist with 30 years research experience in the New Zealand forestry and agricultural sectors. James is passionate about community-led innovation to tackle the complex and interconnected challenges facing rural communities. Working in an agricultural research organisation, his research focuses on innovation processes and systems, including monitoring and evaluation and co-innovation, to enable community-led innovation.

Geraldo Stachetti Rodrigues, Embrapa Meio Ambiente

Received his B.Sc. in Ecology at Universidade Estadual Paulista (UNESP, Rio Claro, Brazil) in 1982 and the M.Sc. in 1986, when he joined the environmental research unit of the Brazilian Agricultural Research Agency (Embrapa). He earned his Ph.D. in Ecology and Evolutionary Biology from Cornell University (Ithaca, NY, USA) in 1995, focusing his research on environmental toxicology and impacts of pesticide use. Following a sabbatical leave at the Center for Environmental Policy of the University of Florida (Gainesville, USA) in 2001, he served as Head of Research and Development at Embrapa Environment (2002-2005) and as coordinating researcher on ‘Sustainable Agriculture and the Environment’, at Embrapa Labex Europe in Montpellier, France (2007-2009). He currently dedicates himself to impact assessments for the environmental management of rural activities.

María Magdalena Costa, Instituto Nacional de Investigación Agropecuaria (INIA)

Assistant Technician in Management at INIA Uruguay, supporting the organization and administration of agricultural RD&I. Responsibilities include strategic planning, resource coordination, and ensuring efficient farm operations. Has a background in business management and strong skills in planning and teamwork.

Miguel Sierra Pereiro, Instituto Nacional de Investigación Agropecuaria (INIA)

Currently the Director of Corporate Relations and Innovation and Communication Manager of INIA Uruguay. I was president of CONICYT of Uruguay between 2018 and 2021. I participate in the Strings Project and in a project on Impact Evaluation with other agricultural research institutes such as AgResearch of New Zealand, Teagasc of Ireland, and Irta of Catalonia.

Juan Mechelk, Instituto Nacional de Investigación Agropecuaria (INIA)

Highly committed professional with expertise in generating and applying scientific and technological knowledge to solve problems, contributing not only to academic and professional interests but also to the sustainable development of any country. Extensive experience in managing research, development, and innovation projects across various disciplines in nationally and internationally relevant institutions. Active involvement in research activities related to science, technology, and innovation (STI) policy at the University of the Republic.

Aurelle de Romemont, French Agricultural Research Centre for International Development (Cirad)

An agronomist by training, Aurelle first worked for several years designing, implementing and evaluating rural development projects in international cooperation in various structures (NGOs, donors) in Latin America, South-East Asia and West Africa. From 2010 to 2014, she completed a PhD thesis in management sciences at CIRAD's UMR Innovation, co-funded by AFD, on evaluating the impact of an agricultural management consultancy approach in Benin. From 2014 to 2018, she worked at the interface between research and development on project management, feasibility studies, project and impact evaluations and training engineering (as a consultant, project officer for the FAR International network, research and financial education officer in a microfinance structure and teaching engineer for the MOQUAS master's degree (IRC SupAgro)).

Kevin Heaune, Evaluation Unit, Teagasc Mellows Campus

An economist by training, Kevin is Teagasc's Senior Evaluation Officer where he designs, manages and implements evaluations of Teagasc’s research, advisory, and education programmes. He also leads the development of evaluation strategies, tools, and research on capacity building in Teagasc. Previously, he led research programmes on agricultural innovation systems and knowledge transfer. He has extensive experience in rural development, innovation policy, and has secured significant funding for research and local projects. Kevin also holds leadership roles in rural community development organizations and adjunct positions in Irish universities.