This 63-page paper written by Ingie Hovland for the Overseas Development Institute (ODI) is all about how to monitor and evaluate (M&E) policy research. It is aimed at research programmes and institutions, rather than individual researchers.

Conventional academic research is usually evaluated using two approaches: academic peer review, and the number of citations in peer-reviewed publications. The paper argues that these are too limited to capture the broader aims of policy research, such as impact and change. 

Section two of this paper presents some examples on how to do M&E of policy research. These approaches are then divided into the following performance areas: (1) Strategy and direction; (2) Management; (3) Outputs; (4) Uptake; and (5) Outcomes and impacts.

For evaluating strategy and direction, the paper provides a survey of the following approaches and how to use them: Logframes; Social Network Analysis; Impact Pathways; and Modular Matrices.

In terms of evaluating management, the paper suggests: ‘Fit for Purpose’ reviews; ‘Lighter Touch’ Quality Audits; Horizontal Evaluation; and Appreciative Inquiry.

For outputs, you can evaluate academic articles; policy and briefing papers; websites; networks; and ‘After Action’ reviews.

Some of the approaches that can be used to evaluate uptake include: Impact Logs; New Areas for Citation Analysis; and User Surveys.

Finally, some approaches to evaluating outcomes and impact are: Outcome Mapping, RAPID Outcome Assessment; Most significant Change; Innovation Stories; and Episode Studies.

Section three of this paper is also important, because it details some concerns to bear in mind when conducting institutional evaluations, instead of individual programmes. For instance, having to think about how to assess an organisation’s accountability, leadership, administration, human resources and finance systems.

The paper concludes with some best practice checklists on how to design an M&E approach for a policy reseach project, programme or institution. It is important to remember that one size does not fit all when it comes to evaluating policy research.

Overall, this paper by the ODI can be a useful guideline for monitoring and evaluating  policy research in a way that fits the intentions of the research programme.

This article is part of our initiative, R2A Impact Practitioners. To find out more, please click here.