Engaging policy audiences

Evidence-based policymaking in health systems is a myth

By 17/11/2016

By Devaki Nambiar, Research Scientist at the Public Health Foundation of India and a Member of the Social Science Approaches for Research and Engagement in Health Policy & Systems (SHAPES) and Translating Evidence into Action Thematic Working Groups of Health Systems Global.

Over the past several months, members of the Social Science Approaches for Research and Engagement in Health Policy & Systems (SHAPES) and Translating Evidence into Action Thematic Working Groups of Health Systems Global have scoured websites and interviewed a wide variety of practitioners to contribute to an inventory of knowledge translation initiatives linked to health systems.

There were many lessons to come from this exercise – which will be discussed at the upcoming Vancouver Symposium on Decoding Knowledge Translation: Initiatives, Institutions, and Perspectives on moving from knowledge to action and working across constituencies for policy/programme change.

Perhaps the most provocative of these was that evidence-based policymaking in health systems is a myth.

What is knowledge translation?

Obviously this was a revelation to us all. Isn’t evidence-based policymaking the central premise of knowledge translation? Not necessarily. Take the definition of knowledge translation arrived at during the 2013 Evidence to Policy Business Meeting of the Health Systems Research Symposium in Cape Town: ‘a situation where high quality, locally applicable synthesized research evidence, using the best available data informs, in the time available, action by elected officials, public servants, managers (including in NGOs), health workers, and patients/citizens (also donors, media and other intermediaries, including researchers)- systematically and transparently – in agenda setting, policy development, or implementation.’

The verb in the definition is “informs.” This states the not insignificant distinction made in the health systems domain (as opposed to the biomedical/clinical domain) – that evidence is not the base of, but rather informs decision-making.

To many of the individuals I spoke to in building up this inventory – hailing from Uganda to Canada, Lebanon to Thailand, evidence-based policymaking is both naïve and dystopian. It is naïve in that it disregards the many other considerations that invariably shape decisions related to health systems, including the products, politics and passions by an array of players. These players are far reaching, from the citizenry to politicians, bureaucrats to researchers. It is also dystopian because the assumption is that this multiple stakeholdership, this pluralism is somehow less desirable than a situation that privileges evidence and the producers and purveyors of evidence, i.e. us!

The ‘architects and engineers’ of knowledge translation

Knowledge translation begins where research endeavours are often at their most vague. Research often determines the magnitude or mechanisms underlying health system challenges and problems. It sometimes compares intervention approaches to each other. But the question is most often, what ought to be done in this case? This is precisely where evidence can inform, but cannot serve as a base. With this in mind, knowledge translation is about other processes, institutions, disciplines even, converging in the service of better informed decision-making.

As was revealed to me interview after interview, this means that knowledge translation must involve a host of players – “architects and engineers” as one key informant put it, but also communication specialists, policy insiders, advocates and a range of issue experts whose engagement with each other has to be culturally salient and institutionally viable. Major knowledge translation efforts at various scales – global like the Evidence Informed Policy Network (EVIPNet), regional, like the Regional East African Community Health policy initiative (REACH), or national, like Thailand’sHealth Intervention and Technology Assessment Programme (HITAP) – have fairly similar outputs and methods of engagement, but highly tailored, customised institutional structures taking this diversity into account.

The Knowledge 2 Policy Centre at the American University of Beirut, is a case in point. It is situated within an academic institution with a strong reputation and credibility. It has strong linkages to the McMaster Health Forum, also university affiliated, that has provided support and leadership for the EVIPNet consortium. Elsewhere, say Burkina Faso or Mongolia, similar initiatives have been based out of Ministries of Health. In Brazil, the Piripiri Evidence Centre was established by legal decree in 2010 at the subnational – municipal level. In yet other cases, such institutions operate autonomously – either with board membership of state Ministries of Health, as in the case of the European Observatory on Health Systems and Policies. Distinct and variegated as their institutional structures may be these institutions are very highly networked – with each other, but also with necessary stakeholders relevant to the scope of their work.

Impact: a slow trickle, not a revolution

The range of products for getting knowledge across to different audiences is as extensive as it is common across these institutions. These generally include policy or evidence briefs, summaries and notes, policy dialogues, outputs from rapid response services… and so on. However, when it comes to impact, “it’s a slow trickle, not a revolution.” It may not come as a surprise, but establishing networks, and remaining engaged with users of the research is what works.

What struck me, however, was that even this slow trickle takes place in a very specific context. It has to be set in an enabling environment that allows continuous advocacy. And the level of impact can vary or change over time. Nothing is set.

One informant described the four Ts essential to knowledge translation:

  • Translation involving the use of language employed by policymakers (instead of research jargon)

  • Tailoring – customising information based on specific questions policymakers may have or are focused on

  • Trust – which knowledge translation practitioners have to painstakingly maintain – in the process trading the goal of evidence-based policymaking for evidence-informed policymaking

  • Timeliness – understanding that policymakers are not always receptive and that the time has to be right for knowledge translation to hold meaning and advance an agenda.

Falling in love with an idea?

Across this broad range of topics on health systems, one interviewee argued that the process of knowledge translation is a constant negotiation, a dance whose moves keep changing. Where another interviewee explained: ’you need people to fall in love with the idea of evidence in policymaking.’

How do you make someone fall in love? Clearly – basing that process in evidence is inadequate!

We have concluded that there is both science and art, evidence and anecdote, strategy and serendipity involved in knowledge translation.

Provoked? Doubtful? Hopeful? Incensed?

Come tell us in Vancouver!

This blog was originally posted on the Health Systems Global blog roll in August 2016.