Beyond internal validity: Towards a broader understanding of credibility in development policy research

We provide evidence from the Transfer Project to show that methodological design is only one factor in determining credibility in the eyes of policymakers. Policymakers understand concerns around internal validity, but also value collaborative research engagement, which builds trust, allows co-creation of research questions, informs operations throughout the evaluation period and leverages national research expertise. Further, the mere act of engaging in a large-scale, transparent impact evaluation, across quasi- and experimental designs can change the culture of decision-making within an agency, leading to better policy choices in the long run. We advocate for a more inclusive approach to policy research that begins with identifying the most relevant research question and fitting the methods to the question rather than vice-versa. We challenge the field to engage more closely with policymakers to identify their evidence needs in order to prioritize the end objective of improving the lives of the poor—regardless of methodological design choices.