Is research in social psychology politically biased? Systematic empirical tests and a forecasting survey to address the controversy

The present investigation provides the first systematic empirical tests for the role of politics in academic research. In a large sample of scientific abstracts from the field of social psychology, we find both evaluative differences, such that conservatives are described more negatively than liberals, and explanatory differences, such that conservatism is more likely to be the focus of explanation than liberalism. In light of the ongoing debate about politicized science, a forecasting survey permitted scientists to state a priori empirical predictions about the results, and then change their beliefs in light of the evidence. Participating scientists accurately predicted the direction of both the evaluative and explanatory differences, but at the same time significantly overestimated both effect sizes. Scientists also updated their broader beliefs about political bias in response to the empirical results, providing a model for addressing divisive scientific controversies across fields. •In scientific abstracts, conservatives are described more negatively than liberals.•In research abstracts, conservatism is also more often explained than liberalism.•In a forecasting survey, scientists overestimated both effects.•Forecasters updated their beliefs about politics in science in light of the results.