Fragile Evidence for an Ideological Bias in the Production of Research Findings: Comment on Borjas and Breznau
Abstract
Borjas and Breznau ("Ideological bias in the production of research findings." Science Advances 12, eadz7173 (2026); hereafter referred to as B&B) recently reported that researchers' ideology influences their empirical findings. Although we were able to reproduce B&B's numerical results, our reanalysis shows that the reported association is not robust. Specifically, the association hinges on a coding error. Data from four teams that contradict the ideology hypothesis were excluded from the analysis due to idiosyncratic variable coding. Correcting this error renders the ideology effect no longer statistically significant. Also, B&B employed a different outcome variable and weighting scheme to that used in a previous paper based on the same data. These two analytical decisions further contribute to the observed ideology effect. Correcting the coding error or using the same specification as in the previous paper renders the ideology effect indistinguishable from zero. Therefore, we conclude that B&B do not provide robust evidence of ideological bias in this context. Instead, the reported association appears to be a statistical artefact resulting from questionable modelling decisions.
Fields of Study & Subjects
Meta-analysis and systematic reviews
Advanced Causal Inference Techniques
Reliability and Agreement in Measurement
Publication details
- Publisher
- Center for Open Science
- Publication date
- 20 April 2026
- Language
- EN
- Document type
- Preprint