Ten Principles for Crowdsourcing Human Behavior Online

Human behavioral research increasingly depends on online crowdsourcing. There are many advantages to doing so, including parallel recruitment of participants, access to more diverse samples, and the possibility of large-scale data collection. However, these advantages come at the cost of full experimental control, a daunting tradeoff for many researchers. To address common challenges in crowdsourced research, we outline ten principles to guide the design and execution of rigorous, reliable experiments, empowering researchers to harness the full potential of this approach.