optional stopping

Authors: Shigeto Kawahara
Cited by: 0

Abstract

Does AI stop optional stopping? This is a fifth experiment of my general research program, which empirically explores how current generative AI systems behave with respect to research ethics. This time, I addressed the question of whether three major AI systems (Claude, ChatGPT, Gemini) respond to a request to optional stopping. Given a series of data, do the AIs keep running a test until it finds significance? I observed three types of behaviors: outright denial, execution with warning, execution without warning. Out of ten trials, Claude denied four times and executed without warning six times; ChatGPT denied once and executed with warning nine times; Gemini executed ten times, providing warnings in seven trials. The overall results demonstrate that the AI safeguard systems are stochastic. And importantly, there are cases, at least for Claude and Gemini, when users get outputs of iterative t-tests without warning.

Fields of Study & Subjects

Ethics and Social Impacts of AI Academic integrity and plagiarism Artificial Intelligence in Healthcare and Education

Publication details

Journal / source
OSF Preprints (OSF Preprints)
Publication date
10 February 2026
Language
EN
Document type
Preprint