Critical Thinking in AI-Assisted Deontologically-Governed Professional Decision-Making: When and How Explainability, Reliability, and Transparency Matter
Abstract
Critical thinking is a central safeguard for responsibility and accountability in deontologically-governed professions. Artificial intelligence (AI)-assisted decision-making is increasingly being integrated within these professional workflows. However, AI introduces autonomy, learning, and inscrutability, disrupting critical, reflective, decision-making processes. Given these challenges, this research systematically unpacks how embedding explainability, reliability, and transparency into AI fosters critical thinking. Employing a multi-method approach combining cognitive neuroscience, behavioral and self-report measures, we conducted three experiments with practicing professionals tasked with realistic AI-assisted scenarios. Experiment 1 assessed varying levels of AI-generated reconstructive causal explanations under consistent reliability, Experiment 2 introduced variable reliability. Experiment 3 added transparency through model confidence scores. Results reveal that minimal reconstructive explanations enhance analytical reasoning under reliable conditions, while epistemic uncertainty drives critical engagement when reliability varies. Transparency offers limited restoration of explainability benefits. These findings suggest AI reliability primarily drives critical thinking, informing AI design that preserves professional responsibility and accountability.
Fields of Study & Subjects
Explainable Artificial Intelligence (XAI)
Ethics and Social Impacts of AI
Decision-Making and Behavioral Economics
Publication details
- Journal / source
- Information Systems Frontiers
- Publisher
- Springer Science and Business Media LLC
- Publication date
- 23 February 2026
- Language
- EN