Evaluating strengths, limitations, and future directions of ChatGPT in psychological analysis within case conceptualization: A qualitative analysis
Abstract
This exploratory qualitative study investigates ChatGPT-4’s capacity to apply the LIBETcase formulation model by analyzing its feedback on anonymized interview transcripts. The study aimed to assess whether ChatGPT-4’s outputs reflectedaccurate identification and interpretation of two key psychological constructs—lifethemes and semi-adaptive plans—while adhering to theoretical principles, and toexplore recurring errors and limitations in its clinical reasoning. Ten non-clinicalparticipants underwent semi-structured interviews, and a custom-configured versionof ChatGPT-4 was provided with structured instructions and theoretical material.Reflexive thematic analysis revealed four overarching themes: (1) limitations inabstraction and interpretative barriers, (2) consistent structure and contentorganization, (3) hypothesis-driven reasoning with cautious language, and (4) partialadherence to LIBET theory through appropriate terminology. While ChatGPT’sstructured reasoning and alignment with theoretical vocabulary suggest its potentialas a reflective support tool—particularly in training or supervision—it also showeddifficulties in distinguishing emotional vulnerabilities from coping strategies, and ininterpreting abstract, relational constructs such as life themes. Findings support theimportance of improving prompt design, expanding training on psychologicalconstructs, and developing rigorous validation pipelines. Future research shouldaddress these limitations before deploying LLMs as assistive tools in clinical reasoningand decision-making.
Fields of Study & Subjects
Artificial Intelligence in Healthcare and Education
Digital Mental Health Interventions
Clinical Reasoning and Diagnostic Skills
Publication details
- Journal / source
- Cyberpsychology Journal of Psychosocial Research on Cyberspace
- Publisher
- Masaryk University Press
- Volume
- 20
- Issue
- 1
- Publication date
- 28 January 2026