Explainable Artificial Intelligence in Conceptual Design: An Large Language Model–Powered Framework to Enhance Originality and Credibility

Read full text Summarise with VIRAT
Authors: Iván Felipe Velasco Medina, Tamotsu MURAKAMI
Cited by: 0
References: 65

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Abstract Recent advances in large language models (LLMs) offer new opportunities for conceptual design, but their opaque reasoning often limits their adoption as active design agents. Explainable artificial intelligence (XAI), defined as techniques that make artificial intelligence (AI) reasoning understandable to humans, provides a path to integrate these models into engineering design workflows with greater transparency and trust. In this article, we explore the role of explainability mechanisms in conceptual design by introducing an XAI-based design framework structured around divergence and convergence cycles. To this end, LLMs generate and evaluate design solutions, while explainability mechanisms allow designers to visualize concept relationships and clarify model recommendations. The framework’s effectiveness is tested through a controlled user study with 88 design engineering participants across three groups: GPT-4 without explanations (n=39), XAI-enhanced framework (n=39), and raters (n=10). Participants from the first two groups addressed one of three realistic design challenges and produced conceptual solutions, while evaluators from the third group rated the answers on key design metrics: usefulness, feasibility, originality, and credibility. Data were analyzed using linear mixed-effects models to ensure robustness, whereas pairwise comparisons and simulation-based power analyses were used to control type I and type II errors, respectively. Results show that XAI significantly improves the originality and credibility of AI-assisted design outputs, while no differences were found in the usefulness and feasibility metrics. These results provide rigorous evidence that explainability enhances human–AI collaboration for conceptual design.

Fields of Study & Subjects

Explainable Artificial Intelligence (XAI) Design Education and Practice Artificial Intelligence Applications

Publication details

Journal / source
Journal of Mechanical Design
Volume
148
Issue
10
Publication date
30 March 2026
Language
EN