A Detection Method for Text Input-Induced Non-Crashing Functional Bugs in Mobile GUI Testing

View at publisher
Authors: Qijun Liang, Chuanyu Li, Fengyu Yang, Qionglong Xu
Cited by: 1
References: 38

Abstract

In mobile GUI testing, non-crashing functional bugs (NCFBs) induced by text input can lead to severe problems such as data errors, logical confusion, and display anomalies. Existing detection methods mainly rely on predefined heuristic rules or specific test oracles, which are difficult to adapt to diverse bug types, resulting in limited detection scope and low efficiency. To systematically address this challenge, this paper proposes an automated testing method based on multimodal large language models (MLLMs). We first construct a three-stage interactive "generation-exploration-verification" automated testing framework: using LLMs to deeply understand the semantics and constraints of input components for generating abnormal inputs; planning test paths through knowledge base construction and retrieval-augmented generation (RAG) technology; and utilizing MLLMs to fuse GUI screenshots and semantic information for identifying and classifying NCFBs. We comprehensively evaluated the method on a dataset consisting of 315 real bugs and 45 injected bugs. Comparison with 21 baseline methods demonstrates its overall effectiveness, and ablation experiments further confirm the contribution of each module. Additionally, 19 previously unknown NCFBs were successfully discovered in real-world application testing, 10 of which have been confirmed or fixed by developers, proving its practical value.

Fields of Study & Subjects

Software Testing and Debugging Techniques Advanced Malware Detection Techniques Digital and Cyber Forensics

Publication details

Journal / source
2026 9th International Conference on Advanced Electronic Technology, Computers and Software Engineering (AETCSE)
Publisher
IEEE
Pages
224–235
Publication date
1 March 2026