Not-So-Pretty: Studying and Segmenting Multiline Console Logs

View at publisher Summarise with VIRAT
Authors: Jianchen Zhao, Kundi Yao, Masanari Kondo, Hetong Dai, Weiyi Shang, Yasutaka Kamei
Cited by: 0
References: 34

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Console logs play a crucial role in the development, maintenance, and operation of software systems. However, their diverse and human-oriented formatting presents significant challenges for automated analysis. Most existing log analysis benchmarks and the tools built upon them operate under the assumption that individual log messages correspond to single lines. In reality, console logs frequently span multiple lines and exhibit a wide range of structures and formats, complicating parsing and downstream analysis. In this paper, we conduct a qualitative study on a diverse dataset of console logs, identifying four structural types and ten common formats in multiline log segments. We find that although only 3% of the log messages are multiline, they account for 66% of the content by line count. To address the challenge of parsing log messages that span multiple lines, we also propose a deep learning–based preprocessing approach that splits logs into structurally and semantically consistent segments and assigns labels about their format. Our model, trained on a manually labelled dataset, achieves an F1 score of 0.88 for log segmentation and 0.84 for log format classification. We release our dataset and model to support further research in log analysis.

Fields of Study & Subjects

Software System Performance and Reliability Software Engineering Research Software Testing and Debugging Techniques

Publication details

Journal / source
ACM Transactions on Software Engineering and Methodology
Publication date
25 March 2026
Language
EN