Extending Memory-Based Obfuscated Malware Detection With Network Behavior
Abstract
Obfuscated and fileless malware families evade traditional detection systems by residing exclusively in memory and employing stealthy techniques such as process injection and encrypted communication. Although memory-based detection methods have demonstrated strong performance using host-based features alone, the contribution of network-level information remains underexplored. This study addresses this gap by leveraging the recently released WinMal25 dataset, which comprises approximately 2 TB of ground-truth Windows memory dumps collected under realistic benign activity and obfuscated malicious execution. We extract a small set of socket- and connection-level variables directly from RAM and evaluate their contribution to malware detection using Random Forest and XGBoost classifiers under multiple feature configurations. The experimental results show that network-related structures preserved in memory are highly discriminative on their own and further enhance detection performance when combined with traditional system-level features. These findings demonstrate that communication-related structures preserved in memory constitute a robust and complementary forensic signal, supporting the development of interpretable and generalizable memory-based malware detection systems capable of operating under heavy obfuscation.
Fields of Study & Subjects
Advanced Malware Detection Techniques
Network Security and Intrusion Detection
Spam and Phishing Detection
Publication details
- Journal / source
- IEEE Open Journal of the Communications Society
- Publisher
- Institute of Electrical and Electronics Engineers (IEEE)
- Volume
- 7
- Pages
- 2385–2399
- Publication date
- 1 January 2026
- Language
- EN