Toward 6G Edge Intelligence: Lightweight LLMs for Intent-Driven Network Automation

View at publisher
Authors: Bei Wu, S. Q. Zou, Minghui Liwang, Wei Ni, Xianbin Wang, Youliang Tian
Cited by: 1
References: 26

Abstract

Future 6 G networks are envisaged to tightly integrate communication, sensing, and computing, demanding real-time, intent-driven intelligence at the edge. Whilelargelanguagemodels (LLMs) excel in intent recognition and semantic reasoning, their application to real-time network lifecycle management at the edge is limited by heterogeneousapplicationintents (APPIs), dynamic network conditions, and severe resource constraints. This paper proposes a novel lightweight LLM architecture, KGLlama-KD, that synergizes knowledge graphs (KGs) withknowledgedistillation (KD) to enable intent-driven networking and enhance 6 G edge intelligence. Specifically, a KG is constructed to formally describe the relationships among application scenarios, functional primitives, performance requirements within APPIs, and the correspondences between APPIs andnetworkservicerequests (NSRs), thereby producing a structured intent training dataset. Building upon the Llama 3 foundation model, a two-phase optimization framework is designed to support lightweight edge deployment while preserving translation fidelity. The LLM is first fine-tuned with KG guidance and compressed via KD in the cloud, and then deployed on resource-constrained edge nodes to perform real-time, accurate, and efficient APPIs interpretation. Experiments validate that KGLlama-KD achieves 95% accuracy for APPI understanding, surpassing DeepSeek and Qwen by an average of 8%. The distilled model reduces inference latency by 60% compared to full-scale LLMs, fulfilling the sub-100 ms requirement for 6 G latency-sensitive services.

Fields of Study & Subjects

Software-Defined Networks and 5G IoT and Edge/Fog Computing Age of Information Optimization

Publication details

Journal / source
IEEE Transactions on Mobile Computing
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
25
Issue
9
Pages
14352–14365
Publication date
30 March 2026