Complexity Analysis for Categorized Edge Language Models
Abstract
Edge generative artificial intelligence (AI) increasingly combines language, perception, reasoning, audio, and action on resource-constrained devices. This paper profiles public GPT-Generated Unified Format (GGUF) checkpoints from the Hugging Face Hub (HFH) across conversational, instruct, thinking, audio, vision-language (VL), and vision-language-action (VLA) categories using a shared parser-based deployment-envelope workflow. The main category-specific run retained 21,039 profiled entries and estimated the minimum memory bandwidth, compute throughput, and unified-memory architecture (UMA) footprint needed to satisfy category-specific target throughput values. The resulting measurement protocol was symmetric, but the deployment envelopes were asymmetric: VL and thinking workloads were the heaviest on the compute–bandwidth axis, VLA formed a smaller elevated multimodal branch, and audio, instruct, and conversational workloads were lighter on average. A unified 10-tokens-per-second (TPS) sensitivity run compressed the compute–bandwidth gaps, showing that service-rate assumptions contributed strongly to cross-category separation. Welch/Games–Howell and Kruskal/Dunn analyses confirmed large category effects for bandwidth and compute in the category-specific regime, but only small memory effects. The results show that edge-model feasibility cannot be inferred from parameter count alone; throughput target, backbone family, modality, and memory budgeting must be considered jointly.
Fields of Study & Subjects
Face recognition and analysis
Artificial Intelligence in Healthcare and Education
Face Recognition and Perception
Publication details
- Journal / source
- Symmetry
- Publisher
- MDPI AG
- Volume
- 18
- Issue
- 5
- Pages
- 766–766
- Publication date
- 29 April 2026
- Language
- EN