HAT-YOLO: Hybrid Attention and Transformer-Integrated Model for UAV Object Detection on Embedded Devices

Read full text
Authors: Md. Minhazul Haq, Anis Salwa Mohd Khairuddin, Effariza Hanafi, Hafiz Muhammad Fahad Noman, Mohamad Haniff Junos
Cited by: 1

Abstract

The rapid advancement of unmanned aerial vehicles (UAVs) has increased the demand of accurate, lightweight and real-time object detection models suitable for embedded deployment.However, target object detection from remote sensing images is challenging due to scale variation, complex backgrounds and high object density.Additionally, many existing deep learning-based models require large GPU memory.To overcome these limitations, we proposed a HAT-YOLO model, an improved YOLOv8n-based architecture for efficient vehicle detection in aerial images using limited memory devices.The proposed HAT-YOLO model introduces three key modules.Firstly, a dual channel-spatial attention based A2C2 module to improve local feature discrimination.Secondly, lightweight transformer based TA2C2 module for better long-range global context feature extraction.Finally, GELU activation function integrated CBG module for faster convergence, non-linear feature representation and lower processing time.The HAT-YOLO model was trained and evaluated on VEDAI and RSOD datasets using NVIDIA RTX A2000, Google Colab and Jetson Nano GPU platforms.Experimental results demonstrate that HAT-YOLO improved accuracy over YOLOv8n by 6.7% and 4.2% in mAP@0.5 and 6.1% and 3.2% in mAP@0.5:0.95 on VEDAI and RSOD datasets, respectively, while maintaining lightweight architecture with 3.82 million parameters and 8.9 GFLOPs.On Jetson Nano, HAT-YOLO achieves 17.2 FPS on VEDAI and 18.4 FPS on RSOD, indicating real-time detection performance on resource-constrained devices.These results show that our developed model effectively balances detection accuracy, architectural complexity and inference speed, making it highly feasible for deployment on embedded platforms.Proposed model code is available at

Fields of Study & Subjects

Advanced Neural Network Applications Infrared Target Detection Methodologies Video Surveillance and Tracking Methods

Publication details

Journal / source
KSII Transactions on Internet and Information Systems
Publisher
Korean Society for Internet Information (KSII)
Volume
20
Issue
2
Publication date
27 February 2026