AssistTaxi-v2: A Scalable Dataset for Taxiway/Runway Scene Understanding Under Diverse Conditions
Abstract
The advancement of autonomous taxiing technologies in aviation necessitates access to diverse, high-quality datasets that capture real-world conditions across a range of environments. Building upon our prior release of AssistTaxi, we extend the image/video dataset for aircraft taxiway perception by increasing the diversity of the dataset with varying environmental conditions. This expanded dataset incorporates over 900,000 high-resolution frames collected from general aviation and commercial airports during day, night, and varying weather scenarios. The dataset also provides fine-grained annotations using a semi-automated labeling pipeline across temporally consistent video frames, significantly reducing manual intervention while increasing annotation accuracy. AssistTaxi offers a valuable benchmark for training, evaluating, and validating AI models intended for autonomous ground operations in aviation. We anticipate this dataset to enable further research in transfer learning, robust perception, machine learning engineering, and safety assurance for vision-based aircraft navigation systems.
Fields of Study & Subjects
Advanced Neural Network Applications
Autonomous Vehicle Technology and Safety
Aerospace Engineering and Control Systems
Publication details
- Journal / source
- AIAA SciTech Forum
- Publication date
- 8 January 2026