A Computer Vision Framework for Multi-Class Detection and Tracking in Soccer Broadcast Footage

Read full text
Authors: Daniel Tshiani
Cited by: 0

Abstract

Clubs with access to expensive multi-camera setups or GPS tracking systems gain a competitive advantage through detailed data, whereas lower-budget teams are often unable to collect similar information. This paper examines whether such data can instead be extracted directly from standard broadcast footage using a single-camera computer vision pipeline. This project develops an end-to-end system that combines a YOLO object detector with the ByteTrack tracking algorithm to identify and track players, referees, goalkeepers, and the ball throughout a match. Experimental results show that the pipeline achieves high performance in detecting and tracking players and officials, with strong precision, recall, and mAP50 scores, while ball detection remains the primary challenge. Despite this limitation, our findings demonstrate that AI can extract meaningful player-level spatial information from a single broadcast camera. By reducing reliance on specialized hardware, the proposed approach enables colleges, academies, and amateur clubs to adopt scalable, data-driven analysis methods previously accessible only to professional teams, highlighting the potential for affordable computer vision-based soccer analytics.

Fields of Study & Subjects

Video Surveillance and Tracking Methods Advanced Neural Network Applications Human Pose and Action Recognition

Publication details

Journal / source
arXiv (Cornell University)
Publication date
17 February 2026
Language
EN
Document type
Preprint