Joint Optimization Time-Slotted Computing Offloading and V2X Resource Allocation by Reinforcement Learning

This article addresses the challenges of computation offloading and resource allocation in dynamic vehicular platoons, where high-speed mobility and sparse roadside unit (RSU) deployment lead to intermittent connectivity and complex task scheduling delays. This article proposes a rule-based reinforcement learning (RL) framework that jointly optimizes time-slotted task offloading and vehicle-to-everything (V2X) resource allocation while strictly adhering to energy consumption constraints, which reduces computational complexity while ensuring optimization accuracy. The framework integrates domain-specific rules—such as leader vehicle platoon leader (PL) capacity limits, RSU computation thresholds, and energy budgets—into the RL decision-making process to ensure feasible actions across four offloading scenarios: local computation, direct RSU offloading, relay-based RSU offloading, and PL offloading. The problem is formulated as a mixed-integer nonlinear programming (MINLP) model and decomposed into vehicle-level mode selection and computing unit-level resource allocation. Extensive simulations demonstrate the algorithm’s robustness in dynamic environments.