Deep reinforcement learning based computation offloading for xURLLC services with UAV-assisted IoT-based multi-access edge computing system

New Internet of Things (IoT) based applications with stricter key performance indicators (KPI) such as round-trip delay, network availability, energy efficiency, spectral efficiency, security, age of information, throughput, and jitter present unprecedented challenges in achieving next-generation ultra-reliable and low-latency communications (xURLLC) for sixth-generation (6 G) communication systems and beyond. In this paper, we aim to collaboratively utilize technologies such as deep reinforcement learning (DRL), unmanned aerial vehicle (UAV), and multi-access edge computing (MEC) to meet the aforementioned KPIs and support the xURLLC services. We present a DRL-empowered UAV-assisted IoT-based MEC system in which a UAV carries a MEC server and provides computation services to IoT devices. Specifically, we have employed twin delay deep deterministic policy gradient (TD3), a DRL algorithm, to find optimal computation offloading policies while simultaneously minimizing both the processing delay and the energy consumption of IoT devices, which inherently influence the KPI requirements. Numerical results illustrate the effectiveness of the proposed approach that can significantly reduce the processing delay and energy consumption, and converge quickly, outperforming the other state-of-the-art DRL-based computation offloading algorithms including Double Deep Q-Network(DDQN) and Deep Deterministic Policy Gradient (DDPG).