Q2A-NOMA: A Q-Learning-Based QoS-Aware NOMA System Design for Diverse Data Rate Requirements

Wireless use cases in the industrial Internet of Things networks often require guaranteed data rates ranging from a few kilobits per second to a few gigabits per second. Supporting such a requirement in a single radio access technique is difficult, especially when bandwidth is limited. Although nonorthogonal multiple access (NOMA) can improve the system capacity by simultaneously serving multiple devices, its performance suffers from strong device interference. In this article, we propose a Q-learning-based algorithm for handling many-to-many matching problems, such as bandwidth partitioning, device assignment to sub-bands, interference-aware access mode selection [orthogonal multiple access or NOMA], and power allocation to each device. The learning technique maximizes system throughput and spectral efficiency (SE) while maintaining quality-of-service (QoS) for a maximum number of devices. The simulation results show that the proposed technique can significantly increase overall system throughput and SE while meeting heterogeneous QoS criteria.