Multi-agent deep reinforcement learning for cross-layer scheduling in mobile ad-hoc networks
- Title
- Multi-agent deep reinforcement learning for cross-layer scheduling in mobile ad-hoc networks
- Author
- 이주현
- Keywords
- Ad-hoc network; cross-layer scheduling; multi agent deep reinforcement learning; interference elimination; power control; queue scheduling; actorcritic methods; markov decision process
- Issue Date
- 2023-08
- Publisher
- China Institute of Communication
- Citation
- China Communications, v. 20, NO. 8, Page. 78.0-88.0
- Abstract
- Due to the fading characteristics of wireless channels and the burstiness of data traffic, how to deal with congestion in Ad-hoc networks with effective algorithms is still open and challenging. In this paper, we focus on enabling congestion control to minimize network transmission delays through flexible power control. To effectively solve the congestion problem, we propose a distributed cross-layer scheduling algorithm, which is empowered by graph-based multi-agent deep reinforcement learning. The transmit power is adaptively adjusted in real-time by our algorithm based only on local information (i.e., channel state information and queue length) and local communication (i.e., information exchanged with neighbors). Moreover, the training complexity of the algorithm is low due to the regional cooperation based on the graph attention network. In the evaluation, we show that our algorithm can reduce the transmission delay of data flow under severe signal interference and drastically changing channel states, and demonstrate the adaptability and stability in different topologies. The method is general and can be extended to various types of topologies.
- URI
- https://ieeexplore.ieee.org/document/10238405https://repository.hanyang.ac.kr/handle/20.500.11754/187828
- ISSN
- 1673-5447
- DOI
- 10.23919/JCC.fa.2022-0496.202308
- Appears in Collections:
- COLLEGE OF ENGINEERING SCIENCES[E](공학대학) > ELECTRICAL ENGINEERING(전자공학부) > Articles
- Files in This Item:
There are no files associated with this item.
- Export
- RIS (EndNote)
- XLS (Excel)
- XML