Deakin University
Browse

Deep reinforcement learning for multiagent systems: a review of challenges, solutions, and applications

Version 2 2024-06-06, 07:49
Version 1 2020-05-15, 09:57
journal contribution
posted on 2024-06-06, 07:49 authored by TT Nguyen, ND Nguyen, S Nahavandi
Reinforcement learning (RL) algorithms have been around for decades and employed to solve various sequential decision-making problems. These algorithms, however, have faced great challenges when dealing with high-dimensional environments. The recent development of deep learning has enabled RL methods to drive optimal policies for sophisticated and capable agents, which can perform efficiently in these challenging environments. This article addresses an important aspect of deep RL related to situations that require multiple agents to communicate and cooperate to solve complex tasks. A survey of different approaches to problems related to multiagent deep RL (MADRL) is presented, including nonstationarity, partial observability, continuous state and action spaces, multiagent training schemes, and multiagent transfer learning. The merits and demerits of the reviewed methods will be analyzed and discussed with their corresponding applications explored. It is envisaged that this review provides insights about various MADRL methods and can lead to the future development of more robust and highly useful multiagent learning methods for solving real-world problems.

History

Journal

IEEE transactions on cybernetics

Volume

50

Pagination

3826-3839

Location

Piscataway, N.J.

ISSN

2168-2267

Language

eng

Publication classification

C1 Refereed article in a scholarly journal

Issue

9

Publisher

Institute of Electrical and Electronics Engineers