Emergent Communication in Multi-Agent Reinforcement Learning for Flying Base Stations

Salmane Naoumi, Reda Alami, Hakim Hacid, Ebtesam Almazrouei, Merouane Debbah, Mehdi Bennis, Marwa Chafii

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In order to increase network capacity and coverage, flying base stations (FBSs) can be deployed in a variety of scenarios, such as in extremely crowded gatherings or for emergency communication and network access in areas without terrestrial network coverage. Due to their inherent low cost, ease of deployment and high mobility, unmanned aerial vehicles (UAVs) deployed as FBSs can provide cost-effective, fast and reliable network access services to remote ground users. To maximize network capacity, FBSs need to coordinate and exchange information about their observations to optimize their positions, under limited energy and bandwidth resources. In this paper, we investigate the problem of optimizing the positions of FBSs using the framework of emerging communications in multi-agent reinforcement learning (EC-MARL) and we evaluate two EC-MARL architectures, namely Multi-Agent Graph-Attention Communication and Teaming (MAGIC) and Targeted Multi-Agent Communication (TarMAC). We show that coordination between FBSs through learning a communication protocol increases the total achievable rate and coverage of ground users, compared to baselines without communication. Moreover, we consider challenging environments with a large number of FBSs and demonstrate the efficiency of the proposed method in terms of speed of convergence and robustness to the movement of users.

Original languageEnglish (US)
Title of host publication2023 IEEE International Mediterranean Conference on Communications and Networking, MeditCom 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages133-138
Number of pages6
ISBN (Electronic)9798350333732
DOIs
StatePublished - 2023
Event3rd IEEE International Mediterranean Conference on Communications and Networking, MeditCom 2023 - Dubrovnik, Croatia
Duration: Sep 4 2023Sep 7 2023

Publication series

Name2023 IEEE International Mediterranean Conference on Communications and Networking, MeditCom 2023

Conference

Conference3rd IEEE International Mediterranean Conference on Communications and Networking, MeditCom 2023
Country/TerritoryCroatia
CityDubrovnik
Period9/4/239/7/23

Keywords

  • Emergent communication
  • Flying base station
  • Multi-agent reinforcement learning
  • UAV

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Safety, Risk, Reliability and Quality

Fingerprint

Dive into the research topics of 'Emergent Communication in Multi-Agent Reinforcement Learning for Flying Base Stations'. Together they form a unique fingerprint.

Cite this