How can ignorant but patient cognitive terminals learn their strategy and utility?

S. M. Perlaza, H. Tembine, S. Lasaulce

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper aims to contribute to bridge the gap between existing theoretical results in distributed radio resource allocation policies based on equilibria in games (assuming complete information and rational players) and practical design of signal processing algorithms for self-configuring wireless networks. For this purpose, the framework of learning theory m games is exploited. Here, a new learning algorithm based on mild information assumptions at the transmitters is presented. This algorithm possesses attractive convergence properties not available for standard reinforcement learning algorithms and in addition, it allows each transmitter to learn both its optimal strategy and the values of its expected utility for all its actions. A detailed convergence analysis is conducted. In particular, a framework for studying heterogeneous wireless networks where transmitters do not learn at the same rate is provided. The proposed algorithm, which can be applied to any wireless network verifying the information assumptions stated, is applied to the case of multiple access channels in order to provide some numerical results.

Original languageEnglish (US)
Title of host publication2010 IEEE 11th International Workshop on Signal Processing Advances in Wireless Communications, SPAWC 2010
DOIs
StatePublished - 2010
Event2010 IEEE 11th International Workshop on Signal Processing Advances in Wireless Communications, SPAWC 2010 - Marrakech, Morocco
Duration: Jun 20 2010Jun 23 2010

Publication series

NameIEEE Workshop on Signal Processing Advances in Wireless Communications, SPAWC

Other

Other2010 IEEE 11th International Workshop on Signal Processing Advances in Wireless Communications, SPAWC 2010
CountryMorocco
CityMarrakech
Period6/20/106/23/10

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Computer Science Applications
  • Information Systems

Fingerprint Dive into the research topics of 'How can ignorant but patient cognitive terminals learn their strategy and utility?'. Together they form a unique fingerprint.

Cite this