Document Type
Conference Proceeding
Publication Date
9-27-2004
Abstract
In this paper we take a closer look at a recently proposed classification scheme for multiagent learning algorithms. Based on this scheme an exploitation mechanism (we call it the Exploiter) was developed that could beat various Policy Hill Climbers (PHC) and other fair opponents in some repeated matrix games. We show on the contrary that some fair opponents may actually beat the Exploiter in repeated games. This clearly indicates a deficiency in the original classification scheme which we address. Specifically, we introduce a new measure called Reactivity that measures how fast a learner can adapt to an unexpected hypothetical change in the opponent's policy. We show that in some games, this new measure can approximately predict the performance of a player, and based on this measure we explain the behaviors of various algorithms in the Matching Pennies game, which was inexplicable by the original scheme. Finally we show that under certain restrictions, a player that consciously tries to avoid exploitation may be unable to do so.
Montclair State University Digital Commons Citation
Banerjee, Bikramjit and Peng, Jing, "The Role of Reactivity in Multiagent Learning" (2004). Department of Computer Science Faculty Scholarship and Creative Works. 585.
https://digitalcommons.montclair.edu/compusci-facpubs/585
Published Citation
Banerjee, B., & Peng, J. (2004, July). The role of reactivity in multiagent learning. In Autonomous Agents and Multiagent Systems, International Joint Conference on (Vol. 3, pp. 538-545). IEEE Computer Society.