TY - GEN
T1 - Rules for computing resistance of transitions of learning algorithms in games
AU - Ali, Mohammed Shabbir
AU - Coucheney, Pierre
AU - Coupechoux, Marceau
N1 - Publisher Copyright:
© 2017, ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering.
PY - 2017/1/1
Y1 - 2017/1/1
N2 - In a finite game the Stochastically Stable States (SSSs) of adaptive play are contained in the set of minimizers of resistance trees. Also, in potential games, the SSSs of the log-linear learning algorithm are the minimizers of the potential function. The SSSs can be characterized using the resistance trees of a Perturbed Markov Chain (PMC), they are the roots of minimum resistance tree. Therefore, computing the resistance of trees in PMC is important to analyze the SSSs of learning algorithms. A learning algorithm defines the Transition Probability Function (TPF) of the induced PMC on the action space of the game. Depending on the characteristics of the algorithm the TPF may become composite and intricate. Resistance computation of intricate functions is difficult and may even be infeasible. Moreover, there are no rules or tools available to simplify the resistance computations. In this paper, we propose novel rules that simplify the computation of resistance. We first, give a generalized definition of resistance that allows us to overcome the limitations of the existing definition. Then, using this new definition we develop the rules that reduce the resistance computation of composite TPF into resistance computation of simple functions. We illustrate their strength by efficiently computing the resistance in log-linear and payoff-based learning algorithms. They provide an efficient tool for characterizing SSSs of learning algorithms in finite games.
AB - In a finite game the Stochastically Stable States (SSSs) of adaptive play are contained in the set of minimizers of resistance trees. Also, in potential games, the SSSs of the log-linear learning algorithm are the minimizers of the potential function. The SSSs can be characterized using the resistance trees of a Perturbed Markov Chain (PMC), they are the roots of minimum resistance tree. Therefore, computing the resistance of trees in PMC is important to analyze the SSSs of learning algorithms. A learning algorithm defines the Transition Probability Function (TPF) of the induced PMC on the action space of the game. Depending on the characteristics of the algorithm the TPF may become composite and intricate. Resistance computation of intricate functions is difficult and may even be infeasible. Moreover, there are no rules or tools available to simplify the resistance computations. In this paper, we propose novel rules that simplify the computation of resistance. We first, give a generalized definition of resistance that allows us to overcome the limitations of the existing definition. Then, using this new definition we develop the rules that reduce the resistance computation of composite TPF into resistance computation of simple functions. We illustrate their strength by efficiently computing the resistance in log-linear and payoff-based learning algorithms. They provide an efficient tool for characterizing SSSs of learning algorithms in finite games.
KW - Learning algorithms
KW - Log-linear learning
KW - Perturbed Markov chains
KW - Potential games
KW - Resistance of transitions
U2 - 10.1007/978-3-319-67540-4_9
DO - 10.1007/978-3-319-67540-4_9
M3 - Conference contribution
AN - SCOPUS:85030175704
SN - 9783319675398
T3 - Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
SP - 97
EP - 107
BT - Game Theory for Networks - 7th International EAI Conference, GameNets 2017, Proceedings
A2 - Elazouzi, Rachid
A2 - Chen, Xu
A2 - Duan, Lingjie
A2 - Sanjab, Anibal
A2 - Materassi, Donatello
A2 - Li, Husheng
PB - Springer Verlag
T2 - 7th EAI International Conference on Game Theory for Networks, GameNets 2017
Y2 - 9 May 2017 through 9 May 2017
ER -