TY - GEN
T1 - Generic uniqueness of the bias vector of mean payoff zero-sum games
AU - Akian, Marianne
AU - Gaubert, Stephane
AU - Hochart, Antoine
N1 - Publisher Copyright:
© 2014 IEEE.
PY - 2014/1/1
Y1 - 2014/1/1
N2 - Zero-sum mean payoff games can be studied by means of a nonlinear spectral problem. When the state space is finite, the latter consists in finding an eigenpair (u; λ) solution of T(u) = λ1 + u where T"n → n is the Shapley (dynamic programming) operator, λ is a scalar, 1 is the unit vector, and u n. The scalar λ yields the mean payoff per time unit, and the vector u, called the bias, allows one to determine optimal stationary strategies. The existence of the eigenpair (u; λ) is generally related to ergodicity conditions. A basic issue is to understand for which classes of games the bias vector is unique (up to an additive constant). In this paper, we consider perfect information zero-sum stochastic games with finite state and action spaces, thinking of the transition payments as variable parameters, transition probabilities being fixed. We identify structural conditions on the support of the transition probabilities which guarantee that the spectral problem is solvable for all values of the transition payments. Then, we show that the bias vector, thought of as a function of the transition payments, is generically unique (up to an additive constant). The proof uses techniques of max-plus (tropical) algebra and nonlinear Perron-Frobenius theory.
AB - Zero-sum mean payoff games can be studied by means of a nonlinear spectral problem. When the state space is finite, the latter consists in finding an eigenpair (u; λ) solution of T(u) = λ1 + u where T"n → n is the Shapley (dynamic programming) operator, λ is a scalar, 1 is the unit vector, and u n. The scalar λ yields the mean payoff per time unit, and the vector u, called the bias, allows one to determine optimal stationary strategies. The existence of the eigenpair (u; λ) is generally related to ergodicity conditions. A basic issue is to understand for which classes of games the bias vector is unique (up to an additive constant). In this paper, we consider perfect information zero-sum stochastic games with finite state and action spaces, thinking of the transition payments as variable parameters, transition probabilities being fixed. We identify structural conditions on the support of the transition probabilities which guarantee that the spectral problem is solvable for all values of the transition payments. Then, we show that the bias vector, thought of as a function of the transition payments, is generically unique (up to an additive constant). The proof uses techniques of max-plus (tropical) algebra and nonlinear Perron-Frobenius theory.
U2 - 10.1109/CDC.2014.7039625
DO - 10.1109/CDC.2014.7039625
M3 - Conference contribution
AN - SCOPUS:84988287505
T3 - Proceedings of the IEEE Conference on Decision and Control
SP - 1581
EP - 1587
BT - 53rd IEEE Conference on Decision and Control,CDC 2014
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 53rd IEEE Conference on Decision and Control, CDC 2014
Y2 - 15 December 2014 through 17 December 2014
ER -