TY - GEN
T1 - Lazy parameter tuning and control
T2 - 2021 Genetic and Evolutionary Computation Conference, GECCO 2021
AU - Antipov, Denis
AU - Buzdalov, Maxim
AU - Doerr, Benjamin
N1 - Publisher Copyright:
© 2021 ACM.
PY - 2021/6/26
Y1 - 2021/6/26
N2 - Most evolutionary algorithms have multiple parameters and their values drastically affect the performance. Due to the often complicated interplay of the parameters, setting these values right for a particular problem is a challenging task. This task becomes even more complicated when the optimal parameter values change significantly during the run of the algorithm since then a dynamic parameter choice is necessary. In this work, we propose a lazy but effective solution, namely choosing all parameter values in each iteration randomly from a suitably scaled power-law distribution. We demonstrate the effectiveness of this approach via runtime analyses of the (1 + (λ, λ)) genetic algorithm with all three parameters chosen in this manner. We show that this algorithm on the one hand can imitate simple hill-climbers like the (1+1) EA, giving the same asymptotic runtime on some simple problems. On the other hand, this algorithm is also very efficient on jump functions, where the best static parameters are very different from those necessary to optimize simple problems. We prove a performance guarantee that is comparable to, and sometimes even better than, the best performance known for static parameters. We complement our theoretical results with a rigorous empirical study confirming what the asymptotic runtime results suggest.
AB - Most evolutionary algorithms have multiple parameters and their values drastically affect the performance. Due to the often complicated interplay of the parameters, setting these values right for a particular problem is a challenging task. This task becomes even more complicated when the optimal parameter values change significantly during the run of the algorithm since then a dynamic parameter choice is necessary. In this work, we propose a lazy but effective solution, namely choosing all parameter values in each iteration randomly from a suitably scaled power-law distribution. We demonstrate the effectiveness of this approach via runtime analyses of the (1 + (λ, λ)) genetic algorithm with all three parameters chosen in this manner. We show that this algorithm on the one hand can imitate simple hill-climbers like the (1+1) EA, giving the same asymptotic runtime on some simple problems. On the other hand, this algorithm is also very efficient on jump functions, where the best static parameters are very different from those necessary to optimize simple problems. We prove a performance guarantee that is comparable to, and sometimes even better than, the best performance known for static parameters. We complement our theoretical results with a rigorous empirical study confirming what the asymptotic runtime results suggest.
KW - Crossover
KW - Dynamic parameter choice
KW - Runtime analysis
KW - Theory
U2 - 10.1145/3449639.3459377
DO - 10.1145/3449639.3459377
M3 - Conference contribution
AN - SCOPUS:85108133321
T3 - GECCO 2021 - Proceedings of the 2021 Genetic and Evolutionary Computation Conference
SP - 1115
EP - 1123
BT - GECCO 2021 - Proceedings of the 2021 Genetic and Evolutionary Computation Conference
PB - Association for Computing Machinery, Inc
Y2 - 10 July 2021 through 14 July 2021
ER -