TY - JOUR
T1 - Analysis of Classifier-Free Guidance Weight Schedulers
AU - Wang, Xi
AU - Dufour, Nicolas
AU - Andreou, Nefeli
AU - Cani, Marie Paule
AU - Abrevaya, Victoria Fernández
AU - Picard, David
AU - Kalogeiton, Vicky
N1 - Publisher Copyright:
© 2024, Transactions on Machine Learning Research. All rights reserved.
PY - 2024/1/1
Y1 - 2024/1/1
N2 - Classifier-Free Guidance (CFG) enhances the quality and condition adherence of text-to-image diffusion models. It operates by combining the conditional and unconditional pre-dictions using a fixed weight. However, recent works vary the weights throughout the diffusion process, reporting superior results but without providing any rationale or analysis. By conducting comprehensive experiments, this paper provides insights into CFG weight schedulers. Our findings suggest that simple, monotonically increasing weight schedulers consistently lead to improved performances, requiring merely a single line of code. In addi-tion, more complex parametrized schedulers can be optimized for further improvement, but do not generalize across different models and tasks.
AB - Classifier-Free Guidance (CFG) enhances the quality and condition adherence of text-to-image diffusion models. It operates by combining the conditional and unconditional pre-dictions using a fixed weight. However, recent works vary the weights throughout the diffusion process, reporting superior results but without providing any rationale or analysis. By conducting comprehensive experiments, this paper provides insights into CFG weight schedulers. Our findings suggest that simple, monotonically increasing weight schedulers consistently lead to improved performances, requiring merely a single line of code. In addi-tion, more complex parametrized schedulers can be optimized for further improvement, but do not generalize across different models and tasks.
UR - https://www.scopus.com/pages/publications/85215579725
M3 - Article
AN - SCOPUS:85215579725
SN - 2835-8856
VL - 2024
JO - Transactions on Machine Learning Research
JF - Transactions on Machine Learning Research
ER -