TY - GEN
T1 - LLM as a Broken Telephone
T2 - 63rd Annual Meeting of the Association for Computational Linguistics, ACL 2025
AU - Mohamed, Amr
AU - Geng, Mingmeng
AU - Vazirgiannis, Michalis
AU - Shang, Guokan
N1 - Publisher Copyright:
© 2025 Association for Computational Linguistics.
PY - 2025/1/1
Y1 - 2025/1/1
N2 - As large language models are increasingly responsible for online content, concerns arise about the impact of repeatedly processing their own outputs. Inspired by the “broken telephone” effect in chained human communication, this study investigates whether LLMs similarly distort information through iterative generation. Through translation-based experiments, we find that distortion accumulates over time, influenced by language choice and chain complexity. While degradation is inevitable, it can be mitigated through strategic prompting techniques. These findings contribute to discussions on the long-term effects of AI-mediated information propagation, raising important questions about the reliability of LLM-generated content in iterative workflows.
AB - As large language models are increasingly responsible for online content, concerns arise about the impact of repeatedly processing their own outputs. Inspired by the “broken telephone” effect in chained human communication, this study investigates whether LLMs similarly distort information through iterative generation. Through translation-based experiments, we find that distortion accumulates over time, influenced by language choice and chain complexity. While degradation is inevitable, it can be mitigated through strategic prompting techniques. These findings contribute to discussions on the long-term effects of AI-mediated information propagation, raising important questions about the reliability of LLM-generated content in iterative workflows.
UR - https://www.scopus.com/pages/publications/105021023611
U2 - 10.18653/v1/2025.acl-long.371
DO - 10.18653/v1/2025.acl-long.371
M3 - Conference contribution
AN - SCOPUS:105021023611
T3 - Proceedings of the Annual Meeting of the Association for Computational Linguistics
SP - 7493
EP - 7509
BT - Long Papers
A2 - Che, Wanxiang
A2 - Nabende, Joyce
A2 - Shutova, Ekaterina
A2 - Pilehvar, Mohammad Taher
PB - Association for Computational Linguistics (ACL)
Y2 - 27 July 2025 through 1 August 2025
ER -