TY - GEN
T1 - A Fundamental Storage-Communication Tradeoff in Distributed Computing with Straggling Nodes
AU - Yan, Qifa
AU - Wigger, Michele
AU - Yang, Sheng
AU - Tang, Xiaohu
N1 - Publisher Copyright:
© 2019 IEEE.
PY - 2019/7/1
Y1 - 2019/7/1
N2 - The optimal storage-computation tradeoff is characterized for a MapReduce-like distributed computing system with straggling nodes, where only a part of the nodes can be utilized to compute the desired output functions. The result holds for arbitrary output functions and thus generalizes previous results that restricted to linear functions. Specifically, in this work, we propose a new information-theoretical converse and a new matching coded computing scheme, that we call coded computing for straggling systems (CCS).
AB - The optimal storage-computation tradeoff is characterized for a MapReduce-like distributed computing system with straggling nodes, where only a part of the nodes can be utilized to compute the desired output functions. The result holds for arbitrary output functions and thus generalizes previous results that restricted to linear functions. Specifically, in this work, we propose a new information-theoretical converse and a new matching coded computing scheme, that we call coded computing for straggling systems (CCS).
U2 - 10.1109/ISIT.2019.8849615
DO - 10.1109/ISIT.2019.8849615
M3 - Conference contribution
AN - SCOPUS:85073153102
T3 - IEEE International Symposium on Information Theory - Proceedings
SP - 2803
EP - 2807
BT - 2019 IEEE International Symposium on Information Theory, ISIT 2019 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2019 IEEE International Symposium on Information Theory, ISIT 2019
Y2 - 7 July 2019 through 12 July 2019
ER -