TY - GEN
T1 - A Storage-computation-communication tradeoff for distributed computing
AU - Yan, Qifa
AU - Yang, Sheng
AU - Wigger, Michele
N1 - Publisher Copyright:
© 2018 IEEE.
PY - 2018/10/12
Y1 - 2018/10/12
N2 - This paper investigates distributed computing systems where computations are split into "Map" and "Reduce" functions. A new coded scheme, called distributed computing and coded communication (D3C), is proposed, and its communication load is analyzed as a function of the available storage space and the number of intermediate values (IVA) to be computed. D3C achieves the smallest possible communication load for a given storage space, while a smaller number of IVAs need to be computed compared to Li et al.'s coded distributed computing (CDC) scheme. More generally, our scheme can flexibly trade between storage space and the number of IVAs to be computed. Communication load is then analyzed for any given tradeoff.
AB - This paper investigates distributed computing systems where computations are split into "Map" and "Reduce" functions. A new coded scheme, called distributed computing and coded communication (D3C), is proposed, and its communication load is analyzed as a function of the available storage space and the number of intermediate values (IVA) to be computed. D3C achieves the smallest possible communication load for a given storage space, while a smaller number of IVAs need to be computed compared to Li et al.'s coded distributed computing (CDC) scheme. More generally, our scheme can flexibly trade between storage space and the number of IVAs to be computed. Communication load is then analyzed for any given tradeoff.
UR - https://www.scopus.com/pages/publications/85056725958
U2 - 10.1109/ISWCS.2018.8491052
DO - 10.1109/ISWCS.2018.8491052
M3 - Conference contribution
AN - SCOPUS:85056725958
T3 - Proceedings of the International Symposium on Wireless Communication Systems
BT - 2018 15th International Symposium on Wireless Communication Systems, ISWCS 2018
PB - VDE Verlag GmbH
T2 - 15th International Symposium on Wireless Communication Systems, ISWCS 2018
Y2 - 28 August 2018 through 31 August 2018
ER -