Storage, computation, and communication: A fundamental tradeoff in distributed computing

Qifa Yan, Sheng Yang, Michèle Wigger

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We consider a MapReduce-like distributed computing system. We derive a lower bound on the communication cost for any given storage and computation costs. This lower bound matches the achievable bound we proposed recently. As a result, we completely characterize the optimal tradeoff between the storage, the computation, and the communication. Our result generalizes the previous one by Li et al. to also account for the number of computed intermediate values.

Original languageEnglish
Title of host publication2018 IEEE Information Theory Workshop, ITW 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538635995
DOIs
Publication statusPublished - 2 Jul 2018
Externally publishedYes
Event2018 IEEE Information Theory Workshop, ITW 2018 - Guangzhou, China
Duration: 25 Nov 201829 Nov 2018

Publication series

Name2018 IEEE Information Theory Workshop, ITW 2018

Conference

Conference2018 IEEE Information Theory Workshop, ITW 2018
Country/TerritoryChina
CityGuangzhou
Period25/11/1829/11/18

Fingerprint

Dive into the research topics of 'Storage, computation, and communication: A fundamental tradeoff in distributed computing'. Together they form a unique fingerprint.

Cite this