Abstract
What is Shannon's information theory (IT)? Despite its continued impact on our digital society, Claude Shannon's life and work is still unknown to numerous people. In this tutorial, we review many aspects of the concept of entropy and information from a historical and mathematical point of view. The text is structured into small, mostly independent sections, each covering a particular topic. For simplicity we restrict our attention to one-dimensional variables and use logarithm and exponential notations log and exp without specifying the base. We culminate with a simple exposition of a recent proof (2017) of the entropy power inequality (EPI), one of the most fascinating inequality in the theory.
| Original language | English |
|---|---|
| Pages | 43-77 |
| Number of pages | 35 |
| Publication status | Published - 1 Jan 2018 |
| Externally published | Yes |
| Event | 2018 23rd Seminaire Poincare: L'Information - 2018 23rd Poincare Seminar: Information - Paris, France Duration: 17 Nov 2018 → … |
Conference
| Conference | 2018 23rd Seminaire Poincare: L'Information - 2018 23rd Poincare Seminar: Information |
|---|---|
| Country/Territory | France |
| City | Paris |
| Period | 17/11/18 → … |