Résumé
What is Shannon's information theory (IT)? Despite its continued impact on our digital society, Claude Shannon's life and work is still unknown to numerous people. In this tutorial, we review many aspects of the concept of entropy and information from a historical and mathematical point of view. The text is structured into small, mostly independent sections, each covering a particular topic. For simplicity we restrict our attention to one-dimensional variables and use logarithm and exponential notations log and exp without specifying the base. We culminate with a simple exposition of a recent proof (2017) of the entropy power inequality (EPI), one of the most fascinating inequality in the theory.
| langue originale | Anglais |
|---|---|
| Pages | 43-77 |
| Nombre de pages | 35 |
| état | Publié - 1 janv. 2018 |
| Modification externe | Oui |
| Evénement | 2018 23rd Seminaire Poincare: L'Information - 2018 23rd Poincare Seminar: Information - Paris, France Durée: 17 nov. 2018 → … |
Une conférence
| Une conférence | 2018 23rd Seminaire Poincare: L'Information - 2018 23rd Poincare Seminar: Information |
|---|---|
| Pays/Territoire | France |
| La ville | Paris |
| période | 17/11/18 → … |
Empreinte digitale
Examiner les sujets de recherche de « This is IT: A primer on Shannon's entropy and information ». Ensemble, ils forment une empreinte digitale unique.Contient cette citation
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver