Data Science Decoded

Data Science #3 - "A Mathematical Theory of Communication" (1948), Shannon, C. E. Part - 1


Listen Later

Shannon, Claude Elwood. "A mathematical theory of communication." The Bell system technical journal 27.3 (1948): 379-423.

Part 1/3.
The paper fundamentally reshapes how we understand communication.
The paper introduces a formal framework for analyzing communication systems, addressing the transmission of information with and without noise. Key concepts include the definition of information entropy, the logarithmic measure of information, and the capacity of communication channels.
Shannon demonstrates that information can be efficiently encoded and decoded to maximize the transmission rate while minimizing errors introduced by noise. This work is pivotal today as it underpins digital communication technologies, from data compression to error correction in modern telecommunication systems.
Full breakdown of the paper with math and python code is at our website:
https://datasciencedecodedpodcast.com...
This is the first part out of 3, as the paper is quite long!

...more
View all episodesView all episodes
Download on the App Store

Data Science DecodedBy Mike E

  • 3.8
  • 3.8
  • 3.8
  • 3.8
  • 3.8

3.8

5 ratings


More shows like Data Science Decoded

View all
Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,003 Listeners

The Joe Rogan Experience by Joe Rogan

The Joe Rogan Experience

229,169 Listeners

StarTalk Radio by Neil deGrasse Tyson

StarTalk Radio

14,322 Listeners

More or Less by BBC Radio 4

More or Less

890 Listeners

Talk Python To Me by Michael Kennedy

Talk Python To Me

585 Listeners

The Quanta Podcast by Quanta Magazine

The Quanta Podcast

532 Listeners

Science Friday by Science Friday and WNYC Studios

Science Friday

6,401 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

302 Listeners

Pod Save America by Crooked Media

Pod Save America

87,348 Listeners

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

4,182 Listeners

Practical AI by Practical AI LLC

Practical AI

211 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

95 Listeners

Hard Fork by The New York Times

Hard Fork

5,512 Listeners

The Rest Is History by Goalhanger

The Rest Is History

15,272 Listeners

The Astrophysics Podcast by Paul Duffell

The Astrophysics Podcast

54 Listeners