Breaking Math Podcast

24: Language and Entropy (Information Theory in Language)


Listen Later

Information theory was founded in 1948 by Claude Shannon, and is a way of both qualitatively and quantitatively describing the limits and processes involved in communication. Roughly speaking, when two entities communicate, they have a message, a medium, confusion, encoding, and decoding; and when two entities communicate, they transfer information between them. The amount of information that is possible to be transmitted can be increased or decreased by manipulating any of the aforementioned variables. One of the practical, and original, applications of information theory is to models of language. So what is entropy? How can we say language has it? And what structures within language with respect to information theory reveal deep insights about the nature of language itself?


--- 


This episode is sponsored by 

· Anchor: The easiest way to make a podcast.  https://anchor.fm/app


Support this podcast: https://anchor.fm/breakingmathpodcast/support

...more
View all episodesView all episodes
Download on the App Store

Breaking Math PodcastBy Gabriel Hesch and Autumn Phaneuf

  • 4
  • 4
  • 4
  • 4
  • 4

4

326 ratings


More shows like Breaking Math Podcast

View all
Big Picture Science by Big Picture Science

Big Picture Science

938 Listeners

Science Magazine Podcast by Science Magazine

Science Magazine Podcast

809 Listeners

Closer To Truth by Closer To Truth

Closer To Truth

247 Listeners

In Our Time: Science by BBC Radio 4

In Our Time: Science

719 Listeners

Universe Today Podcast by Fraser Cain

Universe Today Podcast

540 Listeners

Ask a Spaceman! by Paul M. Sutter

Ask a Spaceman!

804 Listeners

The Quanta Podcast by Quanta Magazine

The Quanta Podcast

498 Listeners

Space Nuts: Astronomy Insights & Cosmic Discoveries by Professor Fred Watson and Andrew Dunkley

Space Nuts: Astronomy Insights & Cosmic Discoveries

221 Listeners

SpaceTime: Your Guide to Space & Astronomy by Stuart Gary

SpaceTime: Your Guide to Space & Astronomy

319 Listeners

Physics World Weekly Podcast by Physics World

Physics World Weekly Podcast

79 Listeners

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

4,136 Listeners

Daniel and Kelly’s Extraordinary Universe by iHeartPodcasts

Daniel and Kelly’s Extraordinary Universe

2,307 Listeners

Theories of Everything with Curt Jaimungal by Theories of Everything

Theories of Everything with Curt Jaimungal

459 Listeners

Why This Universe? by Dan Hooper, Shalma Wegsman

Why This Universe?

363 Listeners

The Joy of Why by Steven Strogatz, Janna Levin and Quanta Magazine

The Joy of Why

502 Listeners