inControl

ep8 - Anuradha Annaswamy: Adaptive Control - From the "Brave Era" to Reinforcement Learning and Back


Listen Later

In this episode, our guest is Anuradha Annaswamy. Anu is the Director of the Active-Adaptive Control Laboratory and Senior Research Scientist at the Massachusetts Institute of Technology in the Deparment of Mechanical Engineering.  We delve into adaptive control and its exciting history, ranging from the Brave Era to the audacious X15 tests and to modern intersections with Reinforcement Learning.

Outline
02:15 - Anu's background
05:20 - What is adaptation?
08:30 - The Brave Era
15:17 - The X15 accident 
23:16 - Exploration vs exploitation
28:35 - Beyond linearity and time invariance
45:05 - Adaptive control vs Reinforcement Learning
52:12 - The future of adaptive control
54:34 - Outro

Episode links
Anu's lab:  http://aaclab.mit.edu/
NCCR Symposium: https://tinyurl.com/bdz84p4c
Book - Stable adaptive systems: https://tinyurl.com/mw4saame
X-15 Flight 3-65-97: https://tinyurl.com/2kbe7nsy
Paper - Adaptive Control and the NASA X-15-3 Flight Revisited: https://tinyurl.com/2p83k7ez
Paper - A historical perspective of adaptive control and learning: https://tinyurl.com/yck89rcd
Paper -Adaptive Control and Intersections with Reinforcement Learning: https://tinyurl.com/yc27rsyd
KYP Lemma: https://tinyurl.com/mkf35jjt
Persistence of excitation: https://tinyurl.com/bpfwp9n9
Dual control: https://tinyurl.com/ywduzm5x
Paper - Robust adaptive control in the presence of bounded disturbances:  https://tinyurl.com/4pztx23z
Paper -  Reinforcement learning is direct adaptive optimal control https://tinyurl.com/appnjzyn
MRAC: https://tinyurl.com/bdzzphju
Self Tuning Control: https://tinyurl.com/3mjs3skm

Support the show

Podcast info
Podcast website: https://www.incontrolpodcast.com/
Apple Podcasts: https://tinyurl.com/5n84j85j
Spotify: https://tinyurl.com/4rwztj3c
RSS: https://tinyurl.com/yc2fcv4y
Youtube: https://tinyurl.com/bdbvhsj6
Facebook: https://tinyurl.com/3z24yr43
Twitter: https://twitter.com/IncontrolP
Instagram: https://tinyurl.com/35cu4kr4

Acknowledgments and sponsors
This episode was supported by the National Centre of Competence in Research on «Dependable, ubiquitous automation» and the IFAC Activity fund. The podcast benefits from the help of an incredibly talented and passionate team. Special thanks to L. Seward, E. Cahard, F. Banis, F. Dörfler, J. Lygeros, ETH studio and mirrorlake . Music was composed by A New Element.

...more
View all episodesView all episodes
Download on the App Store

inControlBy Alberto Padoan

  • 5
  • 5
  • 5
  • 5
  • 5

5

61 ratings


More shows like inControl

View all
Nature Podcast by Springer Nature Limited

Nature Podcast

759 Listeners

99% Invisible by Roman Mars

99% Invisible

26,200 Listeners

Philosophize This! by Stephen West

Philosophize This!

15,086 Listeners

Conversations with Tyler by Mercatus Center at George Mason University

Conversations with Tyler

2,397 Listeners

The Quanta Podcast by Quanta Magazine

The Quanta Podcast

506 Listeners

Darknet Diaries by Jack Rhysider

Darknet Diaries

7,962 Listeners

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

4,115 Listeners

The Numberphile Podcast by Brady Haran

The Numberphile Podcast

453 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

90 Listeners

Deep Questions with Cal Newport by Cal Newport

Deep Questions with Cal Newport

1,302 Listeners

MIT Technology Review Narrated by MIT Technology Review

MIT Technology Review Narrated

256 Listeners

People I (Mostly) Admire by Freakonomics Radio + Stitcher

People I (Mostly) Admire

2,095 Listeners

Hard Fork by The New York Times

Hard Fork

5,463 Listeners

Ones and Tooze by Foreign  Policy

Ones and Tooze

332 Listeners

The Joy of Why by Steven Strogatz, Janna Levin and Quanta Magazine

The Joy of Why

502 Listeners