Danijar Hafner on the DreamerV3 agent and world models, the Director agent and heirarchical RL,  realtime RL on robots with DayDreamer, and his framework for unsupervised agent design!

Danijar Hafner is a PhD candidate at the University of Toronto with Jimmy Ba, a visiting student at UC Berkeley with Pieter Abbeel, and an intern at DeepMind.  He has been our guest before back on episode 11.  

Featured References   

Mastering Diverse Domains through World Models [ blog ] DreaverV3 

Danijar Hafner, Jurgis Pasukonis, Jimmy Ba, Timothy Lillicrap  

DayDreamer: World Models for Physical Robot Learning [ blog ] 
Philipp Wu, Alejandro Escontrela, Danijar Hafner, Ken Goldberg, Pieter Abbeel 

Deep Hierarchical Planning from Pixels [ blog ] 
Danijar Hafner, Kuang-Huei Lee, Ian Fischer, Pieter Abbeel   

Action and Perception as Divergence Minimization [ blog ] 
Danijar Hafner, Pedro A. Ortega, Jimmy Ba, Thomas Parr, Karl Friston, Nicolas Heess 

Additional References  

• Mastering Atari with Discrete World Models [ blog ] DreaverV2 ; Danijar Hafner, Timothy Lillicrap, Mohammad Norouzi, Jimmy Ba  
• Dream to Control: Learning Behaviors by Latent Imagination [ blog ] Dreamer ; Danijar Hafner, Timothy Lillicrap, Jimmy Ba, Mohammad Norouzi  
• Planning to Explore via Self-Supervised World Models ; Ramanan Sekar, Oleh Rybkin, Kostas Daniilidis, Pieter Abbeel, Danijar Hafner, Deepak Pathak