No Priors: Artificial Intelligence | Technology | Startups

The Timeline for Realistic 4-D: Devi Parikh from Meta on Research Hurdles for Generative AI in Video and Multimodality


Listen Later

Video dominates modern media consumption, but video creation is still expensive and difficult. AI-generated and edited video is a holy grail of democratized creative expression. This week on No Priors, Sarah Guo and Elad Gil sit down with Devi Parikh. She is a Research Director in Generative AI at Meta and an Associate Professor in the School of Interactive Computing at Georgia Tech. Her work focuses on multimodality and AI for images, audio and video. Recently, she worked on Make a Video 3D, also called MAV3D, which creates animations from text prompts. She is also a talented AI-generated and analog artist herself.

Elad, Sarah and Devi talk about what’s exciting in computer vision, what’s blocking researchers from fully immersive Generative 4-D, and AI controllability.

No Priors is now on YouTube! Subscribe to the channel on YouTube and like this episode.


Show Links:

  • Devi Parikh - Google Scholar 
  • Text-To-4D Dynamic Scene Generation named MAV3D (Make-A-Video3D)
  • Full Research Paper
  • Website with examples of image to 4 D generation
  • Devi’s Substack

  • Sign up for new podcasts every week. Email feedback to [email protected]

    Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @DeviParikh


    Show Notes:

    (0:00:06) - Democratizing Creative Expression With AI-Generated Video

    (0:08:31) - Challenges in Video Generation Research

    (0:15:57) - Challenges and Implications of Video Processing

    (0:20:43) - Control and Multi-Modal Inputs in Video

    (0:25:50) - Audio's Role in Visual Content

    (0:39:00) - Don't Self-Select & Devi’s tips for young researchers

    ...more
    View all episodesView all episodes
    Download on the App Store

    No Priors: Artificial Intelligence | Technology | StartupsBy Conviction

    • 4.4
    • 4.4
    • 4.4
    • 4.4
    • 4.4

    4.4

    111 ratings


    More shows like No Priors: Artificial Intelligence | Technology | Startups

    View all
    This Week in Startups by Jason Calacanis

    This Week in Startups

    1,270 Listeners

    a16z Podcast by Andreessen Horowitz

    a16z Podcast

    996 Listeners

    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

    510 Listeners

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

    432 Listeners

    Invest Like the Best with Patrick O'Shaughnessy by Colossus | Investing & Business Podcasts

    Invest Like the Best with Patrick O'Shaughnessy

    2,296 Listeners

    Y Combinator Startup Podcast by Y Combinator

    Y Combinator Startup Podcast

    210 Listeners

    Practical AI by Practical AI LLC

    Practical AI

    194 Listeners

    Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

    Machine Learning Street Talk (MLST)

    90 Listeners

    Dwarkesh Podcast by Dwarkesh Patel

    Dwarkesh Podcast

    332 Listeners

    The Logan Bartlett Show by by Redpoint Ventures

    The Logan Bartlett Show

    192 Listeners

    Latent Space: The AI Engineer Podcast by swyx + Alessio

    Latent Space: The AI Engineer Podcast

    63 Listeners

    BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

    BG2Pod with Brad Gerstner and Bill Gurley

    432 Listeners

    AI + a16z by a16z

    AI + a16z

    25 Listeners

    Lightcone Podcast by Y Combinator

    Lightcone Podcast

    17 Listeners

    Training Data by Sequoia Capital

    Training Data

    30 Listeners