The Cloud Pod

303: Someday You Will Find Me, Caught Beneath the AI Landslide, in a Champagne Premier Nova in The Sky


Listen Later

Welcome to episode 303 of The Cloud Pod – where the forecast is always cloudy! Justin, Ryan and exhausted dad Matt are here (and mostly awake) ready to bring the latest in cloud news! This week we’ve got more news from Nova, updates to Claude, earnings news, and a mini funeral for Skype – plus a new helping of Cloud Journey!

Titles we almost went with this week:
  • Claude researches so Ryan can nap
  • The best AI for Nova Corps, Amazon Nova Premiere JB
  • If you can’t beat them, change the licensing terms and make them fork, and then 
  •      reverse course… and profit
  • Q has invaded your IDE!!
  • Skype bites the dust
  • A big thanks to this week’s sponsor:
    We’re sponsorless! Want to get your brand, company, or service in front of a very enthusiastic group of cloud news seekers? You’ve come to the right place! Send us an email or hit us up on our Slack channel for more info. 
    Follow Up 

    02:50 Sycophancy in GPT-4o: What happened and what we’re doing about it

    • OpenAI wrote up a blog post about their sycophantic Chat GPT 4o upgrade last week, and they wanted to set the record straight. 
    • They made adjustments at improving the models default personality to make it feel more intuitive and effective across a variety of tasks. 
    • When shaping model behavior, they start with a baseline principle and instructions outlined in their model spec. 
    • They also teach their models how to apply these principles by incorporating user signals like thumbs up and thumbs down feedback on responses. 
    • In this update, though, they focused too much on short-term feedback and did not fully account for how users’ interactions with ChatGPT evolve. This skewed the results towards responses that were overly supportive – but disingenuous. 
    • Beyond rolling back the changes, they are taking steps to realign the model behavior, including refining core training techniques and system prompts to explicitly steer the model away from sycophancy. 
    • They also plan to build more guardrails to increase honesty and transparency principles in the model spec.
    • Additionally, they plan to expand ways for users to test and give direct feedback before deployments.
    • Lastly, OpenAI continues to expand evaluations building on the model sync and our ongoing research. 
    • 04:43 Deep Research on Microsoft Hotpatching:

      • Yes, they’re grabbing money and screwing you. Basically. 
      • 07:06 Justin – “I’m not going to give them any credit on this one. I appreciate that they created hotpatching, but I don’t like what you want to charge me for it.” 

        General News

        It’s Earnings time – cue the sound effects!

        08:03 Alphabet’s Q1 earnings shattered analyst expectations, sending the stock 

        ...more
        View all episodesView all episodes
        Download on the App Store

        The Cloud PodBy Justin Brodley, Jonathan Baker, Ryan Lucas and Matthew Kohn

        • 4.9
        • 4.9
        • 4.9
        • 4.9
        • 4.9

        4.9

        33 ratings


        More shows like The Cloud Pod

        View all
        Software Engineering Radio - the podcast for professional software developers by se-radio@computer.org

        Software Engineering Radio - the podcast for professional software developers

        272 Listeners

        Risky Business by Patrick Gray

        Risky Business

        361 Listeners

        SANS Internet Stormcenter Daily Cyber Security Podcast (Stormcast) by Johannes B. Ullrich

        SANS Internet Stormcenter Daily Cyber Security Podcast (Stormcast)

        628 Listeners

        The Changelog: Software Development, Open Source by Changelog Media

        The Changelog: Software Development, Open Source

        283 Listeners

        Freakonomics Radio by Freakonomics Radio + Stitcher

        Freakonomics Radio

        32,202 Listeners

        Heavy Networking by Packet Pushers

        Heavy Networking

        325 Listeners

        The Cloudcast by Massive Studios

        The Cloudcast

        153 Listeners

        The Vergecast by The Verge

        The Vergecast

        3,669 Listeners

        LINUX Unplugged by Jupiter Broadcasting

        LINUX Unplugged

        265 Listeners

        Software Engineering Daily by Software Engineering Daily

        Software Engineering Daily

        624 Listeners

        AWS Podcast by Amazon Web Services

        AWS Podcast

        202 Listeners

        Kubernetes Podcast from Google by Abdel Sghiouar, Kaslin Fields

        Kubernetes Podcast from Google

        181 Listeners

        The Stack Overflow Podcast by The Stack Overflow Podcast

        The Stack Overflow Podcast

        64 Listeners

        Hard Fork by The New York Times

        Hard Fork

        5,420 Listeners

        Oxide and Friends by Oxide Computer Company

        Oxide and Friends

        47 Listeners