This Day in AI Podcast

EP52: The Groq Breakthrough, Google's Gemma 7B, Unlimited Context, Can 'Magic' Reason?

02.22.2024 - By Michael Sharkey, Chris SharkeyPlay

Download our free app to listen on your phone

Download on the App StoreGet it on Google Play

Show notes: https://thisdayinai.com/bookmarks/32-ep52

Groq Mixtral: https://simtheory.ai/agent/567-groq-mixtral-edition

Groq Llama: https://simtheory.ai/agent/566-groq-the-speed-oriented-chat-companion

SimTheory: https://simtheory.ai

====

This week we discuss Groq's LPU Chips and the implications of low cost low latency LLMs on custom hardware. We revisit our prank calling to see if Groq's low latency gives an advantage and see if we can improve Air Canada's chatbot. We discuss the launch of Google's Open Source Gamma 7B release and Magic's $148M fundraise for an AI co-worker who can reason. We also cover ChatGPT losing it's mind during the week. If you like the show, please consider subscribing. Thanks for listening. ====

Chapters:

00:00 - Groq, Groq API and Retell with Groq

32:48 - Google Gemma 7B Open Source Model

39:04 - The 'Magic' Breakthrough on Reasoning and Context

50:19 - Sounds for OpenAI Sora Thanks to ElevenLabs Sound FX

51:59 - ChatGPT Goes Haywire

More episodes from This Day in AI Podcast