#162 - Udio Song AI, TPU v5, Mixtral 8x22, Mixture-of-Depths, Musicians sign open letter

Our 162nd episode with a summary and discussion of last week's big AI news!

Read out our text newsletter and comment on the podcast at https://lastweekin.ai/

Email us your questions and feedback at [email protected] and/or [email protected]

Timestamps + links:

Tools & Apps

(00:02:50) AI-Music Arms Race: Meet Udio, the Other ChatGPT for Music

(00:07:42) Anthropic launches external tool use for Claude AI, enabling stock ticker integrations and more

(00:11:51) Building LLMs for Code Repair

(00:14:16) Early Reviews of Humane AI Pin Aren’t Impressed

(00:16:23) Microsoft 365’s Copilot gets a GPT-4 Turbo upgrade and improved image generation

(00:18:41) AI editing tools are coming to all Google Photos users

Applications & Business

(00:19:21) Google announces the Cloud TPU v5p, its most powerful AI accelerator yet

(00:23:32) Meta unveils its newest custom AI chip as it races to catch up

(00:27:27) Intel Unveils New AI Accelerator in Bid to Challenge Nvidia

(00:30:46) Adobe Is Buying Videos for $3 Per Minute to Build AI Model

(00:32:55) OpenAI transcribed over a million hours of YouTube videos to train GPT-4

(00:36:23) Waymo will launch paid robotaxi service in Los Angeles on Wednesday

(00:37:23) OpenAI removes Sam Altman's ownership of its Startup Fund

Projects & Open Source

(00:39:51) Mistral AI Stuns With Surprise Launch of New Mixtral 8x22B Model

(00:43:54) Google updates its Gemma AI model family with variants for coding and research

(00:47:04) Aurora-M: The First Open Source Multilingual Language Model Red-teamed according to the U.S. Executive Order

Research & Advancements

(00:52:08) Mixture-of-Depths: Dynamically allocating compute in transformer-based language models

(00:57:41) Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

(01:03:31) Octopus v2: On-device language model for super agent

(01:07:54) Bigger is not Always Better: Scaling Properties of Latent Diffusion Models

(01:09:54) Many-shot Jailbreaking

Policy & Safety

(01:15:08) Schiff unveils AI training transparency measure

(01:20:25) Linwei Ding was a Google software engineer. He was also a prolific thief of trade secrets, say prosecutors.

(01:26:11) Responsible Reporting for Frontier AI Development

(01:30:08) US govt wants to talk to tech companies about AI electricity demands — eyes nuclear fusion and fission

(01:32:39) Washington state judge blocks use of AI-enhanced video as evidence in possible first-of-its-kind ruling

(01:36:45) Trudeau announces $2.4 billion for AI-related investments

Synthetic Media & Art

(01:39:26) Billie Eilish, Pearl Jam, Nicki Minaj Among 200 Artists Calling for Responsible AI Music Practices

Fun!

(01:41:52) OpenAI's Sora just made its first music video and it's like a psychedelic trip