A special non-news episode in which Andrey and Jeremie discussion AI X-Risk!
Please let us know if you'd like use to record more of this sort of thing by emailing contact@lastweekin.ai or commenting whether you listen.
Outline:
(00:00) Intro(03:55) Topic overview(10:22) Definitions of terms(35:25) AI X-Risk scenarios(41:00) Pathways to Extinction(52:48) Relevant assumptions(58:45) Our positions on AI X-Risk(01:08:10) General Debate(01:31:25) Positive/Negative transfer(01:37:40) X-Risk within 5 years (01:46:50) Can we control an AGI(01:55:22) AI Safety Aesthetics(02:00:53) Recap(02:02:20) Outer vs inner alignment(02:06:45) AI safety and policy today(02:15:35) Outro
Links
Taxonomy of Pathways to Dangerous AI
Clarifying AI X-risk
Existential Risks and Global Governance Issues Around AI and Robotics
Current and Near-Term AI as a Potential Existential Risk Factor
AI x-risk, approximately ordered by embarrassment
Classification of Global Catastrophic Risks Connected with Artificial Intelligence
X-Risk Analysis for AI Research
The Alignment Problem from a Deep Learning Perspective

AI and Existential Risk - Overview and Discussion

Weekly summaries and discussion about the most interesting developments in AI, deep learning, robotics, and more!

Technology

Tech News

Podcasting

Gadgets

Software How-To

News

Our 166th episode with a summary and discussion of last week's big AI news!
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/
Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai
Timestamps + links:
(00:00:00) Intro / Banter
Tools & Apps(00:04:23) ElevenLabs previews music-generating AI model
(00:09:31) Mysterious “gpt2-chatbot” AI model appears suddenly, confuses experts
(00:13:00) SoundHound AI and Perplexity Partner to Bring Online LLMs to Next Gen Voice Assistants Across Cars and IoT Devices
(00:14:50) Stability AI sows gen AI discord with Stable Artisan
(00:16:35) Apple Will Revamp Siri to Catch Up to Its Chatbot Competitors
(00:18:54) Alibaba rolls out latest version of its large language model to meet robust AI demand

Applications & Business(00:19:34) OpenAI and Stack Overflow partner to bring more technical knowledge into ChatGPT
(00:17:31) New Microsoft AI model may challenge GPT-4 and Google Gemini
(00:31:08) Wayve, an A.I. Start-Up for Autonomous Driving, Raises $1 Billion
(00:32:00) Motional delays commercial robotaxi plans amid restructuring
(00:33:54) The rise of the Chinese AI unicorns doing battle with OpenAI

Projects & Open Source(00:35:25) Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models
(00:40:12) DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
(00:44:31) OpenVoice V2: Evolving Multilingual Voice Cloning with Enhanced Style Control and Cross-Lingual Capabilities
(00:45:20) Granite Code Models: A Family of Open Foundation Models for Code Intelligence
(00:46:00) Hugging Face launches LeRobot open source robotics code library
(00:48:50) Vibe-Eval: A new open and hard evaluation suite for measuring progress of multimodal language models

Research & Advancements(00:50:02) Google DeepMind’s Groundbreaking AI for Protein Structure Can Now Model DNA
(00:57:20) xLSTM: Extended Long Short-Term Memory
(01:06:35) StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation
(01:07:55) Chain of Thought Empowers Transformers to Solve Inherently Serial Problems
(01:11:48) KAN: Kolmogorov-Arnold Networks

Policy & Safety(01:13:20) US lawmakers unveil bill to make it easier to restrict exports of AI models
(01:17:30) OpenAI’s Model Spec outlines some basic rules for AI
(01:20:18) Robot dogs armed with AI-targeting rifles undergo US Marines Special Ops evaluation
(01:25:15) OpenAI Releases ‘Deepfake’ Detector to Disinformation Researchers

Synthetic Media & Art(01:28:15) Audible’s Test of AI-Voiced Audiobooks Tops 40,000 Titles
(01:32:30) TikTok will automatically label AI-generated content created on platforms like DALL·E 3
(01:33:23) Katy Perry's Fan-Made AI Image Is So Real It Fooled the World Into Thinking She Was at the Met Gala
(01:35:32) South Korean woman falls for deepfake Elon Musk, loses $50K in romance scam 
(01:37:18) Why young Russian women appear so eager to marry Chinese men

(01:40:18) AI Outro Song

#166 - new AI song generator, Microsoft's GPT4 efforts, AlphaFold3, xLSTM, OpenAI Model Spec

Our 165th episode with a summary and discussion of last week's big AI news!
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/
Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai
Timestamps + links:
Tools & Apps(00:01:27) GitHub releases an AI-powered tool aiming for a 'radically new way of building software'
(00:07:05) China unveils Sora challenger able to produce videos from text similar to OpenAI tool, though much shorter
(00:12:23) ChatGPT’s AI ‘memory’ can remember the preferences of paying customers
(00:14:21) Rabbit R1 review: Avoid this AI gadget
(00:18:30) Amazon Q, a generative AI-powered assistant for businesses and developers, is now generally available
(00:19:54) Yelp’s Assistant AI bot will do all the talking to help users find service providers

Applications & Business(00:21:31) Video of super-fast, super-smooth humanoid robot will drop your jaw
(00:25:22) Tesla’s 2 million car Autopilot recall is now under federal scrutiny
(00:29:32) Tesla shares soar as Elon Musk returns from China with FSD 'Game Changer'
(00:32:11) OpenAI inks strategic tie-up with UK’s Financial Times, including content use
(00:35:21) OpenAI Startup Fund quietly raises $15M
(00:37:00) Huawei backs HBM memory manufacturing in China to sidestep crippling US sanctions that restrict AI development

Research & Advancements(00:39:20) Capabilities of Gemini Models in Medicine
(00:45:34) Let's Think Dot by Dot: Hidden Computation in Transformer Language Models
(00:52:20) NExT: Teaching Large Language Models to Reason about Code Execution
(00:55:08) SenseNova 5.0: China’s latest AI model surpasses OpenAI’s GPT-4
(00:57:20) Octopus v4: Graph of language models
(01:00:28) Better & Faster Large Language Models via Multi-token Prediction

Policy & Safety(01:03:15) Refusal in LLMs is mediated by a single direction
(01:09:19) Rishi Sunak promised to make AI safe. Big Tech’s not playing ball.
(01:15:09) DOE Announces New Actions to Enhance America’s Global Leadership in Artificial Intelligence
(01:18:21) The Chips Act is rebuilding US semiconductor manufacturing, so far resulting in $327 billion in announced projects
(01:20:50) Analysis-Second global AI safety summit faces tough questions, lower turnout
(01:24:03) Sam Altman, Jensen Huang, and more join the federal AI safety board

Synthetic Media & Art(01:26:30) Air Head creators say OpenAI's Sora finicky to work with, needs hundreds of prompts, serious VFX work for under 2 minutes of cohesive story ↺
(01:29:50) Eight newspaper publishers sue OpenAI over copyright infringement

#165 - Sora challenger, Astribot's S1, Med-Gemini, Refusal in LLMs

Our 164th episode with a summary and discussion of last week's big AI news!
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/
Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai
Timestamps + links:
Tools & Apps
(00:04:02) Meta, in Its Biggest A.I. Push, Places Smart Assistants Across Its Apps
(00:07:26) Microsoft launches Phi-3, its smallest AI model yet
(00:15:35) The Ray-Ban Meta Smart Glasses have multimodal AI now
(00:17:32) OpenAI winds down AI image generator that blew minds and forged friendships in 2022
(00:18:44) Baidu claims 200 million users for Ernie chatbot after only 13 months
(00:21:13) The new Adobe Photoshop gets an in-app image generator, major Generative Fill upgrades

Applications & Business
(00:22:22) Intel & The Pentagon Deepen Ties To Develop World’s Most Advanced Chips
(00:27:58) Meta Says It Plans to Spend Billions More on A.I.
(00:31:36) OpenAI CEO Sam Altman invests in solar power firm Exowatt to fuel AI datacenters
(00:33:58) Google consolidates AI-focused DeepMind, Research teams
(00:36:22) Microsoft and OpenAI bet $100 billion to free themselves from the shackles and overreliance on the world's most profitable semiconductor chip brand for AI chips

Projects & Open Source
(00:39:03) Apple releases OpenELM: small, open source AI models designed to run on-device
(00:44:12) Snowflake launches Arctic, an open ‘mixture-of-experts’ LLM to take on DBRX, Llama 3

Research & Advancements
(00:48:08) The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions
(00:55:11) Groq’s breakthrough AI chip achieves blistering 800 tokens per second on Meta’s LLaMA 3
(00:59:52) Microsoft shows off VASA-1, an AI framework that makes human headshots talk, sing
(01:01:59) Intel Builds World’s Largest Neuromorphic System to Enable More Sustainable AI

Policy & Safety
(01:05:11) Deepfakes of Bollywood stars spark worries of AI meddling in India election
(01:08:51) LLM Agents can Autonomously Exploit One-day Vulnerabilities
(01:15:27) The Necessity of AI Audit Standards Boards
(01:19:45) A Mechanism-Based Approach to Mitigating Harms from Persuasive Generative AI
(01:22:45) COERCING LLMS TO DO AND REVEAL (ALMOST) ANYTHING
(01:26:40) China acquired recently banned Nvidia chips in Super Micro, Dell servers, tenders show

Synthetic Media & Art
(01:29:08) Drake threatened with lawsuit over diss track featuring AI Tupac

#164 - Meta AI, Phi-3, OpenELM, Bollywood Deepfakes

Our 163rd episode with a summary and discussion of last week's big AI news!
Note: apology for this one coming out a few days late, got delayed in editing it -Andrey
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/
Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai
Timestamps + links:
Intro / Banter
Tools & Apps
(00:02:16) Meta releases Llama 3, claims it’s among the best open models available
(00:14:01) Elon Musk’s xAI Unveils Grok-1.5 Vision, Beats OpenAI’s GPT-4V
(00:17:55) Reka releases Reka Core, its multimodal language model to rival GPT-4 and Claude 3 Opus
(00:21:50) Cohere Compass Private Beta: A New Multi-Aspect Embedding Model
(00:23:48) Amazon Music’s Maestro lets listeners make AI playlists
(00:24:36) Snap plans to add watermarks to images created with its AI-powered tools

Applications & Business
(00:25:52) Boston Dynamics unveils new Atlas robot for commercial use
(00:30:32) TSMC’s $65 billion bet still leaves US missing piece of chip puzzle
(00:36:30) U.S. blacklists Intel's and Nvidia's key partner in China — three other Chinese firms also included in the blacklist for helping the military
(00:38:37) Elon Musk says the next-generation Grok 3 model will require 100,000 Nvidia H100 GPUs to train
(00:40:22) Dr. Andrew Ng appointed to Amazon’s Board of Directors
(00:41:55) Collaborative Robotics Locks Up $100M, Latest Robot Startup To Raise Big

Projects & Open Source
(00:44:08) OpenEQA: Embodied Question Answering in the Era of Foundation Models
(00:50:03) Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

Research & Advancements
(00:51:21) RHO-1: Not All Tokens Are What You Need
(00:57:21) Scaling Laws for Fine-Grained Mixture of Experts
(01:03:20) Chinchilla Scaling: A replication attempt
(01:07:18) China develops new light-based chiplet that could power artificial general intelligence — where AI is smarter than humans
(01:10:45) OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

Policy & Safety
(01:13:44) U.S. Commerce Secretary Gina Raimondo Announces Expansion of U.S. AI Safety Institute Leadership Team
(01:17:18) NSA Publishes Guidance for Strengthening AI System Security
(01:19:19) Foundational Challenges in Assuring Alignment and Safety of Large Language Models
(01:24:11) Former OpenAI Board Member Calls for Audits of Top AI Companies
(01:27:35) SoA survey reveals a third of translators and quarter of illustrators losing work to AI

Synthetic Media & Art
(01:30:25) Medium bans AI-generated content from its paid Partner Program

#163 - Llama 3, Grok-1.5 Vision, new Atlas robot, RHO-1, Medium ban

Our 162nd episode with a summary and discussion of last week's big AI news!
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/
Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai
Timestamps + links:
Tools & Apps
(00:02:50) AI-Music Arms Race: Meet Udio, the Other ChatGPT for Music
(00:07:42) Anthropic launches external tool use for Claude AI, enabling stock ticker integrations and more
(00:11:51) Building LLMs for Code Repair
(00:14:16) Early Reviews of Humane AI Pin Aren’t Impressed
(00:16:23) Microsoft 365’s Copilot gets a GPT-4 Turbo upgrade and improved image generation
(00:18:41) AI editing tools are coming to all Google Photos users

Applications & Business
(00:19:21) Google announces the Cloud TPU v5p, its most powerful AI accelerator yet
(00:23:32) Meta unveils its newest custom AI chip as it races to catch up
(00:27:27) Intel Unveils New AI Accelerator in Bid to Challenge Nvidia
(00:30:46) Adobe Is Buying Videos for $3 Per Minute to Build AI Model
(00:32:55) OpenAI transcribed over a million hours of YouTube videos to train GPT-4
(00:36:23) Waymo will launch paid robotaxi service in Los Angeles on Wednesday
(00:37:23) OpenAI removes Sam Altman's ownership of its Startup Fund

Projects & Open Source
(00:39:51) Mistral AI Stuns With Surprise Launch of New Mixtral 8x22B Model
(00:43:54) Google updates its Gemma AI model family with variants for coding and research
(00:47:04) Aurora-M: The First Open Source Multilingual Language Model Red-teamed according to the U.S. Executive Order

Research & Advancements
(00:52:08) Mixture-of-Depths: Dynamically allocating compute in transformer-based language models
(00:57:41) Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
(01:03:31) Octopus v2: On-device language model for super agent
(01:07:54) Bigger is not Always Better: Scaling Properties of Latent Diffusion Models
(01:09:54) Many-shot Jailbreaking

Policy & Safety
(01:15:08) Schiff unveils AI training transparency measure
(01:20:25) Linwei Ding was a Google software engineer. He was also a prolific thief of trade secrets, say prosecutors.
(01:26:11) Responsible Reporting for Frontier AI Development
(01:30:08) US govt wants to talk to tech companies about AI electricity demands — eyes nuclear fusion and fission
(01:32:39) Washington state judge blocks use of AI-enhanced video as evidence in possible first-of-its-kind ruling
(01:36:45) Trudeau announces $2.4 billion for AI-related investments

Synthetic Media & Art
(01:39:26) Billie Eilish, Pearl Jam, Nicki Minaj Among 200 Artists Calling for Responsible AI Music Practices

Fun!
(01:41:52) OpenAI's Sora just made its first music video and it's like a psychedelic trip

AI and Existential Risk - Overview and Discussion

Download our free app to listen on your phone