GPT Reviews

OpenAI's plan to involve the public in AI governance through "Democratic Inputs to AI" is a promising idea. MiniCPM-2B, an edge-side large language model, outperforms many other models on comprehensive benchmarks. DeepSeekMath 7B achieved a score of 51.7% on the MATH benchmark for mathematical reasoning. V-IRL is a platform that enables AI agents to interact with the real world, opening up possibilities for practical applications such as disaster response and environmental monitoring.

Contact:  [email protected]

Timestamps:

00:34 Introduction

01:28 Inside OpenAI’s Plan to Make AI More ‘Democratic’

03:46 MiniCPM: Unveiling the Potential of End-side Large Language Models

05:06 Beyond Token Prediction: the post-Pretraining journey of modern LLMs

06:56 Fake sponsor

08:36 DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

10:19 Open RL Benchmark: Comprehensive Tracked Experiments for Reinforcement Learning

12:13 V-IRL: Grounding Virtual Intelligence in Real Life

13:54 Outro

Google is revamping its Bard chatbot under a new name, Gemini, with the launch of the highly anticipated Gemini Ultra model.

Hugging Face has launched an open source assistant creator, allowing users to create customizable AI assistants with just two clicks.

OpenAI has released a VisionOS ChatGPT app for the Apple Vision Pro, bringing AI and AR together.

Three interesting research papers were discussed, including Nomic Embed, Boximator, and StepCoder, all making strides in the field of AI.

Contact:  [email protected]

Timestamps:

00:34 Introduction

01:38 Leaked doc reveals Bard rebrand and Gemini Ultra launch

02:56 Hugging Face launches open source assistant creator

04:09 AI meets AR as ChatGPT is now available on the Apple Vision Pro

05:36 Fake sponsor

07:15 Nomic Embed: Training a Reproducible Long Context Text Embedder

08:34 Boximator: Generating Rich and Controllable Motions for Video Synthesis

10:11 StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback

11:48 Outro

AI to sift through body-cam footage, a comprehensive guide to AI in February 2024, the impact of utterance lengths on conversation models, and a new benchmark for testing the planning capabilities of language agents.

Contact:  [email protected]

Timestamps:

00:34 Introduction

01:29 Police Departments Are Turning to AI to Sift Through Millions of Hours of Unreviewed Body-Cam Footage

03:29 Your guide to AI: February 2024

04:45 Running Open-Source AI Models Locally With Ruby

06:08 Fake sponsor

08:10 Making a Long Story Short in Conversation Modeling

09:59 Large Language Models for Mathematical Reasoning: Progresses and Challenges

11:28 TravelPlanner: A Benchmark for Real-World Planning with Language Agents

13:28 Outro

Major AI players like Microsoft, Google, AMD, and Nvidia took a hit after their latest earnings reports failed to impress investors.

Meta is rolling out a new custom AI chip called Artemis in their data centers this year, which will complement the Nvidia H100 chips they've acquired.

Amazon has announced an AI-based shopping assistant called Rufus, which uses generative artificial intelligence to help users search for products.

The papers discussed in this episode cover topics such as open language models, enhancing the Winograd Schema Challenge, and mitigating reward overfitting and overoptimization in RLHF.

Contact:  [email protected]

Timestamps:

00:34 Introduction

01:37 AI companies lose $190 billion in market cap after Alphabet and Microsoft report

03:17 Exclusive: Meta to deploy in-house custom chips this year to power AI drive - memo

04:49 Amazon announces AI shopping assistant called Rufus

06:05 Fake sponsor

08:01 OLMo: Accelerating the Science of Language Models

09:22 WSC+: Enhancing The Winograd Schema Challenge Using Tree-of-Experts

11:15 Iterative Data Smoothing: Mitigating Reward Overfitting and Overoptimization in RLHF

12:58 Outro

Elon Musk's Neuralink implanting a chip in its first human brain, OpenAI exploring AI chip collaboration with Samsung and SK Group, and papers proposing new algorithms to improve the robustness of language models and enhance open-vocabulary object detection.

Contact:  [email protected]

Timestamps:

00:34 Introduction

01:48 Elon Musk says his Neuralink startup has implanted a chip in its first human brain

03:14 OpenAI CEO Sam Altman explores AI chip collaboration with Samsung and SK Group

04:59 Building an early warning system for LLM-aided biological threat creation

06:17 Fake sponsor

08:22 H2O-Danube-1.8B Technical Report

09:45 Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attacks

11:29 YOLO-World: Real-Time Open-Vocabulary Object Detection

13:05 Outro

Hallucinations Leaderboard, AI Chip Startup Rebellions challenging Nvidia, and Microsoft's "Future of Work" report. Our experts also discuss innovative papers that focus on improving the efficiency and effectiveness of Large Language Models (LLMs) and Large Vision-Language Models (LVLMs) through new training strategies and architectures.

Contact:  [email protected]

Timestamps:

00:34 Introduction

01:25 The Hallucinations Leaderboard, an Open Effort to Measure Hallucinations in Large Language Models

03:22 AI Chip Startup Rebellions Snags Funding to Challenge Nvidia

05:06 Microsoft New Future of Work Report 2023

06:21 Fake sponsor

08:10 Scaling Sparse Fine-Tuning to Large Language Models

10:02 Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling

11:25 MoE-LLaVA: Mixture of Experts for Large Vision-Language Models

13:26 Outro

Google's Bard AI outperforms GPT-4 in HuggingFace's Chatbot Arena Leaderboard, while OpenAI partners with Common Sense Media to curate "family-friendly" chatbots in the GPT Store. The episode also delves into two fascinating research papers: SliceGPT introduces a new post-training sparsification scheme that reduces model parameters and maintains performance, while Investigate-Consolidate-Exploit (ICE) promotes the transfer of knowledge between tasks for genuine self-evolution, leading to more robust and autonomous AI agents.

Contact:  [email protected]

Timestamps:

00:34 Introduction

01:36 Bard from Google Outperforms GPT-4 in LLMSys Arena Benchmark

02:56 OpenAI partners with Common Sense Media to collaborate on AI guidelines

04:42 What I Talk About When I Talk About Query Optimizer (Part 1): IR Design

05:45 Fake sponsor

07:45 SliceGPT: Compress Large Language Models by Deleting Rows and Columns

09:48 Investigate-Consolidate-Exploit: A General Strategy for Inter-Task Agent Self-Evolution

11:40 Tweets to Citations: Unveiling the Impact of Social Media Influencers on AI Research Visibility

13:24 Outro

Google's Lumiere AI model for video generation, Nvidia's RTX GPUs using AI to upgrade SDR content to HDR, China's newest dark matter lab, CJPL-II, and MaLA-500, a large language model designed to cover 534 languages. These advancements showcase the immense progress in AI research and are expected to revolutionize video generation, language modeling, and dark matter research.

Contact:  [email protected]

Timestamps:

00:34 Introduction

01:34 Google Releases Lumiere, a New Video Generation AI

03:12 Nvidia’s RTX GPUs can now upgrade SDR content to HDR using AI

05:03 China's new dark matter lab is biggest and deepest yet

06:42 Fake sponsor

08:25 MambaByte: Token-free Selective State Space Model

09:49 VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks

11:34 MaLA-500: Massive Language Adaptation of Large Language Models

13:09 Outro

Google is using AI to enhance user experience and productivity in Chrome, while OpenAI's lack of transparency could damage their reputation in the industry. We also discuss GALA, a framework that can decompose a single-layer clothed 3D human mesh into complete multi-layered 3D assets, and AutoRT, which leverages vision-language models to enable autonomous robot learning.

Contact:  [email protected]

Timestamps:

00:34 Introduction

01:33 Google is using AI to organize and customize your Chrome browser

02:44 Google cancels contract with an AI data firm that’s helped train Bard

04:05 OpenAI Quietly Scrapped a Promise to Disclose Key Documents to the Public

05:41 Fake sponsor

07:26 GALA: Generating Animatable Layered Assets from a Single Scan

09:40 AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents

11:22 Multilingual and Fully Non-Autoregressive ASR with Large Language Model Fusion: A Comprehensive Study

13:16 Outro

Microsoft was hit by another nation-state attack, this time by the same Russian group behind the SolarWinds attack.

ElevenLabs, a startup that just landed $80 million in funding and achieved unicorn status, is making it easier than ever to replace human voice actors with AI-generated voices.

TextReader.ai is a free text-to-speech generator with some of the most realistic AI voices.

"Is the Emergence of Life an Expected Phase Transition in the Evolving Universe?" challenges our current ideas about the emergence of life and opens up new avenues for research.

Contact:  [email protected]

Timestamps:

00:34 Introduction

01:25 Microsoft ‘senior leadership’ emails accessed by Russian SolarWinds hackers

03:18 Voice cloning startup ElevenLabs lands $80M, achieves unicorn status

05:29 Text Reader - Free text to speech generator with realistic AI voices

06:45 Fake sponsor

08:33 Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Text

10:10 Is the Emergence of Life an Expected Phase Transition in the Evolving Universe?

11:57 EmerDiff: Emerging Pixel-level Semantic Knowledge in Diffusion Models

13:45 Outro