LessWrong (30+ Karma)

“Can SAE steering reveal sandbagging?” by jordine, Hoang Khiem, Felix Hofstätter


Listen Later

Summary 

  • We conducted a small investigation into using SAE features to recover sandbagged capabilities.
  • We used the Goodfire API to pick out 15 SAE features, 5 related to sandbagging, 5 related to general expertise, and 5 unrelated features.
  • We used these features to steer a Llama 3.3 70b Instruct that has been prompted to sandbag 
  • We observed that steering can recover up to ~25% of true capabilities
  • We observed that using sandbagging/deception/evaluation-awareness relevant features were slightly better than unrelated features, though results are mixed.
  • While steering with SAE features partially recovered capabilities, this is not as effective as other existing interventions

Introduction

During our work on linear probing for evaluation awareness, we thought about using evaluation-awareness relevant features to uncover sandbagging. Previous work demonstrated that you can add noise to weights or activations and recover capabilities from a prompted sandbagging model, and we thought it would be interesting [...]

---

Outline:

(00:12) Summary

(01:04) Introduction

(01:47) Methodology

(06:11) Results

(07:57) Limitations

(08:16) Discussion

(09:41) Acknowledgements

---

First published:

April 15th, 2025

Source:

https://www.lesswrong.com/posts/dBckLjYfTShBGZ8ma/can-sae-steering-reveal-sandbagging

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

...more
View all episodesView all episodes
Download on the App Store

LessWrong (30+ Karma)By LessWrong


More shows like LessWrong (30+ Karma)

View all
Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,336 Listeners

Conversations with Tyler by Mercatus Center at George Mason University

Conversations with Tyler

2,381 Listeners

The Peter Attia Drive by Peter Attia, MD

The Peter Attia Drive

8,016 Listeners

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

4,130 Listeners

ManifoldOne by Steve Hsu

ManifoldOne

90 Listeners

Your Undivided Attention by Tristan Harris and Aza Raskin, The Center for Humane Technology

Your Undivided Attention

1,487 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,263 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

91 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

421 Listeners

Hard Fork by The New York Times

Hard Fork

5,448 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

15,470 Listeners

Moonshots with Peter Diamandis by PHD Ventures

Moonshots with Peter Diamandis

502 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

129 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

72 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

463 Listeners