LessWrong (30+ Karma)

“Coherence of Caches and Agents” by johnswentworth


Listen Later

There's a lot of confusion about what coherence means for agents, and what "coherence theorems" do and don't say about agents. In this post, I'll talk about some particularly simple notions of coherence in a particularly simple setting. We'll see what nontrivial things coherence has to say, at least in a simple kind of environment, starting with an analogous notion of coherence for caches.

What Kind Of "Coherence" We're Talking About Here

Let's start with a standard CS-101-style example. We write a recursive python function to compute fibonacci numbers:

def fib(n):
if n == 0:
result = 1
elif n == 1:
result = 1
else:
result = fib(n-1) + fib(n-2)
return result

We pass in n = 0, then n = 1, then 2, then 3, etc. It spits out 1, 1, 2, 3, 5, 8, .... Great. Buuuuut it gets very slow very quickly as n increases; the [...]

---

Outline:

(00:28) What Kind Of Coherence Were Talking About Here

(04:52) Value Cache

(09:57) Generalization: Agents Value Function/Cache

(11:49) Coherence Is Not Utility-Dependent

(14:23) Coherence of Policies

(19:43) Summary and Takeaways

---

First published:

April 1st, 2024

Source:

https://www.lesswrong.com/posts/wjFijaAkSCceqCgGF/coherence-of-caches-and-agents

---

Narrated by TYPE III AUDIO.

...more
View all episodesView all episodes
Download on the App Store

LessWrong (30+ Karma)By LessWrong


More shows like LessWrong (30+ Karma)

View all
The Daily by The New York Times

The Daily

113,075 Listeners

Astral Codex Ten Podcast by Jeremiah

Astral Codex Ten Podcast

132 Listeners

Interesting Times with Ross Douthat by New York Times Opinion

Interesting Times with Ross Douthat

7,268 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

560 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,492 Listeners

AI Article Readings by Readings of great articles in AI voices

AI Article Readings

4 Listeners

Doom Debates! by Liron Shapira

Doom Debates!

14 Listeners

LessWrong posts by zvi by zvi

LessWrong posts by zvi

2 Listeners