LessWrong (30+ Karma)

[Linkpost] “Claude 3 Opus can operate as a Turing machine” by Gunnar_Zarncke


Listen Later

This is a linkpost for https://twitter.com/ctjlewis/status/1779740038852690393

Posted on Twitter:

  • Opus can operate as a Turing machine. 
  • given only existing tapes, it learns the rules and computes new sequences correctly. 
  • 100% accurate over 500+ 24-step solutions (more tests running). 
  • for 100% at 24 steps, the input tapes weigh 30k tokens*. 
  • GPT-4 cannot do this.

Here is the prompt code for the Turing machine: https://github.com/SpellcraftAI/turing

This is the fully general counterpoint to the @VictorTaelin's A::B challenge (he put money where his mouth is and got praise for that from Yudkowsky).

Attention is Turing Complete was a claim already in 2021:

Theorem 6 The class of Transformer networks with positional encodings is Turing complete. Moreover, Turing completeness holds even in the restricted setting in which the only non-constant values in positional embedding pos(n) of n, for n ∈ N, are n, 1/n, and 1/n2 , and Transformer networks have a single [...]

---

First published:

April 17th, 2024

Source:

https://www.lesswrong.com/posts/wbjXQtiWMcfo4EpM4/claude-3-opus-can-operate-as-a-turing-machine

Linkpost URL:
https://twitter.com/ctjlewis/status/1779740038852690393

---

Narrated by TYPE III AUDIO.

...more
View all episodesView all episodes
Download on the App Store

LessWrong (30+ Karma)By LessWrong


More shows like LessWrong (30+ Karma)

View all
The Daily by The New York Times

The Daily

113,004 Listeners

Astral Codex Ten Podcast by Jeremiah

Astral Codex Ten Podcast

130 Listeners

Interesting Times with Ross Douthat by New York Times Opinion

Interesting Times with Ross Douthat

7,228 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

532 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,218 Listeners

AI Article Readings by Readings of great articles in AI voices

AI Article Readings

4 Listeners

Doom Debates by Liron Shapira

Doom Debates

14 Listeners

LessWrong posts by zvi by zvi

LessWrong posts by zvi

2 Listeners