The agent-like structure problem is a question about how agents in the world are structured. I think rationalists generally have an intuition that the answer looks something like the following:

• We assume the world follows some evolution law, e.g. maybe deterministically like _x_{n+1} = f(x_n)_, or maybe something stochastic. The intuition being that these are fairly general models of the world, so they should be able to capture whatever there is to capture. _x_ here has some geometric structure, and we want to talk about areas of this geometric structure where there are agents. 
• An agent is characterized by a Markov blanket in the world that has informational input/output channels for the agent to get information to observe the world and send out information to act on it, intuitively because input/output channels are the most general way to model a relationship between two systems, and to embed one system within another [...]

---

Outline:

(02:47) Radical computationalism is killed by information overload

(04:59) Energy-orientation solves information overload

(06:35) ... kinda

---

First published:

Source:

Narrated by TYPE III AUDIO.