
Sign up to save your podcasts
Or


"OK, let's get this meeting started. We're all responsible for development of this new advanced intelligence 'John'. We want John to have some kids with our genes, instead of just doing stuff like philosophy or building model trains, and this meeting is to discuss how we can ensure John tries to do that."
"It's just a reinforcement learning problem, isn't it? We want kids to happen, so provide positive reinforcement when that happens."
"How do we make sure the kids are ours?"
"There's a more fundamental problem than that: without intervention earlier on, that positive reinforcement will never happen."
"OK, so we need some guidance earlier on. Any suggestions?"
"To start, having other people around is necessary. How about some negative reinforcement if there are no other humans around for some period of time?"
"That's a good one, also helps with some other [...]
---
First published:
Source:
Narrated by TYPE III AUDIO.
By LessWrong"OK, let's get this meeting started. We're all responsible for development of this new advanced intelligence 'John'. We want John to have some kids with our genes, instead of just doing stuff like philosophy or building model trains, and this meeting is to discuss how we can ensure John tries to do that."
"It's just a reinforcement learning problem, isn't it? We want kids to happen, so provide positive reinforcement when that happens."
"How do we make sure the kids are ours?"
"There's a more fundamental problem than that: without intervention earlier on, that positive reinforcement will never happen."
"OK, so we need some guidance earlier on. Any suggestions?"
"To start, having other people around is necessary. How about some negative reinforcement if there are no other humans around for some period of time?"
"That's a good one, also helps with some other [...]
---
First published:
Source:
Narrated by TYPE III AUDIO.

112,909 Listeners

130 Listeners

7,215 Listeners

532 Listeners

16,221 Listeners

4 Listeners

14 Listeners

2 Listeners