https://astralcodexten.substack.com/p/highlights-from-the-comments-on-acemoglu

Eugene Norman writes:

This…

“People have said climate change could cause mass famine and global instability by 2100. But actually, climate change is contributing to hurricanes and wildfires right now! So obviously those alarmists are wrong and nobody needs to worry about future famine and global instability at all.”

…isn’t a good analogy at all. Because nobody is arguing that climate change now doesn’t lead to increased climate change in the future. They are the same thing but accelerated. However there’s no certainty that narrow AI leads you a super intelligence. In fact it won’t. There’s no becoming self aware in the algorithms.

I’m against this for two reasons.

First, self-awareness is spooky. I honestly have no idea what self-awareness is or what it even potentially could be. I hate having this disc