📆 | ⏱️ | 🏷️ computing

Robert Miles Makes Accessible AI Safety Videos

I remember being in class once introducing a small group of students to the AI safety problem as it pertains to long-term accidental risks. I was talking about some thought experiment like the paperclip maximizer while the group asked me many questions, each of which warranted their own discussion entirely.

The questions were along the lines of “Would it be like Terminator?”, “Why would it have a utility function?”, “Wouldn’t it be smart enough to realize maximizing paperclips is a dumb goal?”, “Why would it want to acquire resources or self-improve?”, “What makes you think it would become superintelligent?”, “Why couldn’t we just turn it off?”, so on and so forth. All great questions, but I unfortunately didn’t have the time to cover them all.

I realized that the group I was trying to teach lacked the necessary background to understand why the paperclip maximizer would behave the way I was describing. It’s not just lay people and students though. Many people who work in the field of AI are unaware of AI safety. Their job only requires them to think about how they can make their AI model less racially biased. It doesn’t require that they consider AI as an existential risk.

Maybe you don’t think it matters because that person isn’t intending to work on artificial general intelligence (AI as smart as or much smarter than humans). I would argue that that’s besides the point. We may live in a universe where the technological development path of AGI is such that it’s highly probable that it gets invented accidentally. In other words, someone with no intentions to invent AGI and only rudimentary understanding of AI safety ends up inventing it. That scenario would be disastrous for humanity.

One thing I think should be done to mitigate risk is to educate anyone who is willing to listen about the nature of the AI safety problem and why it’s so hard to solve. If you need an introduction to the problem or would like to educate someone you know who is working on AI, Robert Miles made an intro video which I highly recommend titled “Intro to AI Safety, Remastered”.

Robert Miles is a science communicator focused on AI safety and alignment. I’ve learned a lot from watching his AI safety videos. He makes them both informative and entertaining, especially for people like me who are more interested in AI for its implications for the future rather than all the technical details.

If that sounds like something you’re interested in, please check out his channel and support him however you can.