The Internet Is Not Okay After This Anthropic Employee Shared That He Quit His Job Over Fears That AI May Kill Us All
by Megan Liscomb · BuzzFeedPosted 1 hour ago
On Tuesday night, 27-year-old AI researcher Jacob Coxon posted a series of tweets that went megaviral, explaining his decision to quit his job at Anthropic, known for the AI model Claude.
Jacob is not the first in the industry to warn about the potential consequences of AI. Earlier this week, OpenAI chief scientist Jakub Pachocki published a blog post in which he wrote, "I am concerned no one is prepared for the consequences of a continued rapid rise in machine intelligence."
But Jacob's warning is particularly disturbing. In his viral thread, he writes, "The people building AI earnestly believe that it could kill us all by the end of the decade." As someone who would like to live to see 2031, that doesn't sound great!
In response, a lot of people are like, "Hey, please don't kill us all, thanks so much!"
At this point, you might be wondering, if so many people who work in AI are concerned about its ramifications, why do they continue doing what they do? According to Jacob, it comes down to competition.
Or, as this Twitter user very eloquently summed it up, "If I don’t build the Dick Smashing Machine, someone else will build the Dick AND BALL Smashing Machine…"
Jacob ended his thread with a callout to other AI researchers to think carefully about what they are doing. He writes, "Should you put your head down because 'it's happening anyway' - or take this moment to call for different conditions?"
Evan Hubinger, alignment science lead at Anthropic, also chimed in on the thread, claiming that "we really do earnestly believe AI could kill all humans!" Evan went on to clarify that he thinks the risk of current AI models wiping out humanity is "low," but he worries about how future models capable of self-improvement might behave.
In case you didn't know, AI alignment is a field of study that looks into how we can teach AI to behave as ethically, helpfully, and safely as possible.