Dailyhunt
AI safety at crossroads? Anthropic leader resigns after dropping stark warning

AI safety at crossroads? Anthropic leader resigns after dropping stark warning

Mathrubhumi English 3 months ago

Mrinank Sharma, who led the safeguards research team at Anthropic, announced his resignation from the AI company on Monday, publishing a cryptic letter that warned of a world "in peril" and hinted at tensions between organizational values and actions.

The departure letter, shared on X, had garnered nearly one million views by Monday afternoon.

In his letter to colleagues, Sharma wrote that "the world is in peril. And not just from AI, or bioweapons, but from a whole series of interconnected crises unfolding in this very moment". He added: "We appear to be approaching a threshold where our wisdom must grow in equal measure to our capacity to affect the world, lest we face the consequences".

Tensions Over Values

While Sharma did not offer specific details, he suggested that Anthropic may have struggled to live up to its public image as a safety-focused AI company. "Throughout my time here, I've repeatedly seen how hard it is to truly let our values govern our actions," he wrote. "I've seen this within myself, within the organization, where we constantly face pressures to set aside what matters most".

Sharma, who holds a PhD in Statistical Machine Learning from the University of Oxford, joined Anthropic in August 2023. During his tenure, he worked on understanding AI sycophancy, developing defenses against AI-assisted bioterrorism, and researching how AI assistants could "distort our humanity"

Departure Amid Product Push

The resignation comes just days after Anthropic released Claude Opus 4.6, an upgraded AI model designed for enhanced coding and office productivity. The company is also in talks to raise a funding round that would value it at $350 billion, according to CNBC.

Sharma is not the only notable departure from Anthropic in recent months. Researchers Harsh Mehta and Behnam Neyshabur left the company last week to "start something new," while Dylan Scandinaro departed for OpenAI. Business Insider reported that while the exits occurred close together, they appear to be independent moves

Sharma indicated he has no immediate next move planned. He wrote that he may pursue a degree in poetry and "commit myself to the practice of bold expression," adding he wants to "contribute in a manner that aligns with my integrity". He said he would return to the UK in the meantime.

Dailyhunt
Disclaimer: This content has not been generated, created or edited by Dailyhunt. Publisher: Mathrubhumi English