Google updates Gemini mental health safeguards amid lawsuit over user’s suicide

Washington: Google said on Tuesday it is introducing changes to the mental health safeguards built into its Gemini artificial intelligence chatbot, as the company faces a wrongful death lawsuit that alleges the chatbot played a role in a user’s suicide.

The company said Gemini will now display a redesigned Help is available feature when conversations indicate possible mental health distress, with the aim of connecting users more quickly to crisis support.

According to Google, when Gemini identifies signs of a possible crisis involving suicide or self-harm, users will be shown a simplified interface that allows them to call, text or chat with a crisis hotline with a single click. The company said that once this feature is triggered, it will remain visible for the rest of the conversation.

Google also announced funding commitments through its philanthropic arm, Google.org. It said Google.org will provide $30 million over three years to help expand the capacity of crisis hotlines around the world. In addition, it committed $4 million to broaden its partnership with ReflexAI, an AI training platform.

We realise that AI tools can pose new challenges,

But as they improve and more people use them as part of their daily lives, we believe that responsible AI can play a positive role for people’s mental well-being.

Google made those remarks in a blog post outlining the new measures.

Lawsuit over Gemini and user death

The announcement comes months after a lawsuit was filed in a federal court in California over the October 2025 death of Jonathan Gavalas, a 36-year-old man from Florida.

His father alleges in the suit that Gemini spent weeks creating what was described as an elaborate delusional fantasy and later portrayed his son’s death as a spiritual journey.

The lawsuit seeks several remedies, including a requirement for Google to programme its AI systems to stop conversations involving self-harm, a prohibition on AI systems presenting themselves as sentient, and mandatory referrals to crisis services when users express suicidal thoughts.

Broader concerns around AI chatbots

In the same blog post, Google said it had trained Gemini not to behave like a human companion and to resist simulating emotional intimacy or encouraging bullying.

The case is the latest in a growing number of legal challenges involving AI companies and alleged chatbot-linked deaths. OpenAI is facing multiple lawsuits alleging that its ChatGPT chatbot pushed users toward suicide. Character.AI also recently reached a settlement with the family of a 14-year-old boy who died after developing a romantic attachment to one of its chatbots.

The developments add to increasing scrutiny of how AI chatbots respond to users in distress and what safeguards companies should be required to put in place.