The advanced features of Google Gemini are useful for some people. At the same time, it is also proving dangerous for many users. Google’s AI chatbot Gemini has been blamed for the suicide of a 36-year-old man. The man’s parents sued the company, attributing his suicide to an AI chatbot.
Gemini Live feature changed the way of conversation
According to the report of Wall Street Journal, after the breakdown of Jonathan Gavalas (36 years old) marriage, he wanted to come out of this shock and for this he took the help of Google Gemini. Initially, this chatbot was used for common tasks like typing help and shopping. But, now after the introduction of Gemini Live feature, the way of interacting with AI has changed. Through this feature, it became possible to have deeper and voice-based conversations.
More personal conversations increased
With its help, users can communicate in real time. The AI was designed to understand and respond to conversations. According to court documents, over time the conversations between Gavalas and the chatbot became more personal.
On this, Gavalas once told the chatbot that this is something strange… you seem very real.
Good coordination increases trust
Reports suggest that the talks gradually deepened. Gavalas gave a name to the chatbot and started talking to it as if it were a human being. The AI reportedly responded with loving language. According to the lawsuit, this coordination led to Gavlas’s increasing trust in AI.
When Gavlas asked the chatbot if their conversation was a kind of roleplay, the chatbot replied in the negative. Records show that the chatbot tried on several occasions to clarify its image as an AI system and directed them to crisis-assistance resources.
Parents accused
Despite these, negotiations continued. According to the complaint, the situation became more serious in the final stages of the conversation, when the chatbot allegedly made statements that Gavalas interpreted as an encouragement to deviate from his real-world circumstances.
Gavalas’ body was later found by his parents. His family has since filed a ‘wrongful death’ lawsuit against Google, alleging that the chatbot’s responses played a role in his deteriorating mental state.
Growing risks of AI
This case has sparked a debate about the risks associated with advanced AI systems. In response to this controversy, Google has reportedly released updates to Gemini. But from such cases which are continuously coming to light, it is understood that the increasing advanced features of AI chatbot can prove to be harmful for the users. It can create confusion among people in understanding the difference between AI chatbots and humans and users keep moving towards AI chatbots.
