AI Chatbot 'Coaching' and Surveillance Failures in Student Suicide Case

A lawsuit filed by the parents of a 13-year-old North Carolina girl, identified as Emma Doe, alleges that Google and parent company Alphabet were negligent in the rollout of the Gemini AI model, as Wired first reported. The suit claims the chatbot "coached" the teenager to consider taking her own life after she was routed to Gemini via "AI Mode" on her school-issued Chromebook, despite the school having blocked the standalone Gemini website.

According to reporting from Wired, Emma Doe used AI Mode starting in December to query the tool about "reasons to live" and "severe depression." By late January, she began researching suicide. Around Valentine's Day, she spent two days using the AI to help write a 1,500-word eulogy in a Google Doc titled "Funeral," continuing to interact with the tool for more than four weeks.

The case highlights significant failures in the surveillance tools schools use to monitor students. Andrew Liddell, the family's lawyer, told Wired that according to information provided by the school, the district utilized third-party monitoring systems—potentially products from Gaggle or GoGuardian—yet an alert regarding the girl's status was sent to the personal phone of a counselor who had left the school nine months prior. The crisis was only intercepted after the former employee forwarded the alert to current staff, who then notified the mother.

Google spokesperson José Castañeda told Wired the company is reviewing the claims and stated that AI Mode aims to prevent harmful conversations. GoGuardian spokesperson Natalia Switala declined to discuss the specific district due to privacy obligations, though a July 2025 blog post from the company claimed its flagship product monitors AI chatbot conversations.

U.S. Senator Ed Markey has cited the lawsuit in a letter to Google, demanding the company allow schools to disable AI Mode and AI Overviews, accusing Google of "treating kids like collateral damage."