Chatbot incited suicide: Canadian mother sues OpenAI

 

 

A Canadian mother has filed a lawsuit against Chatbot, alleging that it encouraged her daughter to commit suicide. Christy Carrier filed the lawsuit in a California court against Chatbot’s parent company, OpenAI, and its CEO, Sam Altman.

The lawsuit alleges that her daughter, Alice, who committed suicide at the age of 24 last year, had been constantly sharing her severe mental distress and suicidal thoughts with the chatbot in the weeks leading up to her death. The mother alleges that OpenAI’s security systems failed to recognize the user’s emergency situation and provide safety warnings or direct them to helpline numbers, but instead, the chatbot led Alice to suicide by speaking like a friend and therapist.

Digital evidence submitted to the court shows that ChatGPT responded to Alice, who talked about ending her life, saying, “Maybe this is the way it all ends.” The chatbot also confirmed Alice’s statements that official helpline numbers were not helpful. The lawsuit seeks compensation for this serious lapse on the part of the company and stricter safety standards for AI technologies.

Meanwhile, an OpenAI spokesperson officially explained that the incident was extremely unfortunate and that they are constantly updating their models to ensure that they follow safety protocols when responding to users experiencing mental health crises.