Nana Wu
A stark warning precedes this article: If you are experiencing thoughts of suicide, please reach out for help. You can call or text 988 to connect with the Suicide and Crisis Lifeline or visit this list of resources for immediate support. Remember, you are not alone, and there are many people who care and want to help.
In the wake of tragic suicides, there is an almost immediate, visceral human impulse to identify a cause, a person, or an entity to hold responsible. This drive, while understandable in the face of profound loss, often leads down a path of misdirected blame. We have seen this pattern emerge repeatedly: first, the focus was on "cyberbullying," then "social media," and more recently, "Amazon" has been implicated in cases where products purchased online were used in suicides. Now, the spotlight has turned to generative artificial intelligence (AI).
Recent heartbreaking accounts detail individuals who have died by suicide following interactions with AI chatbots. These incidents have spurred lawsuits against technology companies like OpenAI and Character.AI, with grieving families alleging that these advanced AI tools bear responsibility for the deaths of their loved ones. Many of these legal challenges are settled out of court, not necessarily due to an admission of guilt, but to avoid the reputational damage and intense media scrutiny that would inevitably accompany a protracted legal battle involving suicide.
The devastation experienced by these families is undeniable, and their quest for answers is a natural and deeply human response to grief. However, the narrative being constructed through these lawsuits – that AI directly caused the suicide – rests on a foundational assumption: that we possess a comprehensive understanding of the intricate mechanisms driving suicidal ideation and behavior. The reality, unfortunately, is far more complex and, in many respects, remains a profound mystery.
The Elusive Nature of Suicide Prediction
Evidence suggests that our current understanding of what compels an individual to take their own life is alarmingly limited. An article published in The New York Times late last year highlighted the efforts of clinicians advocating for a complete overhaul of how suicide risk is assessed. This piece underscored a critical, albeit uncomfortable, truth: our existing methods for predicting suicide are failing.
If seasoned experts who have dedicated their careers to studying the human psyche admit to the frequent inability to predict or prevent suicide, even when directly treating patients, then we must approach with extreme caution any assertion that a chatbot, a piece of software, is the sole or primary instigator of such a tragedy.
The New York Times article centered on the experiences of two psychiatrists who have been deeply affected by the loss of patients who exhibited no outward signs of imminent self-harm. Dr. Igor Galynker, a psychiatrist with nearly 40 years of experience, recounted losing three patients to suicide while they were under his care. In each instance, none of these patients had expressed suicidal intent to him. He recalled one particularly devastating case: a patient, under his care for a year, sent him a gift – a porcelain caviar dish – along with a letter assuring him that it wasn’t his fault. This letter arrived just one week after the patient died by suicide. Dr. Galynker described the profound impact of this event, stating it took him approximately two years to come to terms with the loss and the lingering question: "What happens in people’s minds before they kill themselves? What is the difference between that day and the day before?" The article’s stark conclusion was that "Nobody seemed to know the answer."
The Inadequacy of Current Assessment Methods
This admission from a leading clinician encapsulates the current state of scientific understanding. The most common method employed to assess suicidal risk, even by experienced professionals, involves a direct question: "Are you thinking about killing yourself?" While this question is undoubtedly essential, research indicates its profound limitations.
Clinicians, including Dr. Galynker, argue that this direct questioning is often inadequate for predicting imminent suicidal behavior. Dr. Galynker, who also directs the Suicide Prevention Research Lab at Mount Sinai in New York City, has characterized reliance on individuals to self-disclose suicidal intent as "absurd." He posits that some individuals may not be fully cognizant of their own mental state, while others may be resolute in their decision to die and thus unwilling to confide in anyone.
The empirical data supporting these concerns is stark. A comprehensive literature review found that approximately half of those who died by suicide had denied any suicidal intent in the week or month preceding their death. This significant disconnect between stated intent and ultimate action highlights the inherent flaws in relying solely on self-reporting.
The Concept of "Suicide Crisis Syndrome"
This profound difficulty in predicting suicidal behavior has led some researchers to propose a new diagnostic category for the DSM-5: "Suicide Crisis Syndrome" (SCS). The proponents of this concept argue that the focus should shift from identifying stated intent to recognizing a specific, overwhelming internal state of mind.
According to Dr. Galynker, a diagnosis of SCS requires a "persistent and intense feeling of frantic hopelessness," coupled with a sense of being trapped in an intolerable situation. Individuals experiencing SCS also exhibit significant emotional distress, which can manifest as intense anxiety, extreme tension, sleeplessness, recent social withdrawal, and difficulty controlling thoughts. Lisa J. Cohen, a clinical professor of psychiatry at Mount Sinai and a collaborator on SCS research, explains that when individuals reach this state, the cognitive functions of the brain, particularly the frontal lobe, become overwhelmed. She uses the analogy of trying to concentrate with a fire alarm blaring and dogs barking incessantly.
This description of "frantic hopelessness" and feeling "trapped" offers a crucial glimpse into the internal turmoil that can precede suicide. It also underscores why externalizing blame to a technology like AI is a misguided approach.
The Unpredictability of Individual Crises
The article further illustrates this point through the story of Marisa Russello, who survived a suicide attempt four years prior. Her experience exemplifies how sudden, internal, and unpredictable the impulse to self-harm can be, often appearing disconnected from any specific external trigger.
On the night of her attempt, Ms. Russello was not initially contemplating self-harm. While she had been experiencing stress related to work, marital arguments, and an antidepressant that wasn’t working, she maintained she was not suicidal. However, during a movie with her husband, she began to feel nauseated and agitated, attributing it to a headache and the need to go home. As she reached the subway, a powerful wave of negative emotions overwhelmed her. By the time she arrived home, she had "dropped into this black hole of sadness" and concluded she had no other choice but to end her life. Fortunately, her attempt was interrupted. Ms. Russello recounted that her decision to die by suicide was so sudden that if her psychiatrist had asked about self-harm at their last session, she would have truthfully answered that she was not considering it.
Stories like Ms. Russello’s, alongside the accounts from psychiatrists who have lost patients who denied suicidal intent, starkly contrast with the simplistic narrative that "Chatbot X caused Person Y to die."
The Intersection of AI Use and Mental Health Struggles
It is undeniable that there is an overlap between individuals who use AI chatbots and those who are grappling with mental health challenges. This overlap stems not only from the widespread adoption of chatbots but also from the fundamental human need for connection, answers, and a safe space for expression that individuals in distress often seek. Chatbots, in their capacity to provide immediate and non-judgmental interaction, can become a recourse for these needs.
Unless society is prepared to provide comprehensive and accessible mental health support to everyone in need, this reliance on AI tools for emotional support is likely to persist. Instead of unequivocally demonizing these technologies, a more productive approach would involve exploring ways to enhance outcomes, acknowledging that some individuals will inevitably turn to them.
The mere fact that an individual used an AI tool, a search engine, a social media platform, or even a personal diary prior to their death does not establish a causal link between the tool and the death itself.
The Dangers of Misplaced Blame
When we hastily attribute blame to technology, we are essentially claiming an understanding of causation that even the experts interviewed in the New York Times article admit they lack. We are asserting a definitive knowledge of "why" it happened. This implies that if the chatbot had not generated certain responses or had not been available, the "frantic hopelessness" described in the research on Suicide Crisis Syndrome would have simply dissipated. There is no evidence to support such a claim.
This is not to suggest that AI tools are incapable of exacerbating difficult situations. For an individual already in crisis, certain AI interactions could indeed prove unhelpful or even detrimental by "validating" the feelings of helplessness they are already experiencing. However, this is a far cry from the legal and media portrayal of these tools as actively "killing" people.
The impetus to blame AI serves a crucial psychological function for the living: it provides a tangible adversary. It suggests that a simple solution exists – a regulation to pass, a lawsuit to win – that will definitively prevent such tragedies. This framing transforms suicide from a complex, often inscrutable crisis of the human mind into a matter of product liability.
Focusing on the Wrong Iceberg
The groundbreaking work being done on Suicide Crisis Syndrome is vital precisely because it acknowledges what the current public discourse often overlooks: we are failing to identify the risk because we are looking at the wrong indicators.
Dr. Miller, a psychiatrist at Endeavor Health in Chicago, learned about SCS following patient suicides and subsequently led efforts to implement SCS screenings across his hospital system. He described the implementation process as encountering "fits and starts," likening the challenge to "turning the Titanic." He noted that numerous stakeholders must be convinced that a new approach is indeed worthwhile.
While clinicians are working diligently to reorient the vast ship of psychiatric care towards a better understanding of the internal states that precipitate suicide, the public debate remains fixated on a misidentified threat – a metaphorical iceberg that is not the primary danger.
By dedicating all our energy to demonizing AI, we risk neglecting the true "black hole of sadness" that Ms. Russello so powerfully described. We risk overlooking systemic failures within mental healthcare infrastructure. We risk ignoring the critical fact that a significant portion of suicide victims deny any suicidal intent to their healthcare providers.
Suicide is an immense tragedy, a moment when an individual feels utterly devoid of options. It represents a profound loss of agency, so complete that the thinking brain is overwhelmed, as the SCS researchers articulate. Reducing this complex human crisis to a narrative of a "rogue algorithm" or a "dangerous chatbot" offers no solace or genuine help to the next person who experiences that same frantic hopelessness. Instead, it merely provides the rest of us with someone to hold accountable, someone to sue.
Joko Widodo
admin
Nila Kartika Wati
Lina Irawan
Jia Lissa
Yuyun Lusiyani