Story Highlight
– Mind launching inquiry into AI and mental health risks.
– Google’s AI Overviews gave harmful medical advice.
– Commission aims to establish safer digital mental health standards.
– Vulnerable individuals exposed to dangerously incorrect guidance.
– Google emphasizes AI quality but acknowledges potential issues.
Full Story
Mind, the mental health charity active in England and Wales, is set to embark on a groundbreaking inquiry into the impact of artificial intelligence (AI) on mental health, following revelations by the Guardian about potentially hazardous medical guidance from Google’s AI Overviews. This year-long investigation will scrutinize the risks associated with AI, as its influence grows significantly among millions facing mental health challenges globally.
This initiative, a pioneering effort on an international scale, aims to convene top-tier medical experts, mental health practitioners, individuals with personal experiences of mental health issues, health service providers, policymakers, and technology firms. Mind’s goal is to advocate for a safer digital environment for mental health support through stringent regulations and standards.
The decision to launch this inquiry comes on the heels of the Guardian’s findings, which highlighted serious concerns regarding the accuracy of health information provided by Google’s AI-powered summaries, viewed by around two billion users monthly. While Google has taken steps to remove its AI Overviews from certain medical searches post-investigation, concerns remain about the propagation of dangerous advice.
Dr. Sarah Hughes, CEO of Mind, remarked that the provision of “dangerously incorrect” mental health information persists. She expressed that in severe situations, such misinformation could lead to fatal outcomes. Hughes commented, “We believe AI has enormous potential to improve the lives of people with mental health problems… But that potential will only be realized if it is developed and deployed responsibly, with safeguards proportionate to the risks.”
The Guardian’s investigation pointed out that some AI Overviews were not only misleading but also potentially harmful, covering critical issues such as cancer, liver disorders, women’s health, and various mental health conditions. Experts have identified that certain summaries related to conditions like psychosis and eating disorders delivered alarmingly inaccurate advice that could discourage individuals from seeking necessary help.
Hughes underlined the gravity of the issue, stating, “Vulnerable people are being served dangerously incorrect guidance on mental health… People deserve information that is safe, accurate and grounded in evidence.”
The upcoming commission aims to collect and evaluate evidence at the crossroads of AI and mental health, ensuring that the experiences of those with mental health conditions are duly acknowledged and incorporated into future digital health strategies.
Rosie Weatherley, Mind’s information content manager, highlighted previous advantages of traditional online searches for mental health information, suggesting that users could find credible resources that provided comprehensive insights. She observed, “AI Overviews replaced that richness with a clinical-sounding summary that gives an illusion of definitiveness,” emphasizing that while they offer brevity, they sacrifice trustworthiness and reliability.
In response to the concerns raised, a Google spokesperson stated, “We invest significantly in the quality of AI Overviews… For queries where our systems identify a person might be in distress, we work to display relevant, local crisis hotlines.” However, they noted that without specific context, they could not comment on the accuracy of the claims made in the inquiry.
