Meta has introduced new tools to notify parents if their teenagers discuss suicide or self-harm with the company’s chatbot, Meta AI. Parents who have activated the supervision feature for their teenagers on Instagram will receive alerts on their own devices when a teenage user displays signs of crisis while interacting with Meta AI across Meta’s platforms. Meta AI is accessible on various Meta platforms like Instagram, WhatsApp, Facebook Messenger, and the Meta.ai website.
These new measures expand Meta’s safety protocols. Previously, when a teenager mentioned thoughts of self-harm or suicide, the AI chatbot would guide them to crisis support lines and advise them to reach out to a trusted individual. Additionally, repeated searches related to self-harm and suicide by teen Instagram users using the regular search function already trigger notifications to parents.
The parent company of Instagram and Facebook, Meta, has made this feature available to users in Canada, the U.K., the U.S., and Australia. Meta had initially announced its plans to incorporate a flagging feature to Meta AI in February.
Meta is also developing a tool to alert emergency services when conversations with the chatbot, involving both adults and teens, suggest potential self-harm intentions. While the community welcomes these initiatives, experts emphasize the need for further enhancements.
London-based technology analyst Carmi Levy acknowledges the importance of empowering teens and parents with enhanced online safety tools. Levy highlights that while these tools are valuable, they may not be foolproof and could generate false alarms.
Meta assures that it will err on the side of caution by notifying parents even in situations where a teenager’s intentions are unclear. The company emphasizes ongoing monitoring to ensure the effectiveness of the new tool.
Hanna Grover, a youth advocate with Children First Canada, notes that teenagers may attempt to circumvent these features, showcasing the continual challenge of ensuring online safety for young users. Sara Austin, CEO of Children First Canada, stresses the necessity of regulatory measures to protect young individuals, advocating for stricter industry regulations.
In a bid to address concerns around AI’s role in mental health crises among youth, Meta has rolled out these new features. The company’s initiatives align with increased scrutiny on AI platforms following incidents like the Tumbler Ridge mass shooting and the tragic suicide of American teenager Adam Raine.
OpenAI, in response to similar issues, has implemented parental controls and alert features within its chatbot, resembling Meta’s functionalities. These developments underscore the evolving landscape of online safety measures for teenagers.
As discussions on regulating tech companies to safeguard young individuals gain momentum, Canada introduced the Safe Social Media Act to establish safety requirements for AI chatbots handling self-harm and suicide-related content. While this bill is pending legislation, it reflects the growing emphasis on enhancing digital protections for youth.
If you or someone you know is in distress, various helplines and resources are available for support. This information aims to guide individuals seeking assistance during challenging times.
