Meta has rolled out new features designed to notify parents when their teenage children discuss suicide or self-harm with Meta AI, the company’s chatbot. Parents who have activated the supervision function for their teens on Instagram will receive alerts on their own devices if their teenage children exhibit signs of crisis in conversations with Meta AI across Meta’s platforms. Meta AI is accessible on various Meta platforms, such as Instagram, WhatsApp, Facebook Messenger, and the Meta.ai website.
These updates represent an extension of Meta’s existing safety protocols. Previously, when a teenager indicated thoughts of self-harm or suicide, the AI chatbot would guide them to crisis helplines and urge them to contact a parent or another trusted individual. Additionally, repeated searches related to self-harm and suicide by teen Instagram users through the platform’s search function would already trigger notifications to parents.
The new feature is currently available for users in Canada, the U.K., the U.S., and Australia. Meta initially announced plans to incorporate a flagging feature into Meta AI in February. The company is also developing a tool to automatically reach out to emergency services when conversations between the chatbot and both adults and teens suggest potential self-harm threats.
While acknowledging the positive impact of these measures, analysts, experts, and youth emphasize the need for further enhancements. London-based technology analyst Carmi Levy reiterated that while these tools are beneficial, they are not foolproof and may generate false alarms or miss genuine risks. Meta assures that it will err on the side of caution initially, notifying parents even in cases of ambiguous intent from teens.
Parents are encouraged to view these tools as part of a broader strategy in overseeing their children’s online activities. Despite the introduction of these features, there is concern that tech-savvy teens may attempt to circumvent them. Advocates like Sara Austin from Children First Canada advocate for stricter regulations to compel tech companies to prioritize youth protection.
The introduction of Meta’s new tool coincides with increased scrutiny of AI’s role during mental health crises among young individuals. OpenAI faced criticism for not flagging an account linked to a tragic incident in British Columbia before it occurred. Families are also pursuing legal action against OpenAI, alleging its chatbot contributed to a teenager’s suicide. In response, OpenAI has implemented parental controls and alert features akin to Meta’s to enhance safety measures for teen users.
As discussions on online safety for teens continue, there is a growing call for legislative action to hold tech companies accountable for safeguarding young individuals. The introduction of the Safe Social Media Act in Canada aims to impose safety requirements on AI chatbot creators in response to mental health concerns expressed by users. However, the bill is pending further legislative processes before becoming law.