Meta has introduced new tools to notify parents when their teenagers discuss suicide or self-harm with Meta AI, the company’s chatbot. Parents with supervision features enabled on their teen’s Instagram account will receive notifications on their own devices if their teenagers show signs of crisis while conversing with Meta AI on any Meta platform. This includes Instagram, WhatsApp, Facebook Messenger, and the Meta.ai website.
These enhanced measures are an extension of Meta’s existing safety protocols. Previously, when a teenager indicated thoughts of self-harm or suicide, the AI chatbot would guide them to crisis hotlines and prompt them to seek help from a trusted individual. Furthermore, repeated searches related to self-harm and suicide on Instagram’s search function would already trigger notifications to parents.
Meta, the parent company of Instagram and Facebook, has made this feature available to users in Canada, the U.K., the U.S., and Australia. The company initially announced plans to incorporate a flagging system into Meta AI back in February.
Moreover, Meta is developing a tool to alert emergency services when both adults and teenagers engage in conversations with the chatbot that suggest a risk of self-harm. While stakeholders appreciate these initiatives, they acknowledge the need for ongoing improvements in online safety measures for young individuals.
Notwithstanding, there are concerns that some teenagers may attempt to circumvent these controls. Hanna Grover, a youth advocate with Children First Canada, highlights that some teenagers have falsified their birthdates to avoid utilizing the more secure teen accounts on Meta. She anticipates that teenagers will continue to find ways to bypass such features to access full functionalities on social media platforms.
Sara Austin, the CEO of Children First Canada, emphasizes that relying solely on parental controls is insufficient in safeguarding children online. She advocates for stricter regulations that compel tech companies to prioritize the protection of young users. The proposed Safe Social Media Act in Canada aims to enforce safety requirements for AI chatbots, especially concerning expressions of self-harm, suicide, or harm to others.
As Meta enhances its tools to address mental health crises among young individuals, the role of AI in such contexts is under scrutiny. Recent incidents involving AI platforms like OpenAI have raised concerns about the need for more robust safety mechanisms. OpenAI faced criticism for not alerting authorities about disturbing content on an account linked to a tragic event. The company has since implemented parental controls and alert features akin to Meta’s to notify parents of potential risks associated with their children’s conversations on the platform.
In conclusion, while advancements in AI technology offer valuable support, ongoing vigilance and collaborative efforts among parents, tech companies, and regulators are crucial to ensure the online safety and well-being of young individuals.