Meta to alert parents if teens show signs of suicide or self-harm in AI chats
Meta has introduced new safety measures that will notify parents when teenagers using its artificial intelligence assistant show possible signs of suicide or self-harm during conversations, as the social media giant deepens efforts to protect young users across its platforms.
The company said the initiative, which initially covers users in the United States, the United Kingdom, Australia and Canada, will eventually be rolled out globally before the end of the year for parents using Instagram’s parental supervision tools.
Under the new system, Meta AI will continue encouraging teenagers expressing suicidal thoughts or self-harm to contact crisis helplines and seek support from parents, guardians or other trusted adults. In addition, supervising parents will now receive proactive alerts whenever Meta’s systems identify conversations suggesting their teen may be at risk.
According to Meta, the alerts will be triggered using detection signals developed in collaboration with mental health experts and will include guidance and expert resources to help parents approach sensitive conversations with their children.
To minimise errors, the company said every conversation flagged by its artificial intelligence will undergo manual review before any parental notification is issued.
Meta acknowledged that while the system may occasionally alert parents even when the level of risk is uncertain, it believes erring on the side of caution offers greater protection for vulnerable teenagers.
Larry Magid, Chief Executive Officer and Co-Founder of ConnectSafely, endorsed the initiative, describing it as an appropriate balance between protecting teenagers’ privacy and ensuring parents are informed when there are credible indications of possible self-harm.
Beyond parental notifications, Meta disclosed that it is developing technology that will enable it to alert emergency responders whenever conversations with Meta AI indicate that a user—whether an adult or teenager—may be at imminent risk of taking their own life.
The planned feature builds on Meta’s existing suicide prevention programme across Facebook and Instagram, where the company refers high-risk cases to emergency services. Meta revealed it made more than 19,000 referrals worldwide last year, enabling first responders to carry out welfare checks on individuals believed to be in danger.
The technology company also announced improvements to how Meta AI responds to discussions involving suicide and self-harm after consulting more than 75 mental health clinicians specialising in adolescent psychology.
The clinicians evaluated hundreds of AI-generated responses, providing recommendations on how the chatbot should acknowledge emotional distress while guiding vulnerable users toward professional help rather than abruptly ending conversations.
Meta said the enhanced responses are designed to recognise users’ emotions, provide compassionate engagement and encourage access to offline support services.
In another safeguard, the company confirmed that its stricter Limited Content setting for Instagram Teen Accounts will now extend to Meta AI conversations.
Teen Accounts are automatically enrolled in a default 13+ content setting, under which Meta AI provides age-appropriate responses and refuses requests involving sensitive topics such as sexual or romantic conversations or instructions for making alcoholic drinks.
With the expanded Limited Content setting, parents choosing additional restrictions for their teenagers will also limit the range of conversations Meta AI is permitted to engage in, reducing exposure to potentially inappropriate interactions.
The latest measures form part of Meta’s broader strategy to strengthen online child safety amid growing global scrutiny of how artificial intelligence platforms interact with minors and respond to mental health concerns.
