Instagram is introducing new safety features through Meta AI that focus specifically on teen mental health. This step is designed to help parents be more aware of signs of stress that their children may be experiencing, thus ensuring that support can be provided earlier before the situation becomes serious.
Among the main steps introduced is a warning to parents. According to Meta, if a teen chats with Meta AI and there are signs that they are thinking about harming themselves, parents who use Instagram controls will receive a warning notification. This notification is also accompanied by a link to professional support resources to ensure that help can be accessed immediately.
There is also immediate support where Meta AI will continue to direct teens to crisis helplines and encourage them to talk to their parents or trusted adults. At the same time, Meta is developing a system to contact emergency services if there is a risk that is considered serious.
At the same time, Instagram is also introducing more systematic content settings. Teens will automatically be placed in the “13+ Content Setting” which is designed to provide age-appropriate responses and reject sensitive requests. Meta is also adding a “Limited Content” option, a more restrictive setting to ensure that the AI doesn’t serve inappropriate conversations.
Meta is also working with more than 75 adolescent mental health experts to provide feedback. This effort aims to ensure that the AI’s responses are more appropriate, empathetic, and aligned with the psychological needs of adolescents. This approach will increase safety and strengthen the user experience for young people.
Currently, the parental warning is implemented in the United States, United Kingdom, Australia, and Canada, and will be expanded globally by the end of the year
