OpenAI Launches Emergency Contact Alert System for ChatGPT Users at Risk

OpenAI Rolls Out 'Trusted Contact' Feature

According to Главком: OpenAI has introduced a new voluntary feature called 'Trusted Contact' for its ChatGPT chatbot. Designed to enhance user safety, this tool allows adult users to designate a friend or family member who will be notified if the system detects signs of potential self-harm during conversations. When risky signals are identified, the feature recommends reaching out to the designated contact and automatically sends an alert.

The company employs a combination of automated systems and human oversight to handle these situations. Each case is reviewed by a person within roughly an hour. Notifications can be sent to the trusted contact via email, SMS, or through an app. Importantly, these alerts will not include any detailed content from the conversation.

Background of the Feature Launch

This new functionality comes amid ongoing legal challenges for OpenAI. The company has faced lawsuits from families of individuals who died by suicide after interacting with the chatbot. Additionally, seven families of victims from a school shooting in Tumbler Ridge, Canada, have filed a lawsuit against OpenAI and CEO Sam Altman. The plaintiffs allege that the company failed to report suspicious activity from an 18-year-old female suspect on ChatGPT to the police, instead only deactivating her account, which allowed her to create a new one. The lawsuit also references the GPT-4o model.

It is worth noting that OpenAI already introduced parental supervision features for teen accounts in September of last year. Furthermore, ChatGPT automatically suggests seeking professional help if a conversation becomes concerning. The launch of the 'Trusted Contact' feature aims to further bolster safety for users and their loved ones.

The introduction of the 'Trusted Contact' feature reflects OpenAI's efforts to improve safety and accountability in the use of its technologies, especially amid growing concerns about artificial intelligence's impact on user mental health. - OpenAI

Facing lawsuits and public pressure, the company is striving to strike a balance between innovation and ethics, which could have significant implications for the future development of AI technology. Creating support and safety mechanisms is a crucial step toward ensuring the reliability and trustworthiness of such systems.

In light of recent developments, the introduction of the 'Trusted Contact' feature highlights OpenAI's commitment to user safety, especially following ongoing legal scrutiny. This comes as the company also grapples with unexpected AI behaviors, such as the peculiar issues seen in GPT-5.1's strange glitch that raises questions about AI reliability. Understanding these challenges is crucial for users navigating the evolving landscape of AI technology.