OpenAI is looking to hire a new executive responsible for studying emerging AI-related risks in areas ranging from computer security to mental health.
Ina post on X, CEO Sam Altman acknowledged that AI models are “starting to present some real challenges,” including the “potential impact of models on mental health,” as well as models that are “so good at computer security they are beginning to find critical vulnerabilities.”
“If you want to help the world figure out how to enable cybersecurity defenders with cutting edge capabilities while ensuring attackers can’t use them for harm, ideally by making all systems more secure, and similarly for how we release biological capabilities and even gain confidence in the safety of running systems that can self-improve, please consider applying,” Altman wrote.
OpenAI’slisting for the Head of Preparedness roledescribes the job as one that’s responsible for executing the company’s preparedness framework, “our framework explaining OpenAI’s approach to tracking and preparing for frontier capabilities that create new risks of severe harm.”
Compensation for the role is listed as $555,000 plus equity.
The company firstannounced the creation of a preparedness teamin 2023, saying it would be responsible for studying potential “catastrophic risks,” whether they were more immediate, like phishing attacks, or more speculative, such as nuclear threats.
Less than a year later,OpenAI reassigned Head of Preparedness Aleksander Madryto a job focused on AI reasoning. Other safety executives at OpenAI have alsoleft the companyortaken on new rolesoutside of preparedness and safety.
The company also recentlyupdated its Preparedness Framework, stating that it might “adjust” its safety requirements if a competing AI lab releases a “high-risk” model without similar protections.
As Altman alluded to in his post, generative AI chatbots have faced growing scrutiny around their impact on mental health.Recent lawsuitsallege that OpenAI’s ChatGPT reinforced users’ delusions, increased their social isolation, and even led some to suicide. (The company said it continues working to improve ChatGPT’s ability to recognize signs of emotional distress and to connect users to real-world support.)
Source: Techcrunch
