Abuse Investigator (Ai Self Improvement Risk) San Francisco at OpenAI — task breakdown

--- BEGIN UNTRUSTED EXTERNAL CONTENT (source: https://openai.com/careers/abuse-investigator-(ai-self-improvement-risk)-san-francisco/) --- Skip to main contentResearchProductsBusinessDevelopersCompanyFoundation(opens in a new window)Log inTry ChatGPT(opens in a new window)ResearchProductsBusinessDevelopersCompanyFoundation(opens in a new window)Abuse Investigator (AI Self-Improvement Risk) | OpenAICareersAbuse Investigator (AI Self-Improvement Risk)Intelligence & Investigations - San FranciscoApply now(opens in a new window)About the TeamOpenAI’s mission is to ensure that general-purpose artificial intelligence benefits all of humanity. We believe that achieving our goal requires real world deployment and iteratively updating based on what we learn.The Intelligence and Investigations team supports this by identifying and investigating misuses of our products – especially new and emerging classes of risk. This enables our partner teams to develop data-backed policies and safety mitigations. Precisely understanding how models behave in real-world conditions allows us to safely enable users to build useful things with our products.About the RoleAs an Abuse Investigator focused on AI Self-Autonomy and Agentic Risk on the Intelligence and Investigations team, you will be responsible for identifying and investigating cases where models exhibit autonomous or agentic behavior, including chaining capabilities, acting with increasing independence, or demonstrating patterns that may introduce safety risk. This includes detecting behaviors that are not explicitly intended, understood, or covered by existing safeguards.This role requires deep domain-specific expertise in identifying, understanding, and mitigating risk from agentic systems, model autonomy, and AI self-improvement signals. You’ll need experience investigating complex systems where behavior emerges across multiple steps, tools, or interactions, and the ability to distinguish between normal task execution and concerning patterns such as persistence, workaround behavior, or capability expansion. You’ll need a proven ability to navigate ambiguous signals in a rapidly evolving and highly technical environment.This role is based in our San Francisco office. Investigations may involve reviewing complex or sensitive model behaviors and edge-case outputs, requiring strong judgment and resilience in high-pressure environments.In this role, you will:Review leads, investigate model behavior, and identify cases where systems demonstrate agentic or autonomous patterns that that introduce safety risksDetect and analyze behaviors such as multi-step planning, capability chaining, tool use, persistence, and workaround behaviorDevelop signals and tracking strategies to help proactively identify emerging agentic risk patterns across our platformIdentify gaps in existing safeguards, evaluations, or monitoring systems and propose improvementsCommunicate investigation findings clearly to technical, policy, and leadership stakeholdersBe someone people enjoy working with and appreciate the opportunity to help othersYou might thrive in this role if you:Have deep expertise in investigating complex, adversarial, or emergent system behavior, ideally in AI safety, security, cyber, or trust & safety environmentsHave strong familiarity with technical investigations, especially using SQL, Python, or similar tools, in a government, research, or technology settingHave experience analyzing multi-step systems, automation, or agentic workflows, and understanding how behaviors emerge across interactionsHave at least 6 years of experience conducting investigations, threat analysis, or research in complex and ambiguous domainsHave experience identifying failure modes, unintended behaviors, or system-level risks, particularly in AI or software systemsHave at least two years of experience helping to develop automated or scalable approaches to detection or investigationExperience presenting analytic work in technical,

Abuse Investigator (Ai Self Improvement Risk) San Francisco

Classified Tasks (13)

Augment (13)

Job description