Anthropic· Safeguards (Trust & Safety) · San Francisco, CA | New York City, NY
Software Engineer, Account Abuse
Classified Tasks (13)
Automate 0%Augment 69%Human-Only 31%
Augment (9)
AI assists, human decides
1. Ensure computing capacity is allocated fairly.
operational
2. Minimize resources available to bad actors.
technical
3. Prevent bad actors from returning to the platform.
operational
4. Build systems that gather and analyze signals at scale.
technical
6. Analyze other teams' code to identify points to gather signals or introduce interventions with minimal impact on system stability, complexity, or architecture.
technical
7. Integrate with third-party data-enrichment vendors.
technical
8. Create monitoring dashboards, configure alerts, and develop internal admin user interfaces.
technical
9. Work with data scientists to maintain situational awareness of current usage patterns and trends.
analytical
11. Build robust and reliable multi-layered defenses against account abuse.
technical
Human-Only (4)
Requires human judgment
5. Balance tradeoffs and coordinate with stakeholder teams across the company when designing and deploying abuse-detection systems.
leadership
10. Collaborate with the Policy & Enforcement team to maximize the impact of human-review availability.
communication
12. Lead root cause analyses and deep-dive investigations into account activity to identify abuse patterns and uncover emerging attack vectors.
analytical
13. Inform immediate enforcement actions and design longer-term systemic defenses based on investigation findings.
leadership
Job description
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role The Account Abuse team is tasked with ensuring Anthropic’s computing capacity is allocated fairly, minimizing resources available to bad actors and preventing them from coming back. As a software engineer on this team, you will build systems that gather and analyze signals at scale, balancing tradeoffs and coordinating closely with stakeholder teams throughout the company. The ideal candidate can see things from opponents’ perspectives, understand their means and motives, and anticipate their responses to countermeasures. Responsibilities: Ability to think and respond quickly in a rapidly-changing greenfield environment Jumping into other teams’ code to identify key points to gather signals or introduce interventions with minimal impact on their systems’ stability, complexity, or overall architecture Integration with third-party data-enrichment vendors Creating monitoring dashboards, alerts, and internal admin UX Working closely with our data scientists to maintain situational awareness of our current usage patterns and trends, and with our Policy & Enforcement team to maximize the impact of their human-review availability Building robust and reliable multi-layered defenses Lead root cause analyses and deep-dive investigations into account activity to identify abuse patterns, uncover emerging attack vectors, and inform both immediate enforcement actions and longer-term systemic defenses You may be a good fit if you have: A Bachelor’s degree in Computer Science, Software Engineering or comparable experience 5-10+ years of experience in a software engineering position, preferably with a focus on integrity, spam, fraud, or abuse detection. Proficiency in Python, SQL, and data analysis tools. Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders Strong candidates may also: Have experience building trust and safety mechanisms for and using AI/ML systems, such as fraud-detection models or security monitoring tools or the infrastructure to support these systems at scale Have worked closely with operational teams to build custom internal tooling The annual compensation range for this role is listed below. For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role. Annual Salary: $320,000 — $405,000 USD Logistics Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position Location-based hybrid policy: Currently, we expect all staff