Nuvepro - Task Intelligence for the Enterprise
Anthropic· AI Research & Engineering· San Francisco, CA

Research Engineer, RL Infrastructure (Knowledge Work)

Classified Tasks (14)

Automate 0%Augment 64%Human-Only 36%

Augment (9)

AI assists, human decides

Own the reliability, observability, and infrastructure foundation for the Knowledge Work training environments.

operational

Ensure training and evaluation runs remain stable, well-instrumented, and high-quality as they scale in size and complexity.

operational

Proactively harden environments and evaluation systems through load testing.

technical

Inject faults into systems to validate failure modes and resilience.

technical

Conduct stress testing at realistic scale and implement mitigations for discovered failures.

technical

Build and automate observability, dashboards, and operational tooling for training environments and evaluation systems.

technical

Design and maintain a small set of trusted metrics and alerts to maximize signal-to-noise in monitoring.

analytical

Own and maintain a clean, canonical set of evaluation tools and processes for Knowledge Work capabilities, including the model-release evaluation process.

operational

Automate operational workflows and provide tooling/support to reduce researchers' operational burden.

technical

Human-Only (5)

Requires human judgment

Serve as the dedicated reliability owner for training environments and provide continuity of context across ownership rotations.

leadership

Act as the primary point of contact for partner training and infrastructure teams when environment issues arise.

communication

Drive incident response and lead efforts to resolve infrastructure and evaluation incidents to completion.

leadership

Collaborate closely with researchers building new training environments to enable reliable deployments.

communication

Monitor and preserve evaluation integrity to ensure evaluation results remain trustworthy and not gameable.

analytical

Job description

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role The Knowledge Work team builds the training environments and evaluations that make Claude effective at real-world professional workflows — searching, analyzing, and creating across the tools and documents knowledge workers use every day. As that work scales, the systems behind it need to be as rigorous as the research itself. We are looking for a Research Engineer to own the reliability, observability, and infrastructure foundation that the team's research depends on. You will be responsible for ensuring our training and evaluation runs remain stable, well-instrumented, and high-quality as they grow in scale and complexity. A core part of this role is shifting reliability work from reactive to proactive: hardening systems, stress-testing at realistic scale, and building the observability and tooling that surface problems early — so researchers can stay focused on research rather than incident response. You will be the team's stable, context-rich owner for environment health and evaluation integrity, and the primary point of contact for partner teams when issues arise. Where this role focuses: While you'll work closely with researchers building new training environments, the priority for this role is the reliability those environments depend on. It's best suited to an engineer who finds real ownership and impact in making critical systems dependable, and in being the person behind trustworthy evaluation results the entire organization relies on. Key Responsibilities: Serve as the dedicated reliability owner for the Knowledge Work training environments, providing continuity of context and reducing the operational overhead of rotating ownership Own a clean, canonical set of evaluation tools and processes for Knowledge Work capabilities, including the process used for model releases Build and automate observability, dashboards, and operational tooling for our training environments and evaluation systems, with an emphasis on high signal-to-noise: a small set of trusted metrics and alerts rather than sprawling instrumentation Proactively harden environments and evaluation systems through load testing, fault injection, and stress testing at realistic scale, so failures surface early rather than during critical training work Act as the primary point of contact for partner training and infrastructure teams when issues in our environments arise, and drive incidents to resolution Reduce the operational burden on researchers so they can stay focused on research Minimum Qualifications: Highly experienced Python engineer who ships reliable, well-instrumented code that teammates trust in production Demonstrated experience operating ML or distributed systems at scale, including significant on-call and incident-response experience Strong SRE or production-engineering mindset — reaching for SLOs, load tests, and failure injection before reaching for more dashboards Foundational ML knowledge sufficient to understand what a training environment or evaluation is actually measuring, and recognize when an evaluation has become stale or gameable Able to read research code and reason evaluation integrity Preferred Qualifications: 5+ years of experience operating ML or distributed sys
Source: Anthropic careers · scraped 2026-05-22
Apply at Anthropic