Research Engineer, RL Scaling Science

About the role

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

What you’ll do

• Design, run, and interpret large-scale RL experiments, reasoning rigorously about what the data does and doesn't show
• Investigate how RL improves as horizon, compute, and model size grow
• Build and maintain benchmarks for long-horizon RL so progress is measurable and reproducible
• Translate validated findings into production training recipes, exercising judgment about when a result is robust enough to ship
• Debug complex issues at the seam where research meets infrastructure - failures that only appear at scale
• Partner closely with adjacent RL teams across research and engineering and advance our overall RL stack

What they’re looking for

Select a requirement to inspect fit, evidence or application context.

• Strong empirical research skills in Reinforcement Learning, large-scale ML training, or a closely adjacent area
• Demonstrated ability to own large experiments end-to-end, from design through interpretation
• Proficiency in Python and experience working with large-scale or distributed ML systems
• Comfort operating at the research/systems boundary, including debugging where the two meet
• Care about the societal impacts of AI and responsible scaling
• A field relevant to the role as demonstrated through coursework, training, or professional experience

Helpful, not always essential

• Published or shipped work in long-horizon RL or RL fundamentals
• Experience translating research findings into production training recipes
• Demonstrated large scale industry impact via RL interventions
• Experience working on frontier-scale training runs with long trajectories