Latest AI JobsBrowse Jobs
Scale AI logo

Research Scientist, Agent Robustness

Scale AISan Francisco, CA; New York, NYResearch
Apply on company site
Salary
Not listed
Job type
Full-time
Posted
20 Mar 2026
Status
Open · checked 7d ago

About this role

Role Overview

The Research Scientist, Agent Robustness role at Scale AI is based in San Francisco, CA or New York, NY, focusing on fundamental challenges in building safe and human-aligned AI agents. This position suits experienced machine learning researchers dedicated to advancing AI safety, risk evaluations, and control protocols alongside global policymakers, industry leaders, and academic institutions.

Key Responsibilities

Research the science of artificial intelligence agent capabilities, connecting them directly to safety, risk factors, and benchmarking methodologies.
Design and construct evaluation harnesses to test artificial intelligence agents for harmful actions triggered by user pressure or environmental manipulation.
Create exploits and mitigations addressing unique failure modes as agents gain advanced affordances like coding, computer use, and web browsing.
Characterize and build mitigations for broader risks involving multiple interacting artificial intelligence systems.

Requirements

A strong commitment to promoting safe, secure, and trustworthy deployments across the artificial intelligence industry.
Practical experience conducting technical research collaboratively, including building agent scaffolding and turning research ideas into prototypes.
Familiarity with post-training and reinforcement learning techniques such as DPO, RLHF, and GRPO.
A documented track record of published research within machine learning and generative artificial intelligence.
Minimum of three years of professional experience solving sophisticated machine learning problems in research or product development.
Excellent written and verbal communication skills for cross-functional collaboration.

Nice to Have

Hands-on familiarity with evaluation frameworks like SWE-bench, WebArena, OSWorld, or Inspect.
Background in red-teaming, prompt injection, or adversarial testing methodologies for artificial intelligence systems.

Skills and Tools

Machine learning research and generative AI frameworks
Post-training and reinforcement learning techniques (RLHF, DPO, GRPO)
Agent scaffolding and evaluation harness design
Prototyping and debugging tools

Salary and Benefits

Base salary range for San Francisco and New York is $216,000 to $270,000 USD.
Equity-based compensation subject to Board of Director approval.
Comprehensive health, dental, and vision coverage.
Retirement benefits alongside a learning and development stipend.
Generous paid time off and potential commuter benefits.

About the Company

Scale AI serves as a primary data and evaluation partner for frontier artificial intelligence companies, specializing in safeguarding models and building reliable technologies. The organization collaborates extensively with major commercial enterprises, healthcare organizations, academic groups, and government entities to accelerate safe AI adoption worldwide. Scale AI maintains an equal opportunity workplace dedicated to inclusive hiring practices and reasonable accommodations.

How to Apply

Candidates should visit the official Scale AI careers page to submit an application for the Research Scientist, Agent Robustness position.

Questions candidates ask

Where is the Research Scientist, Agent Robustness position located?

The position is located in San Francisco, CA or New York, NY.

What is the salary range for this role?

The base salary range for this position in San Francisco and New York is $216,000 to $270,000 USD.

What qualifications are required for the role?

Candidates need at least three years of experience solving sophisticated machine learning problems, a track record of published research in generative AI, experience with post-training and reinforcement learning techniques, and strong collaborative research skills.

What benefits are provided by Scale AI?

Eligible employees receive comprehensive health, dental, and vision coverage, retirement benefits, equity compensation, a learning and development stipend, generous PTO, and potential commuter stipends.

How can I apply for this job?

Interested applicants should apply directly on the official company careers page.

Ready to apply?

The application is on the official Scale AI careers page.

Apply on company site