Latest AI JobsBrowse Jobs
Scale AI logo

Research Scientist, Frontier Risk Evaluations

Scale AISan Francisco, CA; New York, NYResearch
Apply on company site
Salary
Not listed
Job type
Full-time
Posted
25 Mar 2026
Status
Open · checked 7d ago

About this role

Role Overview

The Research Scientist position at Scale AI focuses on Frontier Risk Evaluations within the Research department, based in San Francisco, CA or New York, ND. This role suits a technical professional dedicated to designing evaluation measures and datasets that measure the risks associated with frontier artificial intelligence systems.

Key Responsibilities

Design and construct specialized harnesses to test artificial intelligence models and systems, covering agents, for potential high-risk activities, CBRN uplift, and security vulnerability exploitation.
Collaborate directly with government agencies and external laboratories to jointly scope and create evaluations aimed at measuring and mitigating advanced artificial intelligence risks.
Write detailed technical reports and publish evaluation methodologies intended for policy makers.

Requirements

Strong commitment toward promoting safe, secure, and trustworthy artificial intelligence deployments as capabilities advance.
Demonstrated practical experience in conducting collaborative technical research, building and instrumenting machine learning pipelines, writing evaluation harnesses, and prototyping ideas quickly from research literature.
Published research history centering on machine learning, with a strong focus on generative artificial intelligence.
Minimum of three years of experience focused on solving complex machine learning challenges within product development or research environments.
Excellent written and verbal communication skills necessary for operating smoothly inside a cross-functional team structure.

Nice to Have

Background or experience creating evaluations, benchmarks, or data science tasks involving large language model technologies.
Prior involvement in adversarial testing or red-teaming of artificial intelligence platforms.
Familiarity with existing artificial intelligence safety policy frameworks such as the EU AI Act, NIST AI RMF, and Korea AI Basic Act.

Skills and Tools

Large Language Models (LLM)
Machine learning pipeline development and debugging
Evaluation harness creation and prototyping
Research publication and technical report writing

Salary and Benefits

Base salary range of $216,000 to $270,000 USD for eligible full-time positions in San Francisco and New York.
Comprehensive medical, dental, and vision insurance coverage alongside retirement benefits.
Generous paid time off paired with a learning and development stipend.
Potential eligibility for equity-based compensation and a commuter stipend, determined during the interview process.

About the Company

Scale AI builds reliable data and full-stack technologies that help governments and enterprises build, oversee, and deploy impactful artificial intelligence applications. The organization collaborates with top industry leaders, prominent medical centers, global enterprises, and various United States government agencies. Scale AI operates as an inclusive, equal opportunity workplace committed to supporting all qualified individuals.

How to Apply

Interested candidates should submit their application directly through the official company careers page.

Skills and tech stack

LLM

Questions candidates ask

What locations is this position based in?

This role is located in San Francisco, CA or New York, NY.

What is the salary range for this position?

The base salary range for this full-time role in San Francisco and New York is $216,000 to $270,000 USD.

What experience level is required?

Candidates must have at least three years of experience addressing sophisticated machine learning problems in research or product development.

Are LeetCode-style questions used in the interviews?

No, the research interviews assess practical machine learning prototyping, debugging skills, and research concepts without using LeetCode questions.

Where should I submit my application?

Applications should be submitted through the official company careers page.

Ready to apply?

The application is on the official Scale AI careers page.

Apply on company site