Latest AI JobsBrowse Jobs
Scale AI logo

Research Scientist, AI Controls and Monitoring

Scale AISan Francisco, CA; New York, NYResearch
Apply on company site
Salary
Not listed
Job type
Full-time
Posted
20 Mar 2026
Status
Open · checked 7d ago

About this role

Scale AI is hiring a Research Scientist for AI Controls and Monitoring based in San Francisco, CA or New York, NY to shape policies and safety protocols for frontier artificial intelligence models. This opportunity suits experienced machine learning researchers dedicated to building reliable, secure, and trustworthy AI systems.

Role Overview

Scale Labs has introduced a specialized policy research group to bridge the gap between artificial intelligence research and global policymakers. The team tackles complex challenges in agent robustness, control protocols, and risk evaluations to help governments and industries understand and mitigate risks. As a Research Scientist focused on AI Controls and Monitoring, the professional will create methods, systems, and experiments to keep advanced AI models aligned with intended goals, particularly in adversarial environments.

Key Responsibilities

Create real-time monitoring techniques and observability methods to track artificial intelligence behavior, flagging deviations, anomalous outputs, or emergent capabilities.
Research layered control mechanisms, including oversight protocols, fail-safes, and intervention strategies to halt or redirect systems when risks arise.
Build red-team simulations to uncover vulnerabilities in oversight and control systems, developing mitigations to close gaps.
Work alongside policymakers, engineers, and researchers to set benchmarks and standards for artificial intelligence escalation and monitoring.

Requirements

Dedication to the mission of promoting safe, secure, and trustworthy artificial intelligence deployments as frontier capabilities grow.
Practical experience in collaborative technical research, designing control and monitoring experiments, building prototypes, and transforming research literature into working models.
A documented track record of published research focusing on machine learning, specifically generative artificial intelligence.
Minimum of three years of experience tackling sophisticated machine learning problems within product development or research settings.
Strong verbal and written communication skills for cross-functional collaboration.

Nice to Have

Background in runtime monitoring, anomaly detection, or observability for machine learning systems.
Familiarity with AI alignment or control research, including interpretability, scalable oversight, or debate.
Experience with post-training and reinforcement learning techniques such as DPO, RLHF, GRPO, and related methodologies.

Skills and Tools

Generative AI and Machine Learning research
Reinforcement learning techniques (RLHF, DPO, GRPO)
Runtime monitoring and anomaly detection for ML systems
Prototyping and debugging machine learning models
AI control protocols and oversight architectures

Salary and Benefits

The base salary range for this full-time position in San Francisco and New York is $216,000 to $270,000 USD, with final compensation determined by location, skills, experience, and qualifications. Eligible roles include equity-based compensation subject to Board of Director approval. Comprehensive benefits feature health, dental, and vision coverage, retirement benefits, a learning and development stipend, generous paid time off, and potential commuter stipends.

About the Company

Scale AI provides high-quality data and full-stack technologies that power leading artificial intelligence models, helping enterprises and governments build, deploy, and oversee impactful applications. The organization collaborates with prominent industry leaders and public sector agencies, maintaining a commitment to an inclusive and equal opportunity workplace.

How to Apply

Interested candidates should visit the official Scale AI careers page to submit an application and learn more about the hiring process.

Questions candidates ask

What are the primary locations for the Research Scientist role?

The position is located in San Francisco, CA, and New York, NY.

What is the salary range for this position in San Francisco and New York?

The base salary range for this full-time role in San Francisco and New York is $216,000 to $270,000 USD.

What level of experience is required for applicants?

Candidates must have at least three years of experience addressing sophisticated machine learning problems in a research or product development setting, along with a track record of published research in machine learning.

What benefits are provided to eligible employees?

Eligible employees receive comprehensive health, dental, and vision coverage, retirement benefits, a learning and development stipend, generous PTO, equity-based compensation, and potential commuter stipends.

What does the interview process evaluate?

Research interviews assess practical machine learning prototyping and debugging skills, comprehension of research concepts, and alignment with company culture, without any LeetCode-style questions.

How can an applicant request accommodations for a disability?

Applicants needing assistance or reasonable accommodations during the recruiting process can contact accommodations@scale.com.

Ready to apply?

The application is on the official Scale AI careers page.

Apply on company site