Latest AI JobsBrowse Jobs
Scale AI logo

Tech Lead Manager- MLRE, ML Systems

Scale AISan Francisco, CA; New York, NYResearch
Apply on company site
Salary
Not listed
Job type
Full-time
Posted
10 Oct 2025
Status
Open · checked 7d ago

About this role

Scale AI is hiring a Tech Lead Manager for MLRE, ML Systems in San Francisco, CA or New York, NY to lead the development of internal distributed frameworks for large language model training. This opportunity suits an experienced engineering leader passionate about system optimization, distributed machine learning, and shaping the future of artificial intelligence.

Role Overview

The Tech Lead Manager position focuses on building, profiling, and optimizing training and inference frameworks to power researchers, machine learning engineers, and data scientists. The person in this role will work closely with machine learning teams to accelerate development and enable the creation of next-generation models and data curation techniques.

Key Responsibilities

Build, profile, and optimize training and inference frameworks.
Collaborate with machine learning and research teams to accelerate research and development.
Enable teams to develop the next generation of models and data curation.
Research and integrate state-of-the-art technologies to optimize machine learning systems.

Requirements

Passionate about system optimization.
Experience with multi-node LLM training and inference.
Experience with developing large-scale distributed machine learning systems.
Experience with post-training methods like RLHF or RLVR and related algorithms such as PPO or GRPO.
Strong software engineering skills with proficiency in frameworks and tools like CUDA, PyTorch, transformers, and flash attention.
Strong written and verbal communication skills to operate effectively in a cross-functional team environment.

Nice to Have

Demonstrated expertise in post-training methods and next-generation use cases for large language models, including instruction tuning, RLHF, tool use, reasoning, agents, and multimodal applications.

Skills and Tools

PyTorch
LLMs
CUDA
Transformers
Flash attention
Multi-node training and inference

Salary and Benefits

Base salary range for San Francisco and New York is $290,400 to $363,000 USD.
Compensation packages include base salary, equity based on Board of Director approval, and comprehensive health, dental, and vision coverage.
Additional benefits include retirement benefits, a learning and development stipend, generous PTO, and potentially a commuter stipend.

About the Company

Scale AI has a mission to develop reliable artificial intelligence systems for the world's most important decisions. The company provides high-quality data and full-stack technologies that power leading models, helping enterprises and governments build, deploy, and oversee impactful AI applications. Scale AI partners with industry leaders and government agencies, maintaining a commitment to being an inclusive and equal opportunity workplace.

How to Apply

Interested candidates should apply directly on the official Scale AI careers page.

Skills and tech stack

Questions candidates ask

What locations are eligible for this role?

This position is located in San Francisco, CA and New York, NY.

What is the salary range for this position?

The base salary range for this full-time position in San Francisco and New York is $290,400 to $363,000 USD.

What benefits are included with the role?

Eligible roles receive comprehensive health, dental, and vision coverage, retirement benefits, a learning and development stipend, generous PTO, equity-based compensation, and potentially a commuter stipend.

What technical skills are required?

Candidates need strong software engineering skills, proficiency in tools like CUDA, PyTorch, transformers, and flash attention, along with experience in large-scale distributed ML systems and multi-node LLM training.

Is there a waiting period to reapply if previously rejected?

Yes, Scale AI has a policy requiring a 90-day waiting period before reconsidering candidates for the same role.

Ready to apply?

The application is on the official Scale AI careers page.

Apply on company site