Latest AI JobsBrowse Jobs
runway-ml logo

Member of Technical Staff, ML Platform

runway-mlRemoteEngineering
Apply on company site
Salary
$240K – $290K
Job type
Full-time
Work mode
Remote
Experience
Senior · 5+ yrs
Posted
7 Oct 2026
Status
Open · checked 9d ago

About this role

Member of Technical Staff, ML Platform is a remote full-time position at runway-ml focusing on model evaluation infrastructure, suited for experienced engineers with a background in building production machine learning systems. This role centers on owning and expanding the model evaluation platform to measure and scale frontier models.

Role Overview

The Member of Technical Staff, ML Platform position involves designing and building the centralized systems that generate samples, score outputs using automated metrics and human annotations, and track performance across releases. Located remotely, this role embeds within research teams to define operational standards for model quality and provide rapid feedback to researchers.

Key Responsibilities

Own the evaluation platform from end to end, covering tooling, generation, annotation, review, and adaptation at scale.
Define command-line interfaces, application programming interfaces, graphical user interfaces, and storage layers for collaborative workflows.
Collaborate directly with research teams focused on video, image, audio, agents, and robotics to build measurement solutions.
Establish standards for reproducibility, metric definitions, reporting formats, and ship/no-ship decision criteria.
Support adoption of the evaluation platform across training, production serving, and research efforts.
Contribute broadly to the ML Platform team's tools for training and serving frontier models.

Requirements

Five plus years of experience building machine learning infrastructure or data platforms in production environments.
Background focused on evaluation, experimentation, or benchmarking systems.
Strong proficiency in Python and PyTorch.
Hands-on experience running large batch graphical processing unit workloads on Kubernetes.
Experience designing data pipelines and storage for large media or model outputs with a focus on versioning and reproducibility.
Familiarity with experimental statistics such as paired comparisons and confidence intervals.
Ability to build internal tools end to end from command line to browser.
Familiarity with the complete model development lifecycle from data to serving.

Nice to Have

Track record of building evaluation suites for generative models.
Hands-on experience with large language model or vision language model as judge pipelines.
Experience with online experimentation platforms and connecting offline metrics to product outcomes.
Prior work evaluating agents or robotics policies.

Skills and Tools

Python
PyTorch
Kubernetes
Cloud services
Large batch GPU workloads
Data pipelines and storage layers
CLIs, APIs, and GUIs

Salary and Benefits

Salary range of $240K to $290K for United States-based candidates, with adjustments for other regions.
Overall compensation package that includes salary alongside other factors determined by experience and qualifications.

About the Company

Runway builds artificial intelligence to simulate the world through merging art and science, focusing on world models as a frontier of progress. The company creates technology that changes how stories are told and scientific progress is made. Recognized as a best place to work by various organizations, Runway values an inclusive workplace supporting equal opportunity.

How to Apply

Interested candidates should apply on the official company careers page.

Skills and tech stack

PythonPyTorchKubernetesLLM

Questions candidates ask

What is the primary focus of this role?

The primary focus is owning model evaluation at Runway end to end, building the systems that generate samples, score them, and track results across releases.

Where is the position located?

The role is remote.

What is the salary range for the position?

The expected salary range for United States-based candidates is $240K to $290K.

How many years of experience are required?

Candidates must have 5+ years of experience building machine learning infrastructure or data platforms in production environments.

What core technologies are used in the technical stack?

The technical stack includes Python, PyTorch, Kubernetes, and multiple cloud-native tools.

Ready to apply?

The application is on the official runway-ml careers page.

Apply on company site