Latest AI JobsBrowse Jobs
Anyscale logo

Staff Software Engineer, Ray Data

AnyscaleSan FranciscoEngineering
Apply on company site
Salary
$240K - $270K USD
Job type
Full-time
Posted
9 Sept 2026
Status
Open · checked 7d ago

About this role

Production is seeking a Staff Software Engineer to join the Ray Data team in San Francisco on a full-time basis. This role is ideal for an experienced distributed systems expert eager to build and scale foundational infrastructure for modern AI workloads.

Role Overview

The Staff Software Engineer, Ray Data position involves designing, building, and improving the core systems that power Ray Data. The professional in this role will focus heavily on performance, scalability, and reliability while working closely with customers and AI-native companies to solve complex scaling challenges.

Key Responsibilities

Design and optimize distributed execution across different stages of data pipelines in heterogeneous environments.
Build robust data loading and processing solutions specifically tailored for production training and inference workloads.
Solve complex challenges in distributed execution, scheduling, resource management, data partitioning, fault tolerance, and performance optimization.
Make critical system-level architectural decisions, carefully reasoning through tradeoffs involving resource allocation, execution models, batch versus streaming workloads, and consistency versus availability.
Collaborate directly with customers and new-age AI-native companies to identify and resolve obstacles in scaling their AI workloads.

Requirements

Possess six or more years of experience building production-grade software, infrastructure, or developer-facing systems, backed by strong Python engineering expertise.
Demonstrate six or more years of experience personally owning core architectural decisions within a distributed data or compute engine, rather than primarily operating or using an existing platform designed by others.
Bring deep, hands-on experience with distributed systems internals, including scheduling, fault tolerance, data partitioning, distributed execution, performance optimization, or database and query engine internals.
Exhibit a proven track record of reasoning through system-level tradeoffs and defending architectural decisions such as batch versus streaming and static versus dynamic resource allocation.
Show a strong passion for solving unsolved problems in large-scale AI infrastructure.

Skills and Tools

Python
Azure
Distributed Systems Internals
Data Processing Engines

Salary and Benefits

Annual salary range between $240,000 and $270,000 USD.
Comprehensive health, dental, and vision coverage, with many plans up to 99% employer-covered.
Flexible time off policy.
Paid parental leave.
Dedicated mental health support.

About the Company

Production is commercializing Ray, a popular open-source project creating an ecosystem of libraries for scalable machine learning. Prominent organizations like OpenAI, Uber, Spotify, Instacart, and Cruise utilize Ray in their tech stacks. Backed by Andreessen Horowitz, NEA, and Addition, the organization has raised over $250 million to date and maintains partnerships with Azure, CoreWeave, and Google Cloud.

How to Apply

Interested candidates should visit the official company careers page to submit their application for the Staff Software Engineer, Ray Data position.

Skills and tech stack

PythonAzure

Questions candidates ask

What is the salary range for the Staff Software Engineer position?

The annual salary for this role is between $240,000 and $270,000 USD.

Where is this job located?

This position is located in San Francisco and is an on-site, full-time role.

How many years of experience are required?

Candidates must have 6+ years of experience building production-grade software, infrastructure, or developer-facing systems, along with personally owning core architectural decisions within a distributed data or compute engine.

What primary programming language is required?

Strong Python engineering experience is required for this role.

What benefits are included with employment?

Benefits include health, dental, and vision coverage with many plans up to 99% employer-covered, flexible time off, paid parental leave, and mental health support.

Ready to apply?

The application is on the official Anyscale careers page.

Apply on company site