Latest AI JobsBrowse Jobs
Anyscale logo

Staff Software Engineer, Platform Infrastructure (Foundations)

AnyscaleSan FranciscoEngineering
Apply on company site
Salary
$215K - $265K USD
Job type
Full-time
Work mode
Remote
Posted
21 Sept 2026
Status
Open · checked 7d ago

About this role

Anyscale is hiring a remote-friendly Staff Software Engineer, Platform Infrastructure (Foundations) to spearhead the technical vision for the infrastructure group in San Francisco. This position suits an experienced distributed systems specialist eager to scale AI workloads and guide the architectural roadmap for cloud-native platforms.

Role Overview

In this role, the selected candidate will lead the technical vision for the infrastructure team. Responsibilities include owning the architectural evolution of the control plane and data plane to support demanding distributed artificial intelligence workloads globally. The engineer will act as a force multiplier, defining standards for Kubernetes-based cloud-native infrastructure while mentoring team members and aligning cross-functional groups.

Key Responsibilities

Define and execute the multi-year technical roadmap for services that orchestrate Ray clusters across diverse cloud and on-premises environments.
Spearhead the design and optimization of high-performance control plane components built specifically for large-scale, heterogeneous machine learning workloads.
Establish organization-wide benchmarks for the scalability, reliability, and observability of managed infrastructure.
Direct long-term strategies regarding container management and accelerator integration, including GPUs and TPUs, to ensure smooth execution of distributed tasks.
Lead complex architectural discussions, resolve deep technical debt, and champion engineering excellence.
Collaborate closely with machine learning specialists and client-facing teams to transform market demands into strong foundational infrastructure.

Requirements

Bring at least 5 years of professional experience producing top-tier production code and directing complex distributed systems initiatives.
Demonstrate background in building and maintaining highly secure, scalable, and available cloud-native platforms utilizing AWS, Azure, or GCP.
Possess advanced expertise in large-scale container orchestration and Kubernetes-based deployments.
Hold deep system foundation knowledge covering the Linux kernel, networking, and low-level operating system principles.
Demonstrate mastery in Python and Go, with capabilities to establish rigorous coding standards and best practices.
Exhibit a proven track record of mentoring senior engineers and guiding technical strategies without direct authority in fast-paced environments.

Skills and Tools

Python
Go
AWS
GCP
Azure
Kubernetes
Linux Kernel and Networking

Salary and Benefits

Competitive yearly salary ranging from $215,000 to $265,000 USD
Equity packages
Health, dental, and vision coverage with many plans up to 99 percent covered by the employer
Flexible time off policy
Paid parental leave
Mental health support services

About the Company

Anyscale is on a mission to democratize distributed computing, making it accessible to software developers of all skill levels. The organization commercializes Ray, an open-source project powering scalable machine learning ecosystems used by industry leaders like OpenAI, Uber, Spotify, Instacart, and Cruise. Anyscale builds environments that allow developers to scale machine learning applications from a laptop to a cluster without needing specialized distributed systems expertise. The company is backed by prominent investors including Andreessen Horowitz, NEA, and Addition, with over $250 million raised to date.

How to Apply

Interested candidates should visit the official Anyscale careers page to submit an application for this position.

Skills and tech stack

PythonAWSGCPAzureKubernetes

Questions candidates ask

What is the salary range for the Staff Software Engineer position?

The annual salary ranges from $215,000 to $265,000 USD.

What level of experience is required for this role?

Candidates must have 5+ years of experience writing high-quality production code and leading complex distributed systems projects.

Is this a remote position?

Yes, the job is listed as remote with a location context of San Francisco.

What technical skills and programming languages are required?

Required proficiencies include Python, Go, Kubernetes, cloud platforms such as AWS, Azure, or GCP, and foundational knowledge of the Linux kernel and networking.

What benefits are included with employment?

Benefits include competitive salary and equity, comprehensive health, dental, and vision coverage with many plans up to 99% employer-covered, flexible time off, paid parental leave, and mental health support.

Ready to apply?

The application is on the official Anyscale careers page.

Apply on company site