Latest AI JobsBrowse Jobs
Anyscale logo

Software Engineer, Infrastructure

AnyscaleSan FranciscoEngineering
Apply on company site
Salary
$200K - $240K USD
Job type
Full-time
Work mode
Remote
Posted
19 Aug 2026
Status
Open · checked 7d ago

About this role

Production is seeking a Software Engineer for the Platform and Infrastructure team to build and scale next-generation cloud infrastructure for distributed artificial intelligence applications. This full-time position is based in San Francisco with remote flexibility, perfectly suited for developers with a strong background in cloud-native technologies and distributed systems.

Role Overview

As a Software Engineer focusing on infrastructure, the professional will join the group responsible for both the control plane and data plane. The control plane manages cluster orchestration, scheduling, and user access, while the data plane ensures high-performance execution of distributed workloads. The engineer will design, build, and scale services that orchestrate clusters across cloud and on-premises environments, optimize control plane components for large-scale artificial intelligence operations, and create intelligent scheduling systems for heterogeneous compute clusters. Additional duties involve enhancing reliability, performance, scalability, and observability, supporting accelerator integrations like GPUs and TPUs, and managing container images and dependency resolution.

Key Responsibilities

Design, build, and scale orchestration services for clusters across cloud and on-premises environments supporting virtual machine and Kubernetes deployments.
Optimize control plane components tailored for massive distributed machine learning workloads.
Build intelligent scheduling and resource management systems for heterogeneous compute clusters.
Enhance the reliability, performance, scalability, and observability of managed workloads.
Support and optimize accelerator integrations such as GPUs and TPUs.
Handle container image management and dependency resolution for distributed jobs.
Participate in code reviews, system design, and architecture discussions.
Provide on-call support and collaborate with customer and field teams to troubleshoot infrastructure challenges.

Requirements

Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
Minimum of 3 years of experience writing high-quality production code.
Hands-on experience building and maintaining highly available, scalable, and performant distributed systems.
Expertise in cloud-native platforms including AWS, Azure, and GCP, alongside Kubernetes-based deployments.
Deep understanding of networking, security, and authentication mechanisms within cloud environments.
Familiarity with observability stacks such as Prometheus and Grafana.
Proficiency in programming languages like Go and Python.
Knowledge of low-level operating system foundations including the Linux kernel, file systems, and containers.

Skills and Tools

Python
Go
AWS
GCP
Azure
Kubernetes
Prometheus
Grafana
Linux Kernel and Containers

Salary and Benefits

Annual salary range between $200,000 and $240,000 in USD.
Competitive equity packages.
Comprehensive health, dental, and vision coverage with many plans up to 99 percent employer-covered.
Flexible time off policy.
Paid parental leave.
Mental health support services.

About the Company

Production is commercializing Ray, a popular open-source project that creates an ecosystem of libraries for scalable machine learning. Prominent technology companies utilize this technology to accelerate artificial intelligence applications into real-world production. The company is backed by prominent venture capital firms including Andreessen Horowitz, NEA, and Addition, with over $250 million raised to date.

How to Apply

Interested candidates should visit the official company careers page to submit their application for this position.

Skills and tech stack

Questions candidates ask

What is the salary range for this role?

The annual salary ranges from $200,000 to $240,000 USD.

Where is this job located?

This position is based in San Francisco with remote work options available.

How many years of experience are required?

Candidates must have at least 3 years of experience writing high-quality production code.

What technical skills are necessary for the position?

Required technical skills include proficiency in Python and Go, hands-on experience with Kubernetes, cloud platforms like AWS, GCP, and Azure, and a strong understanding of distributed systems.

What benefits are provided with this employment?

Benefits include competitive salary and equity, health, dental, and vision coverage with many plans up to 99% employer-covered, flexible time off, paid parental leave, and mental health support.

Ready to apply?

The application is on the official Anyscale careers page.

Apply on company site