Latest AI JobsBrowse Jobs
Anyscale logo

Software Engineer, ML Developer Experience

AnyscaleSan FranciscoEngineering
Apply on company site
Salary
$226K - $283K USD
Job type
Full-time
Work mode
Remote
Posted
26 Aug 2026
Status
Open · checked 7d ago

About this role

Anyscale is seeking a Software Engineer to join the Machine Learning Developer Experience team in San Francisco, with remote flexibility. This full-time individual contributor role suits an experienced engineer passionate about building developer tools, SDKs, and MLOps platforms that simplify distributed computing for AI workloads.

Role Overview

The ML Developer Experience team manages the primary interaction layer of the Anyscale platform. This encompasses everything developers use to discover, configure, run, observe, and debug AI workloads, including command-line tools, software development kits, application programming interfaces, user interfaces, and workspaces. The engineer in this role will simplify distributed systems into manageable coding problems, building control-plane services, developer tools, and architecture that span from the Ray runtime up to cloud infrastructure.

Key Responsibilities

Design and develop agent-first command-line tools, consistent software development kits, application programming interfaces, and model context protocols with structured error handling and self-discovery.
Enhance the Anyscale Workspaces ecosystem to streamline the transition from local development to distributed execution, covering environments, dependencies, container images, and authentication.
Build frameworks supporting the entire machine learning lifecycle, such as data preparation, post-training fine-tuning, evaluation, serving, dataset management, and experiment tracking.
Create production deployment pipelines for trained models, spanning model registration, deployment workflows, benchmarking, and large language model service metrics.
Implement observability features across interfaces to help users diagnose system failures across tasks, jobs, actors, nodes, and graphics processing units.
Architect open integrations utilizing standards like OpenTelemetry and application programming interfaces compatible with OpenAI.
Design, scale, and operate highly available backend services supporting serverless and customer-managed cloud environments.

Requirements

Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
Minimum of 5 years of professional experience producing high-quality production code.
Strong fundamentals in system design, data structures, and algorithms.
Practical background utilizing modern machine learning tooling such as PyTorch, data catalogs, and related frameworks.
Demonstrated hands-on experience building and managing highly available production services.
Strong product sense with a history of shipping developer-facing tools that users actively adopt.

Nice to Have

Background maintaining or building open-source software projects.
Experience designing and running machine learning infrastructure in production environments.
Practical experience developing highly available serving systems.
Prior experience using Ray.

Skills and Tools

PyTorch
Machine Learning Operations (MLOps)
Large Language Models (LLMs)
Command-Line Interfaces (CLI)
Software Development Kits (SDK)
Application Programming Interfaces (API)
OpenTelemetry

Salary and Benefits

Annual Salary Range: $226,000 to $283,000 USD

About the Company

Anyscale is on a mission to democratize distributed computing for developers of all skill levels by commercializing Ray, a leading open-source framework for scalable machine learning. Prominent technology companies utilize Ray in their production tech stacks to accelerate artificial intelligence applications. Backed by prominent venture capital firms including Andreessen Horowitz, Addition, and NEA, Anyscale enables developers and data scientists to scale machine learning applications seamlessly from a local laptop to large distributed clusters.

How to Apply

Interested candidates should visit the official Anyscale careers page to submit an application for this position.

Skills and tech stack

PyTorchLLMMLOps

Questions candidates ask

What is the salary range for the Software Engineer, ML Developer Experience role?

The annual salary range for this position is between $226,000 and $283,000 USD.

Where is this position located?

The role is based in San Francisco with remote work options available.

How many years of experience are required?

Candidates must have 5+ years of experience writing high-quality production code.

What primary technologies and tools will I work with?

The role involves working with PyTorch, MLOps tooling, LLMs, command-line interfaces, SDKs, APIs, and OpenTelemetry.

How should I apply for this job?

You can apply directly on the official Anyscale careers page.

Ready to apply?

The application is on the official Anyscale careers page.

Apply on company site