Latest AI JobsBrowse Jobs
Anyscale logo

Software Engineer (Ray Core)

AnyscaleSan FranciscoEngineering
Apply on company site
Salary
$215K - $265K USD
Job type
Full-time
Posted
3 Sept 2026
Status
Open · checked 7d ago

About this role

Anyscale is seeking a full-time Software Engineer for the Ray Core team based in San Francisco to build and optimize distributed computing infrastructure. This engineering position suits experienced systems developers who want to advance scalable open-source AI technology.

Role Overview

The Ray Core team builds and maintains the C++ backend for Ray, focusing on distributed schedulers, memory subsystems, and language runtime integration. Professionals in this position balance new feature development, debugging, testing infrastructure improvements, and long-term architectural enhancements. Engineers help make distributed programming accessible to developers of all backgrounds while driving performance and reliability across large-scale workloads.

Key Responsibilities

Lead cross-functional projects while guiding and mentoring junior teammates.
Build premium open-source software designed to simplify distributed programming.
Research, design, and execute architectural enhancements for the core Ray system.
Enhance testing procedures to streamline software releases and maintain system stability.
Share technical achievements with wider audiences through tutorials, technical talks, and blog posts.

Requirements

Minimum of five years of professional work experience in software engineering.
Proven background in constructing fault-tolerant and scalable distributed systems.
Extensive professional experience utilizing C and C++ alongside low-level operating systems.
Strong foundational knowledge covering system design, algorithms, and data structures.

Nice to Have

Familiarity with GPU programming concepts.
Understanding of distributed model training and inference methods, including pipeline parallel and tensor parallel architectures.

Skills and Tools

C++
Azure
Distributed Systems Design
Algorithms and Data Structures
Low-Level Operating Systems

Salary and Benefits

Annual base salary ranging from $215,000 to $265,000 paid in USD.
Equity options.
Comprehensive health, vision, and dental insurance plans with many options up to 99 percent covered by the employer.
Flexible time off policies.
Paid parental leave programs.
Dedicated mental health support resources.

About the Company

Anyscale commercializes Ray, an open-source project delivering scalable machine learning libraries used by prominent global enterprises like OpenAI, Uber, Spotify, Instacart, and Cruise. The organization is backed by prominent investors including Addition, NEA, and Andreessen Horowitz, having raised over $250 million to date. Recent enterprise partnerships with Azure, CoreWeave, and Google Cloud continue expanding AI-native compute availability.

How to Apply

Interested candidates should visit the official Anyscale careers page to submit their application for this San Francisco based role.

Skills and tech stack

Questions candidates ask

What is the salary range for this role?

The salary ranges from $215,000 to $265,000 per year in USD.

Where is the job located?

This position is located in San Francisco, United States, and is not remote.

How many years of experience are required?

Applicants must have a minimum of five years of relevant professional experience.

What core programming language is required?

Extensive professional experience in C and C++ working on low-level operating systems is required.

What benefits are included?

Benefits include competitive salary and equity, health, dental, and vision coverage with many plans up to 99 percent employer-covered, flexible time off, paid parental leave, and mental health support.

Ready to apply?

The application is on the official Anyscale careers page.

Apply on company site