Latest AI JobsBrowse Jobs
Anthropic logo

Staff+ Software Engineer, Inference Velocity

AnthropicRemote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NYSoftware Engineering - Infrastructure
Apply on company site
Salary
Not listed
Job type
Full-time
Work mode
Remote
Posted
12 Jun 2026
Status
Open · checked 7d ago

About this role

Role Overview

The Staff+ Software Engineer, Inference Velocity position at Anthropic is a senior individual contributor technical lead role focused on optimizing developer productivity within the Inference organization. Based in San Francisco, Seattle, New York City, or available as remote-friendly with travel required, this position suits an experienced infrastructure expert who enjoys building systems and feedback loops that empower engineers to ship reliable AI software faster.

Key Responsibilities

Define technical direction and own the architecture and roadmap for toolchains, developer environments, and CI/CD systems across GPU (CUDA), TPU, and Trainium platforms.
Manage accelerator toolchains, including compilers, drivers, libraries, and frameworks, ensuring compatibility and stable performance for model serving.
Build efficient infrastructure for accelerator usage during development, featuring devbox environments, pre- and post-land validation automation, and cross-hardware shared tooling.
Measure and track productivity metrics for the Inference division, establishing dashboards and alerts to catch regressions, slow builds, and toolchain issues early.
Identify and eliminate workflow friction, bottlenecks, and toil for inference engineering teams.
Partner with the central Infrastructure organization to align on company-wide productivity initiatives and contribute specialized inference requirements.
Guide team members through design reviews, code reviews, and direct collaboration to elevate overall engineering quality.

Requirements

Minimum of 8 years of software engineering experience, including significant tenure as a technical lead or anchor on platform, infrastructure, or developer productivity teams.
Strong background in systems engineering, build and test infrastructure, or machine learning infrastructure.
Experience managing toolchains or development environments for compute-intensive workloads such as machine learning inference or training, high-performance computing, or large distributed systems.
Depth in at least one accelerator ecosystem, including CUDA/GPU, TPU, or Trainium/AWS Neuron.
Demonstrated ability to utilize engineering metrics, define service level objectives, and improve developer velocity.
History of driving technical alignment across organizational boundaries.
Excellent written and verbal communication skills with the ability to influence technical direction without formal authority.
Bachelor's degree in a relevant field of study or an equivalent combination of education, training, and professional experience.

Nice to Have

Experience working with machine learning compiler toolchains like XLA, Triton, or NeuronX, or managing accelerator firmware at scale.
Background in building shared development environments or ephemeral remote environments for hardware-dependent workflows.
Familiarity with large-scale CI/CD systems for accelerator hardware workloads.
Knowledge of Kubernetes-based development and job scheduling environments.
Prior technical leadership experience within a fast-growing artificial intelligence or machine learning company.

Skills and Tools

AWS
Kubernetes
CUDA and GPU frameworks
TPUs and Trainium
CI/CD pipelines
ML compiler toolchains including XLA, Triton, and NeuronX

Salary and Benefits

Annual salary range of $405,000 to $485,000 USD.
Competitive compensation and benefits package.
Optional equity donation matching.
Generous vacation and parental leave policies.
Flexible working hours.
Visa sponsorship available with professional immigration lawyer support.

About the Company

Anthropic operates as a public benefit corporation dedicated to creating reliable, interpretable, and steerable AI systems that are safe and beneficial for society. The organization functions as a single cohesive team tackling large-scale empirical science research inspired by fields like physics and biology, valuing high-impact outcomes over smaller puzzles.

How to Apply

Candidates should visit the official Anthropic careers page to submit an application and review open position details.

Skills and tech stack

AWSKubernetes

Questions candidates ask

What is the salary range for the Staff+ Software Engineer, Inference Velocity role?

The annual base salary range for this position is $405,000 to $485,000 USD.

Where is this position located?

This role is remote-friendly with required travel, and can be based out of San Francisco, CA, Seattle, WA, or New York City, NY.

How many years of experience are required?

Candidates must have at least 8 years of software engineering experience, with significant time spent as a technical lead or anchor on infrastructure, platform, or developer productivity teams.

Does Anthropic offer visa sponsorship for this role?

Yes, Anthropic does sponsor visas and works with an immigration lawyer to assist candidates throughout the process.

What are the primary hardware platforms supported?

The infrastructure spans across GPUs using CUDA, TPUs, and AWS Trainium platforms.

Ready to apply?

The application is on the official Anthropic careers page.

Apply on company site