Latest AI JobsBrowse Jobs
Anthropic logo

Staff + Senior Software Engineer, Inference Infrastructure

AnthropicSan Francisco, CA | New York City, NY | Seattle, WASoftware Engineering - Infrastructure
Apply on company site
Salary
Not listed
Job type
Full-time
Posted
8 Jun 2026
Status
Open · checked 7d ago

About this role

Anthropic is currently seeking a Staff or Senior Software Engineer for Inference Infrastructure to design and maintain the systems that deliver Claude to a massive global user base. Based in San Francisco, New York City, or Seattle with a hybrid schedule, this opportunity suits experienced software professionals eager to tackle complex distributed systems and machine learning challenges.

Role Overview

The Inference team at Anthropic focuses on creating and maintaining critical platforms that serve Claude to millions of users daily. This group manages the complete technology stack, ranging from intelligent request routing to fleet orchestration across multiple AI accelerators. Operating with a dual focus, the team maximizes compute efficiency to support rapid customer growth while providing high-performance infrastructure for scientists developing next-generation models.

Key Responsibilities

Design, construct, and maintain distributed systems that reliably serve Claude to global users.
Build resilient, flexible systems capable of adapting instantly to real-world events and changing workloads.
Create sophisticated request routing, traffic management, and load balancing systems across thousands of accelerators.
Maximize overall compute efficiency through fleet autoscheduling and orchestration spanning production, research, and experimental environments.
Deliver production-grade deployment pipelines for releasing new models securely and reliably.
Supply high-performance inference infrastructure that empowers researchers to build advanced model architectures and integrate new AI accelerator platforms.

Requirements

Significant software engineering background focusing heavily on distributed systems.
Results-oriented mindset characterized by flexibility and a strong bias toward impact.
Willingness to support team objectives outside of standard job responsibilities.
Eagerness to expand knowledge surrounding machine learning systems and underlying infrastructure.
Comfort working in environments where technical excellence drives both business outcomes and research breakthroughs.
Minimum of a Bachelor’s degree or an equivalent combination of education, training, and professional experience in a relevant field.
Ability to meet the location-based hybrid policy, requiring time in one of the company offices at least 25% of the time.

Nice to Have

Practical background working with high-performance, large-scale distributed systems.
Experience implementing and deploying machine learning systems at scale.
Familiarity with load balancing, request routing, or traffic management technologies.
Knowledge of LLM inference optimization, caching strategies, and batching techniques.
Previous engagement with Kubernetes and cloud infrastructure providers such as AWS, GCP, or Azure.
Proficiency in programming languages including Python or Rust.

Skills and Tools

Distributed Systems Architecture
Python and Rust
Kubernetes
Cloud Platforms (AWS, GCP, Azure)
Machine Learning Infrastructure
LLM Inference Optimization
Traffic Management and Routing

Salary and Benefits

Annual compensation ranging from $320,000 to $485,000 USD.
Competitive compensation and benefits package.
Optional equity donation matching.
Generous vacation time and parental leave.
Flexible working hours and collaborative office spaces.
Visa sponsorship support provided where eligible, utilizing an immigration lawyer to assist candidates.

About the Company

Anthropic operates as a public benefit corporation headquartered in San Francisco with a mission to build reliable, interpretable, and steerable AI systems that remain safe and beneficial for society. The organization functions as a cohesive team tackling large-scale research initiatives, viewing AI research as an empirical science closely tied to physics and biology.

How to Apply

Candidates can submit applications directly on the official company careers page.

Skills and tech stack

PythonAWSGCPAzureKubernetesRustLLM

Questions candidates ask

What are the job locations for this position?

The role is available in San Francisco, CA, New York City, NY, or Seattle, WA, with a location-based hybrid policy requiring employees to be in the office at least 25% of the time.

What is the annual salary range for this role?

The annual salary range is between $320,000 and $485,000 USD.

Does Anthropic offer visa sponsorship for this position?

Yes, visa sponsorship is available for this role, and the company works with an immigration lawyer to assist successful candidates with the process.

What educational background is required?

Candidates must hold a Bachelor’s degree or an equivalent combination of education, training, and professional experience in a relevant field.

How should I submit my application?

Interested candidates should visit the official Anthropic careers page to submit their application securely.

Ready to apply?

The application is on the official Anthropic careers page.

Apply on company site