Latest AI JobsBrowse Jobs
Anthropic logo

Staff + Senior Software Engineer, Inference Deployment

AnthropicSan Francisco, CA | New York City, NY | Seattle, WASoftware Engineering - Infrastructure
Apply on company site
Salary
Not listed
Job type
Full-time
Posted
29 Jun 2026
Status
Open · checked 7d ago

About this role

The Staff and Senior Software Engineer for Inference Deployment position at Anthropic involves building and maintaining the critical infrastructure that serves Claude to millions of users worldwide across multiple office locations. This role is ideal for engineers experienced in distributed systems who want to maximize compute efficiency and support next-generation AI research.

Role Overview

The Inference team at Anthropic tackles complex, distributed systems challenges across diverse cloud platforms and hardware accelerators. The position involves managing the entire stack from intelligent request routing to fleet-wide orchestration. Professionals in this role support explosive customer growth while providing high-performance infrastructure for scientists developing new AI models.

Key Responsibilities

Design, build, and maintain distributed systems serving Claude to a global user base.
Create resilient systems that adapt dynamically to real-world events and production workloads.
Build intelligent request routing, traffic management, and load balancing mechanisms across thousands of hardware accelerators.
Maximize compute efficiency through fleet-wide autoscaling and orchestration of production, research, and experimental workloads.
Operate and build production-grade deployment pipelines for releasing new models.
Deliver high-performance infrastructure that empowers researchers to develop next-generation models and integrate new accelerator platforms.

Requirements

Significant software engineering experience, specifically with distributed systems.
Results-oriented mindset with a strong bias for impact and flexibility.
Willingness to assist outside of direct job duties when needed.
A desire to deepen knowledge in machine learning systems and infrastructure.
Bachelor’s degree in a relevant field or an equivalent combination of education, training, and experience.
Ability to work under a hybrid policy requiring staff to be in the office at least 25% of the time.

Nice to Have

Experience with high-performance, large-scale distributed systems and machine learning systems at scale.
Familiarity with load balancing, request routing, and traffic management.
Knowledge of LLM inference optimization, batching, and caching strategies.
Experience working with Kubernetes and major cloud infrastructures like AWS, GCP, or Azure.
Proficiency in programming languages such as Python or Rust.

Skills and Tools

Python
Rust
AWS, GCP, and Azure
Kubernetes
Large Language Model (LLM) inference techniques
Distributed systems architecture

Salary and Benefits

Annual salary range between $320,000 and $485,000 USD.
Competitive compensation and benefits package.
Optional equity donation matching.
Generous vacation time and parental leave.
Flexible working hours and collaborative office environments.
Visa sponsorship available for qualifying candidates with immigration lawyer support.

About the Company

Anthropic is a public benefit corporation on a mission to build reliable, interpretable, and steerable AI systems that remain safe and beneficial for society. Operating as a single cohesive team, the organization approaches AI research as an empirical science akin to physics and biology. Employees collaborate closely in office spaces located in San Francisco, New York City, and Seattle.

How to Apply

Interested candidates should visit the official Anthropic careers page to submit an application. Applications are reviewed on a rolling basis with no fixed submission deadline.

Skills and tech stack

Questions candidates ask

What locations are available for this position?

This role is offered in San Francisco, CA, New York City, NY, and Seattle, WA, under a hybrid policy requiring time in the office at least 25% of the time.

What is the annual salary range for this role?

The annual salary range for the Staff and Senior Software Engineer, Inference Deployment position is $320,000 to $485,000 USD.

Does Anthropic offer visa sponsorship?

Yes, Anthropic sponsors visas and retains an immigration lawyer to assist candidates who receive an employment offer.

What education or experience is required?

Candidates need a bachelor's degree in a relevant field or an equivalent combination of education, training, and experience, along with significant software engineering experience in distributed systems.

How can I apply for this job?

You can apply by visiting the official Anthropic careers page, as applications are reviewed on a rolling basis.

Ready to apply?

The application is on the official Anthropic careers page.

Apply on company site