Latest AI JobsBrowse Jobs
Anthropic logo

Staff Software Engineer, Inference

AnthropicLondon, UKSoftware Engineering - Infrastructure
Apply on company site
Salary
Not listed
Job type
Full-time
Posted
2 Feb 2026
Status
Open · checked 7d ago

About this role

The Staff Software Engineer, Inference position at Anthropic in London is a vital infrastructure role focused on developing and maintaining large-scale distributed systems that deliver the Claude AI assistant to millions of users globally. This opportunity suits experienced engineers who thrive on complex performance challenges across diverse hardware and cloud environments.

Role Overview

Anthropic seeks an experienced technologist to join the Inference team in London, UK. This group manages the end-to-end infrastructure stack responsible for serving models at scale, ranging from traffic management and request routing to fleet orchestration across various AI accelerators. The work directly impacts how millions of daily users interact with advanced artificial intelligence while supporting ongoing research and experimental workloads.

Key Responsibilities

Design, build, and maintain high-performance distributed systems that serve Claude to a global user base.
Create resilient, adaptable systems capable of responding to real-time events and shifting demands.
Implement intelligent request routing, load balancing, and traffic management solutions across thousands of accelerators.
Maximize compute efficiency through automated scaling and workload orchestration for production and research.
Build and operate production-grade deployment pipelines for releasing new models securely and reliably.
Provide infrastructure that empowers researchers to develop next-generation AI architectures.
Integrate emerging AI accelerator platforms and support inference for novel model designs.

Requirements

Proficiency in Python or Rust programming languages.
Professional software engineering experience building and running distributed systems in production environments.
Working knowledge of containerized infrastructure tools like Kubernetes alongside major cloud platforms such as AWS, GCP, or Azure.
A results-oriented mindset with a strong bias toward flexibility, impact, and willingness to assist outside core duties.
A deep interest in machine learning systems and a dedication to the societal impacts of artificial intelligence.
Minimum education of a Bachelor's degree in a relevant field, or an equivalent combination of education, training, and professional experience.
Ability to meet the location-based hybrid policy requiring time in the London office.

Nice to Have

Significant background in high-performance, large-scale distributed systems.
Practical experience implementing and deploying machine learning systems at scale.
History of building load balancing, request routing, or traffic management infrastructure.
Familiarity with LLM inference optimization, caching strategies, and batching.
Deep operating experience with Kubernetes, cloud environments, and specialized AI accelerators like GPUs and TPUs.

Skills and Tools

Python
Rust
Kubernetes
AWS, GCP, and Azure cloud platforms
Large Language Model (LLM) inference and optimization tools

Salary and Benefits

Annual base salary ranging from £325,000 to £390,000 GBP.
Optional equity donation matching.
Generous vacation and parental leave policies.
Flexible working hours and a collaborative office environment.
Visa sponsorship is available for qualified candidates.

About the Company

Anthropic is a public benefit corporation dedicated to creating reliable, interpretable, and steerable AI systems that remain safe and beneficial for society. Operating as a collaborative and cohesive team, the organization approaches AI research as an empirical science akin to physics or biology, focusing on large-scale efforts that drive meaningful long-term advancements.

How to Apply

Interested candidates should visit the official Anthropic careers page to submit an application and review further details about the opening.

Skills and tech stack

PythonAWSGCPAzureKubernetesRustLLM

Questions candidates ask

What is the location of the Staff Software Engineer, Inference role?

The role is based in London, UK, and operates under a location-based hybrid policy requiring staff to be in the office at least 25% of the time.

What is the salary range for this position?

The annual salary for this role is between £325,000 and £390,000 GBP.

Does Anthropic offer visa sponsorship for this job?

Yes, Anthropic sponsors visas for this role and provides assistance through an immigration lawyer if an offer is extended.

What core programming languages are required?

Candidates must be proficient in either Python or Rust.

How can I apply for this position?

You can apply directly by visiting the official Anthropic careers page.

Ready to apply?

The application is on the official Anthropic careers page.

Apply on company site