Latest AI JobsBrowse Jobs
Anthropic logo

Staff + Senior Software Engineer, Inference

AnthropicOntario, CANSoftware Engineering - Infrastructure
Apply on company site
Salary
Not listed
Job type
Full-time
Posted
17 Aug 2026
Status
Open · checked 7d ago

About this role

The Staff + Senior Software Engineer, Inference position at Anthropic involves developing and maintaining the infrastructure that delivers Claude to a global user base. Based in Ontario, this opportunity suits experienced software professionals eager to tackle distributed systems challenges and drive advancements in artificial intelligence.

Role Overview

Anthropic is looking for a skilled engineer to join the Inference team and manage the systems serving Claude to millions of users. The position centers on operating compute-agnostic inference deployments, handling everything from request routing to fleet orchestration across diverse AI hardware. Professionals in this role balance two primary goals: optimizing compute efficiency to support rapid customer expansion, and supplying researchers with high-performance infrastructure to create next-generation models.

Key Responsibilities

Design, build, and maintain distributed systems that reliably serve Claude to global users.
Create flexible, resilient systems capable of adapting in real time to dynamic events.
Establish intelligent request routing, traffic management, and load balancing systems across thousands of accelerators.
Optimize compute efficiency through autoscaling and orchestrating experimental, research, and production workloads.
Build and operate production-grade deployment pipelines for releasing new models.
Provide robust infrastructure to support researchers in developing advanced model architectures and integrating new AI accelerator platforms.

Requirements

Significant software engineering experience, specifically with distributed systems.
A results-oriented mindset with a strong bias toward flexibility and impact.
Willingness to take on tasks outside the formal job description when needed.
A desire to deepen knowledge regarding machine learning systems and infrastructure.
Ability to thrive in settings where technical excellence fuels research breakthroughs and business results.
A Bachelor’s degree or an equivalent combination of education, training, and experience in a relevant field of study.

Nice to Have

Experience working with high-performance, large-scale distributed systems.
Background in implementing and deploying machine learning systems at scale.
Familiarity with load balancing, request routing, or traffic management systems.
Knowledge of LLM inference optimization, caching, and batching strategies.
Experience utilizing Kubernetes and cloud infrastructure platforms like AWS, GCP, or Azure.
Proficiency in Python or Rust.

Skills and Tools

Python
Rust
AWS, GCP, Azure
Kubernetes
Distributed Systems and Infrastructure
LLM Inference Optimization

Salary and Benefits

Competitive compensation and benefits packages.
Optional equity donation matching.
Generous vacation time and parental leave.
Flexible working hours.
Access to a collaborative office space.

About the Company

Anthropic is a public benefit corporation dedicated to building reliable, interpretable, and steerable AI systems that benefit society. The organization operates as a collaborative group of researchers, engineers, and policy experts who approach AI research as an empirical science akin to physics or biology. Employees work closely together on large-scale research efforts aimed at long-term AI safety and trustworthiness.

How to Apply

Interested candidates should submit their application directly through the official Anthropic careers page.

Skills and tech stack

Questions candidates ask

What is the primary focus of the Inference team at Anthropic?

The Inference team builds and maintains critical systems that serve Claude to millions of users worldwide, maximizing compute efficiency while providing high-performance infrastructure for researchers.

What qualifications are required for this role?

Candidates need significant software engineering experience with distributed systems, a results-oriented mindset, a willingness to help outside normal duties, and a relevant Bachelor's degree or equivalent experience.

Is visa sponsorship available for this position?

Yes, Anthropic sponsors visas for candidates and works with an immigration lawyer to assist with the process when an offer is made.

What work policy does Anthropic follow regarding office attendance?

Anthropic maintains a location-based hybrid policy where staff are expected to work from an office at least 25% of the time, though some roles may require more frequent in-office presence.

How can I submit my application safely?

You should apply directly through the official Anthropic careers page and verify that any communications come from an official @anthropic.com email address.

Ready to apply?

The application is on the official Anthropic careers page.

Apply on company site