Latest AI JobsBrowse Jobs
Anthropic logo

Performance Engineer

AnthropicSan Francisco, CA | New York City, NY | Seattle, WAAI Research & Engineering
Apply on company site
Salary
Not listed
Job type
Full-time
Posted
22 Apr 2024
Status
Open · checked 7d ago

About this role

Anthropic is seeking a Performance Engineer to build systems that optimize the throughput and robustness of massive distributed machine learning operations. This role is based in San Francisco, CA, New York City, NY, or Seattle, WA, and is ideal for results-driven software professionals passionate about supercomputing scale and AI advancement.

Role Overview

Operating machine learning algorithms at scale frequently introduces novel systems challenges. As a Performance Engineer, the professional in this role detects these issues and builds sophisticated systems to boost the robustness and throughput of the largest distributed networks. Ideal candidates bring a strong history of resolving large-scale systems problems while developing deep expertise in machine learning. Responsibilities include implementing low-latency sampling for large language models, crafting custom load-balancing algorithms, and building quantitative models for system performance.

Key Responsibilities

Design and execute low-latency, high-throughput sampling for large language models.
Write custom GPU kernels to adapt company models for low-precision inference.
Build custom load-balancing algorithms to maximize serving efficiency.
Construct quantitative models to measure and analyze system performance.
Implement fault-tolerant distributed systems operating on complex network topologies.
Troubleshoot and debug kernel-level network latency spikes within containerized environments.

Requirements

Substantial software engineering or machine learning background, specifically at supercomputing scale.
Results-oriented mindset characterized by flexibility and a high focus on impact.
Willingness to pick up tasks outside the standard job description and enjoy collaborative pair programming.
Minimum of a Bachelor’s degree or an equivalent combination of education, training, and experience in a relevant field of study.

Nice to Have

Background working with high-performance, large-scale machine learning systems.
Experience in GPU and accelerator programming alongside machine learning framework internals.
Familiarity with operating system internals and language modeling using transformers.

Skills and Tools

Distributed systems architecture and design
GPU and accelerator programming
Machine learning framework internals
OS internals and containerized environment debugging
Network topology and load-balancing optimization

Salary and Benefits

The annual compensation range for this position spans from $280,000 to $850,000 USD. Anthropic provides competitive compensation alongside benefits that include optional equity donation matching, generous vacation allowances, parental leave, flexible working hours, and collaborative office spaces.

About the Company

Anthropic operates as an AI safety and research company with a mission to create reliable, interpretable, and steerable AI systems that benefit society. The organization treats AI research as an empirical science, functioning as a single cohesive team focused on large-scale investigations. Staff follow a location-based hybrid policy requiring attendance in an office at least 25% of the time, and visa sponsorship is available for qualifying candidates.

How to Apply

Interested candidates should submit an application directly on the official company careers page.

Questions candidates ask

What is the salary range for the Performance Engineer role?

The annual salary for this position ranges from $280,000 to $850,000 USD.

Where is the position located?

The role is located in San Francisco, CA, New York City, NY, or Seattle, WA, with a hybrid work policy requiring staff to be in the office at least 25% of the time.

What education is required to apply?

Candidates need a Bachelor’s degree or an equivalent combination of education, training, and/or experience in a relevant field of study.

Does Anthropic offer visa sponsorship for this job?

Yes, Anthropic sponsors visas for this role and retains an immigration lawyer to assist candidates who receive an offer.

What kind of projects will a Performance Engineer work on?

Projects include implementing low-latency sampling for large language models, writing GPU kernels for low-precision inference, building load-balancing algorithms, and debugging containerized network latency spikes.

Ready to apply?

The application is on the official Anthropic careers page.

Apply on company site