Latest AI JobsBrowse Jobs
Anthropic logo

Pre-training Data Infrastructure Engineer

AnthropicSan Francisco, CAAI Research & Engineering
Apply on company site
Salary
Not listed
Job type
Full-time
Posted
3 Nov 2025
Status
Open · checked 7d ago

About this role

The Pre-training Data Infrastructure Engineer role at Anthropic involves building and operating end-to-end data pipelines for large language model training in San Francisco, making it an ideal opportunity for experienced distributed systems professionals passionate about safe and ethical artificial intelligence. Based in San Francisco, CA, this position focuses on creating high-throughput, fault-tolerant architectures that turn raw web-scale corpora into training-ready datasets.

Role Overview

Anthropic is seeking a Staff-level Engineer to join the Pre-training team and contribute to the development of the next generation of large language models. The professional in this position works at the intersection of cutting-edge research and practical engineering, helping build AI systems that are reliable, interpretable, and steerable. The role operates under a location-based hybrid policy where staff are expected to be in the office at least 25 percent of the time.

Key Responsibilities

Design and implement data processing infrastructure for large language model training with a focus on high performance, reproducibility, and traceability.
Develop and maintain core processing primitives, including tokenization, deduplication, and chunking, emphasizing scalability.
Build robust systems for data quality assurance and validation at scale.
Collaborate closely with research teams to implement novel data processing architectures.
Build and operate end-to-end data pipelines that convert raw web-scale corpora into training-ready datasets.
Engage in sample projects such as designing distributed computing architectures for web-scale data processing and building scalable infrastructure for model training data preparation.

Requirements

Five or more years of experience outside of internships.
Strong software engineering skills with proven experience building high-throughput, fault-tolerant distributed systems.
Hands-on experience using distributed computing frameworks, specifically Apache Spark.
Excellent problem-solving skills paired with strong attention to detail.
Strong communication skills and the ability to work effectively in a collaborative environment.
An advanced degree in Computer Science or a related field, or a Bachelor’s degree with an equivalent combination of education, training, and experience in a relevant field of study.
Background in Data Infrastructure, MLOps, or machine learning infrastructure.

Nice to Have

Significant experience building high-throughput, fault-tolerant distributed systems.
Expertise working with Python and Rust.
A deep passion for system reliability and performance.
Comfort working with ambiguous requirements and evolving specifications.
Ability to take ownership of problems and drive solutions independently.
Excitement about contributing to the development of safe and ethical artificial intelligence.
Capacity to balance technical excellence with practical delivery.
Eagerness to learn about machine learning research and its infrastructure requirements.

Skills and Tools

Python
Rust
Apache Spark
MLOps and distributed computing frameworks

Salary and Benefits

Annual base salary ranging from $500,000 to $850,000 USD.
Competitive compensation and benefits package.
Optional equity donation matching.
Generous vacation and parental leave.
Flexible working hours.
Access to an office space designed for team collaboration.
Visa sponsorship is available for eligible candidates.

About the Company

Anthropic is a public benefit corporation headquartered in San Francisco dedicated to creating reliable, interpretable, and steerable artificial intelligence systems. The organization approaches AI research as an empirical science, functioning as a single cohesive team focused on large-scale research efforts that align transformative AI with human interests.

How to Apply

Interested candidates should visit the official Anthropic careers page to submit an application for this position.

Skills and tech stack

PythonRustSparkMLOps

Questions candidates ask

What is the location and work policy for this role?

The position is based in San Francisco, CA, and operates under a location-based hybrid policy where staff are expected to work from an office at least 25% of the time.

What is the salary range for the Pre-training Data Infrastructure Engineer?

The annual base salary ranges from $500,000 to $850,000 USD.

What technical experience is required?

Candidates need at least 5 years of experience outside of internships, strong software engineering skills in building high-throughput fault-tolerant distributed systems, hands-on experience with Apache Spark, and an advanced degree in Computer Science or a related field (or equivalent education and experience).

Does Anthropic offer visa sponsorship for this position?

Yes, Anthropic sponsors visas and retains an immigration lawyer to assist with the process, making every reasonable effort to secure visas for offered candidates.

How should I apply for this job?

You should apply directly through the official Anthropic careers page.

Ready to apply?

The application is on the official Anthropic careers page.

Apply on company site