Latest AI JobsBrowse Jobs
B

Software Engineer - Training Infrastructure

BasetenSan FranciscoEPD
Apply on company site
Salary
$165K - $330K USD
Job type
Full-time
Work mode
Remote
Posted
29 Aug 2025
Status
Open · checked 7d ago

About this role

Baseten is hiring a Software Engineer for the Training Infrastructure team in San Francisco, with remote flexibility available for qualified candidates. This full-time role is ideal for experienced professionals with a background in distributed systems who want to build and scale cutting-edge platforms for machine learning training.

Role Overview

As a Software Engineer on the Training Infrastructure team, the selected candidate will architect and lead development for the machine learning training platform. The position involves supporting top-tier research engineers and model developers while making key technical choices for infrastructure that enables high-performance and reliable workload scaling. Responsibilities span ownership of scheduling, storage, networking, reliability, and observability across the entire training stack.

Key Responsibilities

Design and architect scalable infrastructure systems for the machine learning training platform, including scheduling, storage, and networking.
Partner closely with developers and research engineers to translate complex training needs into robust technical solutions.
Design and architect a global training scheduler alongside reinforcement learning systems and continuous learning pipelines.
Drive long-term system reliability enhancements and increase development velocity.
Collaborate closely with SRE and Capacity teams to unlock state-of-the-art training infrastructure.
Make critical architectural decisions that balance high performance with system reliability.
Lead technical discussions, mentor junior engineers on infrastructure best practices, and contribute to the long-term technical strategy and roadmap.

Requirements

Bachelor’s degree or higher in Computer Science or a related field.
Five or more years of professional experience.
Proficiency in Go.
Deep expertise with Kubernetes operating in production environments.
Advanced understanding of distributed systems concepts and performance tuning.
Proven background in designing observability systems.
Practical experience handling ML and AI workloads as well as MLOps platforms.

Nice to Have

Experience working with distributed storage systems.
Python programming experience is considered a plus.
Extensive familiarity with major cloud providers such as AWS and GCP, alongside neo-cloud providers like Crusoe, DigitalOcean, and Nebius.
Background using workload orchestration platforms including Temporal or Airflow.
Familiarity with open-source training frameworks and stacks such as NCCL, PyTorch, Megatron, NemoRL, VeRL, Axolotl, and Hugging Face Trainer, plus distributed training techniques like FSDP and DeepSpeed.
Experience developing AI products, tooling, or agents.

Skills and Tools

Go
Kubernetes
Distributed Systems
Observability Systems
MLOps Platforms
Python
AWS and GCP
Airflow and Temporal
PyTorch and Open Source Training Stacks

Salary and Benefits

Competitive annual compensation ranging from $165,000 to $330,000 in USD, including meaningful equity.
100% coverage of medical, dental, and vision insurance for employees and their dependents (U.S. only).
Flexible Paid Time Off policy, which includes a company-wide Winter Break where offices close from Christmas Eve to New Year's Day.
Paid parental leave.
Fertility and family-building stipend provided through Carrot.
Company-facilitated 401(k) plan (U.S. only).
Exposure to various machine learning startups, providing unique learning and networking opportunities.

About the Company

Baseten powers mission-critical inference for dynamic AI companies such as Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, the company enables teams operating at the AI frontier to bring cutting-edge models into production. Backed by a recent Series F funding round led by Altimeter Capital, Conviction Partners, and Spark Capital, Baseten is growing rapidly.

How to Apply

Interested candidates should apply directly through the official Baseten careers page to submit their application.

Skills and tech stack

PythonPyTorchAWSGCPKubernetesSparkMLOpsAirflow

Questions candidates ask

What is the salary range for the Software Engineer - Training Infrastructure role?

The salary ranges from $165,000 to $330,000 USD per year, and includes meaningful equity.

Is remote work allowed for this position?

Yes, this position offers remote work flexibility alongside the San Francisco office location.

What level of experience is required?

Applicants must have 5+ years of professional experience along with a Bachelor’s degree or higher in Computer Science or a related field.

What core technical skills are needed?

Key requirements include proficiency in Go, deep expertise with Kubernetes in production, advanced distributed systems knowledge, observability design experience, and background with ML workloads and MLOps platforms.

What benefits are provided to employees?

Benefits include competitive compensation with equity, full medical, dental, and vision coverage for U.S. employees and dependents, flexible PTO with a winter break, paid parental leave, a Carrot fertility stipend, and a company-facilitated 401(k).

Ready to apply?

The application is on the official Baseten careers page.

Apply on company site