Latest AI JobsBrowse Jobs
B

Technical Program Manager, Model Performance

BasetenSan FranciscoEPD
Apply on company site
Salary
$165K - $330K USD
Job type
Full-time
Work mode
Remote
Posted
29 Aug 2026
Status
Open · checked 7d ago

About this role

The Technical Program Manager, Model Performance role at Baseten is a unique zero-to-one opportunity based in San Francisco or available remotely. This position suits an experienced program manager ready to build core planning structures and execution frameworks for advanced AI inference infrastructure from scratch.

Role Overview

Baseten is seeking its first Technical Program Manager to join the Model Performance organization. In this founding role, the professional will establish the planning structures, execution processes, metrics, and cross-functional alignment needed to productize performance R&D rapidly. Working within a dynamic team focused on core algorithms and methods for high-performance AI inference, the individual will turn loosely defined initiatives into predictable, well-governed programs.

Key Responsibilities

Manage execution across the active project portfolio within Model Performance, allowing technical leads to concentrate on technical direction.
Create and implement planning structures, operating cadences, and status reporting mechanisms tailored to the team.
Coordinate end-to-end model release and optimization programs, including day-zero launches and sequencing work across engineering, infrastructure, and release stakeholders.
Foster cross-team alignment as responsibilities expand from Model Performance Core into Model APIs and the inference production stack.
Identify and surface risks and dependencies early while providing clear status updates to leadership.
Collaborate with engineering leads to establish team structures and ownership boundaries during organizational scaling.

Requirements

Extensive background in technical program management running programs of similar scope and complexity.
Hands-on experience program-managing model performance or inference optimization work, with familiarity regarding serving stack engines.
Demonstrated ability to thrive in ambiguity and build zero-to-one programs without relying on pre-existing frameworks.
Ability to influence engineers, managers, and leaders across the organization without direct authority.
Exceptional written and verbal communication skills to make complex technical concepts understandable to any audience.
High-agency decision-making displaying strong ownership, accountability, and execution.

Nice to Have

Background in coordinating model release programs, particularly day-zero launches for large-scale models.
Previous hands-on software engineering experience.
Background in deep learning performance optimization, with a preference for inference applications.

Skills and Tools

Program management for complex machine learning or infrastructure environments.
Cross-functional coordination across engineering and product teams.
Risk management and framework design for zero-to-one initiatives.
Familiarity with large language models and high-performance inference concepts.

Salary and Benefits

Competitive compensation package featuring meaningful equity.
Full medical, dental, and vision insurance coverage for employees and dependents in the U.S.
Flexible paid time off policy, which includes a company-wide Winter Break closing offices from Christmas Eve to New Year's Day.
Paid parental leave.
Fertility and family-building stipend through Carrot.
U.S. company-facilitated 401(k) program.
Exposure to numerous machine learning startups providing unique learning and networking prospects.

About the Company

Baseten powers mission-critical inference for advanced AI companies, combining applied AI research, flexible infrastructure, and developer tooling to bring cutting-edge models into production. Backed by a recent Series F funding round led by prominent capital partners, the company is growing rapidly and helping engineers build the platform required to ship modern AI products.

How to Apply

Interested candidates should visit the official Baseten careers page to submit an application and learn more about joining the team.

Skills and tech stack

SparkLLM

Questions candidates ask

Where is this job located?

This position is based in San Francisco with remote flexibility available.

What department does this role belong to?

The role sits within the EPD department, specifically inside the Model Performance organization.

Is prior experience with inference optimization required?

Yes, candidates must have experience program-managing model performance or inference optimization work.

What benefits are provided for U.S. employees?

U.S. employees receive 100% medical, dental, and vision insurance coverage for themselves and dependents, a company-facilitated 401(k), flexible PTO with a Winter Break, paid parental leave, and a fertility and family-building stipend.

How should I apply for this position?

Candidates can apply directly on the official Baseten careers page.

Ready to apply?

The application is on the official Baseten careers page.

Apply on company site