Latest AI JobsBrowse Jobs
B

Engineering Manager, Runtime Fabric

BasetenSan FranciscoEPD
Apply on company site
Salary
$165K - $330K USD
Job type
Full-time
Work mode
Remote
Posted
9 Jun 2026
Status
Open · checked 7d ago

About this role

Baseten is seeking an Engineering Manager for the Runtime Fabric team in San Francisco or remote to lead the development of specialized container runtimes for AI inference workloads. This position is well-suited for an experienced systems engineering leader with a strong open-source background who wants to shape the future of artificial intelligence infrastructure.

Role Overview

Baseten powers mission-critical inference for dynamic artificial intelligence companies. Traditional container runtimes struggle with artificial intelligence workloads due to GPU memory constraints, slow image pulls, and isolation challenges. The Runtime Fabric team builds purpose-built container runtime and storage layers designed specifically for artificial intelligence inference. As the Engineering Manager, this role involves guiding technical direction, growing a team of systems engineers, and ensuring the group's contributions influence the broader open-source container ecosystem.

Key Responsibilities

Recruit, hire, and mentor a high-performing team of systems engineers specializing in containers and Linux.
Shape team culture around technical rigor, continuous improvement, and open-source contributions while providing ongoing career development.
Partner with leadership to define long-term roadmaps for container runtime and storage infrastructure.
Direct the optimization of containerd, runc, and related open-container initiative projects for GPU-specific inference demands.
Oversee the Baseten Delivery Network architecture to improve cold start speeds and eliminate scaling bottlenecks.
Provide technical oversight for secure, GPU-aware isolation mechanisms including namespaces, secure runtimes, and micro-VMs.
Collaborate across departments to prioritize infrastructure investments and communicate progress clearly.

Requirements

Demonstrated experience managing and scaling engineering teams within low-level runtime, systems, or infrastructure contexts.
Deep familiarity with the Linux container stack, including containerd, runc, OCI specifications, namespaces, and cgroups.
Documented contributions to relevant open-source projects such as containerd, runc, gVisor, or Kata Containers.
Robust systems programming background utilizing languages like Go, C, or C++.
Practical knowledge of distributed storage systems, content-addressable storage, or large-scale caching solutions.
Solid understanding of how container images are organized, stored, and distributed at scale.
Excellent written and verbal communication abilities to influence stakeholders across the organization.

Nice to Have

Practical exposure to container GPU device access through the NVIDIA Container Toolkit, CDI, or GPU-aware scheduling.
Familiarity with lazy-loading snapshotters or peer-to-peer image distribution methods.
Experience working with secure container runtimes or micro-VM technologies like Firecracker.
Knowledge of the containerd shim API and building custom shim implementations.
Background operating within multi-tenant infrastructure or security-sensitive environments.

Skills and Tools

Spark
C++
Go
containerd
runc
Linux Containers
Distributed Storage

Salary and Benefits

The annual salary range for this position is $165,000 to $330,000 in USD. Baseten provides competitive compensation alongside meaningful equity. U.S. employees receive full medical, dental, and vision insurance coverage for themselves and dependents. Additional offerings include a flexible paid time off policy featuring a company-wide winter break, paid parental leave, a fertility and family-building stipend, and a company-facilitated 401(k).

About the Company

Baseten provides essential inference infrastructure for prominent artificial intelligence companies. The organization recently secured a Series F funding round led by Altimeter Capital, Conviction Partners, and Spark Capital. Baseten values diversity, operates as an equal opportunity employer, and follows fair chance hiring ordinances.

How to Apply

Interested candidates should visit the official Baseten careers page to submit an application for this role.

Skills and tech stack

SparkC++

Questions candidates ask

What is the salary range for the Engineering Manager, Runtime Fabric role?

The salary ranges from $165,000 to $330,000 USD per year.

Is this position remote?

Yes, this role offers remote flexibility alongside a San Francisco location option.

What specific open-source experience is required?

Candidates must have prior contributions to open-source projects such as containerd, runc, google/gvisor, kata-containers, or closely related initiatives.

What benefits are included for U.S. employees?

U.S. employees receive 100% medical, dental, and vision coverage for themselves and dependents, a 401(k), flexible PTO, parental leave, and family-building stipends.

How should I apply for this job?

Interested applicants should apply directly through the official Baseten careers website.

Ready to apply?

The application is on the official Baseten careers page.

Apply on company site