Latest AI JobsBrowse Jobs
RunPod logo

Director of Infrastructure Engineering

RunPodRemote - USAEngineering
Apply on company site
Salary
$225K - $325K USD
Job type
Full-time
Work mode
Remote
Posted
9 Jul 2026
Status
Open · checked 7d ago

About this role

Role Overview

The Director of Infrastructure Engineering at RunPod leads and scales core cloud and bare-metal environments from a remote location within the USA. This full-time leadership position suits an experienced engineering leader eager to own foundational layers like SRE, global networking, and distributed storage for AI workloads.

Key Responsibilities

Lead multiple engineering teams responsible for Site Reliability Engineering, networking, and storage while establishing rigorous SRE practices.
Oversee the design, scaling, and operation of the global network backbone and ultra-low-latency HPC cluster networks, including InfiniBand and RoCE.
Direct the architecture and performance tuning of highly scalable, distributed storage systems to deliver massive IOPS and throughput.
Hire, mentor, and grow technical engineering managers and senior individual contributors within a remote-first setting.
Partner with Program Management and Product teams to forecast capacity requirements and shape technical roadmaps.
Drive measurable improvements in infrastructure reliability, deployment frequency, MTTR, and infrastructure as code coverage.
Provide architectural stewardship for bare-metal provisioning, virtualization layers, network fabrics, and storage clusters.

Requirements

7+ years of engineering leadership experience leading software, infrastructure, SRE, or networking teams, including managing managers and multiple squads.
8+ years building and operating large-scale distributed systems, bare-metal infrastructure, or public and private cloud platforms.
Strong background or architectural understanding of ultra-low latency networking, InfiniBand, RoCE, spine-leaf architectures, and BGP.
Experience operating or tuning high-performance distributed storage systems and parallel file systems.
Strong foundation in reliability engineering, infrastructure-as-code tools like Terraform and Ansible, container orchestration via Kubernetes, and observability stacks.
Experience building culture, accountability, and momentum across distributed technical teams.
Successful completion of a background check.

Nice to Have

Direct experience architecting and operating infrastructure optimized for massive GPU clusters and AI and ML workloads.
Deep understanding of hardware architectures, GPU interconnects including NVLink, and datacenter topology.
Track record of scaling infrastructure teams in hyper-growth startup environments.
Open-source contributions or active recognition within infrastructure, networking, or Kubernetes communities.

Skills and Tools

Kubernetes
Terraform
Ansible
InfiniBand
RoCE
BGP
Distributed Storage Systems

Salary and Benefits

Competitive base pay ranging from $225,000 to $325,000 per year, determined by experience, qualifications, and location.
Meaningful equity through stock options.
Generous medical, dental, and vision plans.
Flexible paid time off to recharge.
Remote work environment utilizing Slack for primary communication.
$1,200 home office and equipment stipend.

About the Company

RunPod operates as the AI Developer Cloud, providing a platform for more than one million developers, researchers, and enterprise teams to experiment, train, fine-tune, deploy, and scale AI workloads. Having processed over 20 billion inference requests and backed by a Series A funding round, the company operates as a small, remote-first team focused on building foundational AI infrastructure.

How to Apply

Apply directly on the official RunPod careers page to submit your application for this remote position.

Skills and tech stack

KubernetesTerraform

Questions candidates ask

What is the salary range for the Director of Infrastructure Engineering role?

The base salary ranges from $225,000 to $325,050 per year, depending on experience, qualifications, and location.

Is this position remote?

Yes, this is a remote position based in the USA within a remote-first team environment.

What technical skills are required for this role?

Required expertise includes infrastructure-as-code tools like Terraform and Ansible, Kubernetes for container orchestration, distributed storage systems, and advanced networking protocols such as InfiniBand, RoCE, and BGP.

What experience level is needed?

Candidates need 7+ years of engineering leadership experience managing managers and multiple squads, alongside 8+ years building and operating large-scale distributed systems or cloud platforms.

What benefits are included?

Benefits include stock options, medical, dental, and vision plans, flexible PTO, a $1,200 home office and equipment stipend, and remote work support.

Does RunPod offer visa sponsorship for this role?

RunPod is currently unable to sponsor employment visas for this position, though eligible candidates authorized to work in the United States are welcome to apply.

Ready to apply?

The application is on the official RunPod careers page.

Apply on company site