Latest AI JobsBrowse Jobs
Lambda logo

Senior HPC Engineer - Fleet Engineering

LambdaSan Francisco Office (Fremont St)Data Center Business
Apply on company site
Salary
$227K - $356K USD
Job type
Full-time
Work mode
Remote
Posted
1 Sept 2026
Status
Open · checked 7d ago

About this role

Lambda is currently hiring a Senior HPC Engineer for the Fleet Engineering team in San Francisco with remote flexibility. This full-time role focuses on scaling and optimizing massive AI infrastructure, making it an ideal match for professionals with extensive distributed systems background.

Role Overview

The Senior HPC Engineer drives the reliability, performance, and scaling of large-scale high-performance computing clusters dedicated to artificial intelligence workloads. Responsibilities include building proactive monitoring systems, automating deployment pipelines, and troubleshooting complex networking and hardware faults.

Key Responsibilities

Build and operate monitoring and alerting tools for cluster health, tracking fabric, GPU, power, thermal, and job-level metrics to spot and handle issues early.
Remotely deploy and configure massive HPC clusters specifically designed for AI workloads utilizing automated methods.
Automate the complete cluster lifecycle covering operating systems, firmware, drivers, and networking as code using tools like Ansible and Terraform.
Design automated remediations and clear runbooks for frequent cluster failure scenarios to assist support teams.
Diagnose and fix complex problems spanning InfiniBand, RoCE, NCCL, GPU-direct, switching, and power infrastructures.
Take part in on-call schedules and direct incident responses for infrastructure-wide challenges.
Author standard operating procedures and supply actionable feedback to peer engineering departments to enhance operational stability.

Requirements

Minimum of 7 years of professional background working in Site Reliability Engineering, High-Performance Computing Engineering, DevOps, or related fields.
Deep familiarity with modern artificial intelligence hardware architectures and performance optimization techniques.
Strong command of Linux operating systems within distributed setups.
Hands-on background configuring and diagnosing InfiniBand, RoCE, CLOS fabrics, high-speed Ethernet, GPU-direct, and NCCL setups.
Proficiency in Python and Go, coupled with experience collaborating alongside software engineering units for internal tooling.
Familiarity with monitoring frameworks such as Prometheus, Grafana, and Clickhouse.
Expertise in automation and infrastructure-as-code platforms including Ansible and Terraform.
Exceptional analytical capabilities paired with meticulous attention to detail.

Nice to Have

Background working with machine learning frameworks like PyTorch and TensorFlow, plus benchmarking tools such as DeepSpeed and MLPerf.
Familiarity with containerization and cluster orchestration platforms like Docker and Kubernetes.
Previous experience building or maintaining HPC environments.
Specialized knowledge regarding NVIDIA hardware and firmware ecosystems.
Background in data center thermal and power design principles.
Exposure to chaos engineering or reliability testing techniques.
Familiarity with security and compliance standards including SOC 2 and ISO 27001.

Skills and Tools

Python
Go
PyTorch
TensorFlow
Kubernetes
Docker
Terraform
Ansible
Prometheus
Grafana
InfiniBand and RoCE networking

Salary and Benefits

Annual salary range between $227,000 and $356,000 in USD.
Generous cash and equity compensation packages.
Comprehensive medical, dental, and vision health coverage for employees and dependents.
Dedicated wellness and commuter stipends for eligible roles.
Retirement 401(k) plan featuring a 2% company match for US personnel.
Flexible paid time off policy.

About the Company

Established in 2012, Lambda operates as The Superintelligence Cloud, employing over 500 people and scaling rapidly. The enterprise serves tens of thousands of clients ranging from academic researchers to major hyperscalers, backed by prominent investors and industry partners.

How to Apply

Interested candidates should submit their application directly through the official Lambda careers portal.

Skills and tech stack

PythonPyTorchTensorFlowKubernetesDockerTerraform

Questions candidates ask

What is the salary range for the Senior HPC Engineer role?

The annual salary falls between $227,000 and $356,000 USD, depending on qualifications.

How many years of experience are required?

Candidates must have at least 7 years of professional experience in HPC engineering, SRE, DevOps, or a closely related field.

Is this job remote?

The position is based out of the San Francisco office on Fremont Street with remote flexibility.

What programming languages are required?

Applicants need a solid understanding of Python and Go.

What benefits are provided?

Lambda offers health, dental, and vision coverage, a 401(k) with a 2% company match, wellness and commuter stipends, cash and equity compensation, and flexible paid time off.

Ready to apply?

The application is on the official Lambda careers page.

Apply on company site