Latest AI JobsBrowse Jobs
S

Senior HPC & GPU Infrastructure Engineer

SciforiumSan Francisco, CAEngineering
Apply on company site
Salary
$150K – $220K
Job type
Full-time
Experience
Senior · 5+ yrs
Posted
6 Oct 2026
Status
Open · checked 7d ago

About this role

This position suits an experienced systems engineer who enjoys managing high-density accelerator environments, optimizing hardware performance, and debugging distributed infrastructure. The Senior HPC & GPU Infrastructure Engineer role is based in San Francisco, California, with Sciforium.

Role Overview

Sciforium is hiring a Senior HPC & GPU Infrastructure Engineer to manage the health, reliability, and performance of its GPU compute cluster. The professional chosen for this role acts as the bridge between hardware operations, distributed systems, and machine learning workflows.

Key Responsibilities

Respond to system outages, GPU failures, node crashes, and cluster-wide incidents to minimize downtime.
Monitor GPU health, thermal behavior, PCIe and NVLink topology, memory errors, and system load.
Coordinate with data center staff and hardware vendors for repairs, RMAs, and physical maintenance.
Administer Linux distributions, ensuring consistent configuration, kernel tuning, and automation across node fleets.
Configure network security, firewalls, VPNs, SSH hardening, and identity management systems like LDAP, FreeIPA, or Active Directory.
Administer distributed file systems including NFS, GPFS, and Lustre.
Lead the deployment of new GPU nodes, managing BIOS configurations, NUMA tuning, and cluster integration.
Build and optimize kernel modules, GPU drivers, and runtime stacks for both NVIDIA and AMD hardware.
Maintain machine learning frameworks and libraries such as PyTorch, JAX, CUDA, cuDNN, ROCm, and NCCL.
Troubleshoot complex issues involving compilers, distributed training runtimes, CUDA memory leaks, and ROCm kernel crashes.

Requirements

Minimum of 5 years of professional experience in HPC, GPU cluster operations, Linux systems engineering, or related fields.
Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related technical discipline.
Expertise working with NVIDIA (H100/B200) or AMD (MI325x/MI355x) GPUs, covering driver and kernel-level debugging.
In-depth knowledge of Linux internals, kernel modules, hardware bring-up, and systems performance tuning.
Experience with network security tools, VPNs, firewalls, and identity management.
Proficiency in Python and Bash scripting for automation and tooling.
Familiarity with machine learning software stacks, runtime behavior, NVLink/NVSwitch fabrics, and RDMA networking.

Nice to Have

Experience utilizing job schedulers such as Slurm, Kubernetes, or Run:AI.
Exposure to vLLM, inference systems, and model serving optimizations.
Hands-on practice with configuration management tools including Ansible, SaltStack, and Terraform.
Background supporting machine learning research teams in startup or research settings.

Skills and Tools

Linux (Ubuntu, CentOS, RHEL)
NVIDIA (CUDA, cuDNN, NCCL, H100, B200)
AMD (ROCm, MI325x, MI355x)
PyTorch
JAX
Python
Bash
NFS, GPFS, Lustre
LDAP, FreeIPA, Active Directory
NVLink, NVSwitch, RDMA
Slurm, Kubernetes, Run:AI
Ansible, SaltStack, Terraform
vLLM

Salary and Benefits

Salary range between $150K and $220K
Equity offerings
Medical, dental, and vision insurance coverage
401k retirement plan
Daily lunch, snacks, and beverages provided
Flexible time off policies

About the Company

Sciforium operates as an AI infrastructure company that builds next-generation multimodal AI models and a proprietary high-efficiency serving platform. The organization receives backing through multi-million-dollar funding and direct sponsorship from AMD, alongside hands-on engineering support.

How to Apply

Interested candidates should apply directly on the official Sciforium company careers page.

Skills and tech stack

LinuxUbuntuCentOSRHELNVIDIA CUDAcuDNNNCCLAMD ROCmPyTorchJAXPythonBashNFSGPFSLustreLDAPFreeIPAActive DirectorySlurmKubernetesRun:AIAnsibleSaltStackTerraformvLLMMachine LearningCUDADistributed Systems

Questions candidates ask

What is the salary range for the Senior HPC & GPU Infrastructure Engineer role?

The salary ranges from $150K to $220K alongside equity offerings.

Where is the position located?

The role is based in San Francisco, CA.

What level of experience is required?

Candidates must have 5+ years of experience in HPC, GPU cluster operations, Linux systems engineering, or similar roles.

What educational background is needed?

A Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related technical field is required.

What benefits are provided?

Benefits include medical, dental, and vision insurance, a 401k plan, daily lunch, snacks, beverages, and flexible time off.

Ready to apply?

The application is on the official Sciforium careers page.

Apply on company site