Latest AI JobsBrowse Jobs
D

Sr Staff Site Reliability Engineer, AI Infrastructure

d-matrixSanta ClaraG&A
Apply on company site
Salary
$175K – $265K
Job type
Full-time
Work mode
Remote
Experience
Senior · 7+ yrs
Posted
29 Sept 2026
Status
Open · checked 7d ago

About this role

Based in Santa Clara, the Sr Staff Site Reliability Engineer, AI Infrastructure role at d-Matrix suits an experienced professional seeking a hands-on position managing core infrastructure layers for generative AI technology. This role focuses on maintaining reliability across physical and cloud environments to support silicon development and customer deployments.

Role Overview

d-Matrix employs this senior engineer to own system reliability, automation, and observability across colocation facilities, on-premises lab clusters, cloud platforms, and customer-facing services. The position involves collaborating directly with hardware and software engineering teams on continuous integration, quality assurance, and high-performance computing workloads. The work centers on direct system operation, ranging from physical hardware provisioning to live incident management.

Key Responsibilities

Manage reliability and availability across colocation server fleets, on-premises lab clusters, major cloud environments, and platform services.
Execute hands-on infrastructure tasks including server provisioning, operating system configuration, networking, storage, and hardware troubleshooting from bare metal to Kubernetes.
Manage capacity planning, hardware lifecycles, and cloud expenditure tracking to inform FinOps and workload decisions.
Implement infrastructure changes using Terraform and Ansible, contributing to shared Infrastructure as Code modules.
Create automation and documentation to reduce manual operational toil, including host management, health checks, and self-service tools.
Design and monitor observability metrics using tools like Prometheus, Grafana, DataDog, and Splunk.
Manage an on-call rotation for incident triage, resolution, and root cause analysis reporting.
Maintain platform services for internal teams and external partners while adhering to uptime commitments.

Requirements

Bachelor's or Master's degree in Computer Science, Electrical Engineering, or a related field, or equivalent practical experience.
Minimum of 7 years of professional experience in Site Reliability Engineering, infrastructure engineering, or systems administration.
In-depth Linux systems expertise with physical colocation or on-premises server hardware, networking, and storage.
Practical production experience writing and maintaining Infrastructure as Code with Terraform and Ansible.
Operational expertise with Kubernetes for cluster troubleshooting and workload management.
Proficiency in observability platforms such as Prometheus, Grafana, DataDog, or Splunk.
Production-level scripting capabilities in Python or Bash alongside formal incident response experience.

Nice to Have

Background in running customer-facing infrastructure or platform services.
Cloud infrastructure operations spanning AWS, Azure, or GCP in hybrid architectures.
Practical deployment of AI-driven infrastructure and AIOps tools in production.
Familiarity with high-performance computing job schedulers like Slurm or LSF.
Knowledge of high-speed interconnect technologies including InfiniBand, RoCE, or NVLink.
Experience building large-scale automation frameworks for fleet auto-healing and host lifecycles.

Skills and Tools

Linux
Terraform
Ansible
Kubernetes
Python
Bash
Prometheus
Grafana
DataDog
Splunk
AWS, Azure, GCP
Slurm, LSF
InfiniBand, RoCE, NVLink

Salary and Benefits

Salary range between $175K and $265K
Equity offerings
Bonus offerings

About the Company

d-Matrix concentrates on unlocking generative AI capabilities to drive technological transformation, working at the intersection of software and hardware innovation. The organization maintains an inclusive culture centered on mutual respect, direct communication, collaboration, and humility.

How to Apply

Interested candidates should apply directly through the official d-Matrix careers page.

Skills and tech stack

LinuxTerraformAnsibleKubernetesPythonBashPrometheusGrafanaDataDogSplunkAWSAzureGCPSlurmLSFInfiniBandRoCENVLinkLLMGenerative AI

Questions candidates ask

Where is the Sr Staff Site Reliability Engineer position located?

The position is based in Santa Clara.

What is the salary range for this role?

The salary ranges from $175K to $265K, with additional equity and bonus offerings.

How many years of experience are required?

Candidates must have 7 or more years of experience in SRE, infrastructure engineering, or systems administration.

What educational background is expected?

A Bachelor's or Master's degree in Computer Science, Electrical Engineering, or a related field is required, or equivalent experience.

How should applicants submit their resumes?

Applicants must apply directly through the official d-Matrix careers page as external agency submissions are not accepted.

Ready to apply?

The application is on the official d-matrix careers page.

Apply on company site