Latest AI JobsBrowse Jobs
D

Director Site Reliability Engineer, AI Infrastructure

d-matrixSanta ClaraG&A
Apply on company site
Salary
$195K – $285K
Job type
Full-time
Work mode
Remote
Experience
Senior · 15+ yrs
Posted
26 Sept 2026
Status
Open · checked 7d ago

About this role

Director Site Reliability Engineer, AI Infrastructure is an infrastructure leadership role based in Santa Clara that suits an experienced engineering leader looking to build and scale an SRE function from the ground up. This position focuses on owning and scaling reliability across cloud, colocation, and on-premises lab environments for an AI silicon company.

Role Overview

This position involves establishing d-Matrix's Site Reliability Function from zero, managing infrastructure for software, validation, and customer-facing deployments. The professional will direct lab and data center operations, define service level objectives, and lead technical strategy while remaining hands-on with production systems.

Key Responsibilities

Build and lead the SRE function from scratch, defining its charter and hiring a team of 1 to 3 SRE engineers.
Direct a dedicated Data Center and Lab Technician team, setting operational standards across on-premises and colocation facilities.
Own 24 by 7 reliability across cloud, colocation, on-premises lab clusters, and customer-facing platform services.
Establish SRE processes from zero, including SLIs, SLOs, error budgets, on-call rotations, and incident management frameworks.
Own the full observability stack, instrumenting metrics, traces, and logs for SLO visibility.
Drive infrastructure-as-code automation and build self-healing infrastructure using Terraform and Ansible.
Manage FinOps and capacity planning across cloud, colocation, and on-premises tiers.
Lead the migration from ad-hoc storage to an enterprise-grade shared storage platform spanning hybrid environments.

Requirements

Bachelor's or Master's degree in Computer Science, Electrical Engineering, or a related field.
Minimum of 15 years of experience in SRE, infrastructure engineering, or production engineering.
Minimum of 5 years leading SRE or infrastructure engineering teams, including building functions from the ground up.
Deep Linux systems expertise, bare-metal operations, and enterprise shared storage platforms.
Proven experience operating colocation and on-premises hardware at scale.
Hands-on Infrastructure as Code fluency with Terraform and Ansible at production scale.
Kubernetes cluster operations experience at scale.
Full observability stack ownership using tools like Prometheus, Grafana, Datadog, or Splunk.
Strong Python and or Go scripting skills for production services and automation.
Executive communication skills and the ability to operate in a high-ambiguity environment.

Nice to Have

Experience operating customer-facing infrastructure or platform services.
Knowledge of high-speed interconnect fabrics such as InfiniBand, RoCE, or NVLink.
High performance computing job scheduler experience including Slurm or LSF.
Multi-cloud hybrid operations across AWS, Azure, and GCP.
FinOps expertise in cloud spend attribution and total cost of ownership modeling.
ITIL knowledge or equivalent structured incident, problem, and change management frameworks.
Published technical writing, conference talks, or open-source contributions.

Skills and Tools

Linux
Terraform
Ansible
Kubernetes
Python
Go
Prometheus
Grafana
Datadog
Splunk
AWS
Azure
GCP
InfiniBand
RoCE
NVLink
Slurm
LSF

Salary and Benefits

Salary range between $195K and $285K
Offers Equity
Offers Bonus

About the Company

d-Matrix designs and manufactures purpose-built AI inference silicon and software, focusing on unleashing the potential of generative AI. The company maintains an inclusive, collaborative culture centered on respect, humility, and direct communication.

How to Apply

Interested candidates should apply directly on the official company careers page.

Skills and tech stack

LinuxTerraformAnsibleKubernetesPythonGoPrometheusGrafanaDatadogSplunkAWSAzureGCPInfiniBandRoCENVLinkSlurmLSFNASSANNFSSMBGenerative AI

Questions candidates ask

Where is this job located?

The position is located in Santa Clara.

What is the salary range for this role?

The salary ranges from $195K to $285K, with offers of equity and bonus.

How many years of experience are required?

The role requires 15+ years in SRE, infrastructure engineering, or production engineering, with at least 5 years leading SRE or infrastructure engineering teams.

What educational background is required?

A Bachelor's or Master's degree in Computer Science, Electrical Engineering, or a related field is required.

Is visa sponsorship available?

Visa sponsorship details are not stated in the job posting.

Ready to apply?

The application is on the official d-matrix careers page.

Apply on company site