Latest AI JobsBrowse Jobs
Deepgram logo

Platform Engineer - AI/ML Infrastructure (Kubernetes & Terraform)

DeepgramUSA - RemoteEngineering
Apply on company site
Salary
$136K - $240K USD
Job type
Full-time
Work mode
Remote
Posted
3 Jul 2026
Status
Open · checked 7d ago

About this role

Role Overview

The Platform Engineer for AI/ML Infrastructure role at Deepgram involves designing and operating the hybrid infrastructure foundation that supports advanced AI and machine learning research and product development. This remote position within the United States suits professionals who enjoy tackling complex infrastructure challenges at the intersection of modern platform engineering and cutting-edge artificial intelligence.

Key Responsibilities

Architect, build, and maintain core computing platforms using Kubernetes across AWS and on-premise environments to support scalable applications and services.
Develop and manage the entire infrastructure utilizing Infrastructure-as-Code principles with Terraform for automated, versioned, and reproducible environments.
Design, construct, and optimize AI/ML job scheduling and orchestration systems by integrating Slurm with Kubernetes clusters to handle GPU resources efficiently.
Provision, maintain, and manage on-premise bare metal server infrastructure dedicated to high-performance GPU computing.
Implement platform networking solutions like CNI and service meshes, alongside storage solutions such as CSI and S3, to support high-throughput and low-latency hybrid workloads.
Create a comprehensive observability stack covering monitoring, logging, and tracing to guarantee platform health, alongside automation for performance tuning, incident response, and routine tasks.
Partner closely with machine learning engineers and AI researchers to identify infrastructure needs and deliver developer tools that speed up the development cycle.
Automate the complete lifecycle for single-tenant, managed deployments.

Requirements

Minimum of five years of professional background working in Site Reliability Engineering, DevOps, or Platform Engineering.
Demonstrated, hands-on experience in building and operating production infrastructure using Terraform.
Expert-level understanding of Kubernetes architecture and operational management in large-scale settings.
Strong capabilities in scripting and automation utilizing languages such as Python.
Working experience with continuous integration and continuous deployment systems like GitLab CI, ArgoCD, or Jenkins, alongside developer tooling creation.

Nice to Have

Hands-on experience with high-performance computing job schedulers like Slurm for managing resource-heavy GPU AI workloads.
Background in managing bare metal infrastructure including server lifecycle management, configuration, and provisioning through tools like MAAS or PXE boot.
Familiarity with cloud cost optimization strategies and FinOps principles.
Knowledge regarding Kubernetes storage solutions like Rook or Ceph, and networking tools such as Cilium or Calico.
Previous exposure to hybrid cloud or multi-region environments.

Skills and Tools

Terraform
Kubernetes
Python
AWS
Infrastructure-as-Code (IaC)
Slurm
CI/CD Systems

Salary and Benefits

Annual Salary Range: $136,000 to $240,000 USD

About the Company

Deepgram provides the platform behind the Voice AI economy, offering real-time APIs for text-to-speech, speech-to-text, and production-grade voice agents. Over 1,300 organizations and 200,000 developers utilize voice offerings powered by Deepgram. The organization operates with an AI-first mindset, requiring team members to actively experiment with and integrate advanced artificial intelligence tools into their daily workflows.

How to Apply

Interested candidates should visit the official Deepgram careers page to submit an application for this opportunity.

Skills and tech stack

PythonAWSKubernetesTerraform

Questions candidates ask

What is the salary range for the Platform Engineer position?

The annual salary for this role ranges from $136,000 to $240,000 USD.

Is this job remote?

Yes, this position is designated as USA - Remote.

What level of experience is required?

Candidates must have 5 or more years of experience in Platform Engineering, DevOps, or Site Reliability Engineering.

What core technologies will I work with?

The role involves working extensively with Kubernetes, Terraform, Python, AWS, and GPU workload schedulers like Slurm.

How should I apply for this job?

You should submit your application directly on the official Deepgram careers page.

Ready to apply?

The application is on the official Deepgram careers page.

Apply on company site