Latest AI JobsBrowse Jobs
Deepgram logo

Senior Technical Program Manager (Engineering) - AI Tooling & Systems

DeepgramUSA - RemoteEngineering
Apply on company site
Salary
$152K - $208K USD
Job type
Full-time
Work mode
Remote
Posted
9 Jul 2026
Status
Open · checked 7d ago

About this role

Deepgram is seeking a Senior Technical Program Manager for AI Tooling and Systems to drive large-scale machine learning infrastructure initiatives from a remote location across the United States. This role suits an experienced technical leader who thrives on building scalable artificial intelligence systems and accelerating product delivery.

Role Overview

In this position, the program manager leads the complete delivery lifecycle for advanced artificial intelligence infrastructure programs, spanning model training pipelines, experiment tracking, inference serving, and production monitoring. The professional defines technical architecture, integration patterns, and rollout strategies for novel machine learning systems and tools including vector databases, model servers, and evaluation frameworks. By serving as the central link between machine learning research, engineering, product, and data groups, this individual ensures clear alignment on system requirements and delivery timelines.

Key Responsibilities

Own the end-to-end delivery of artificial intelligence infrastructure initiatives from training pipelines and experiment tracking to inference serving and monitoring.
Define technical architecture, integration patterns, and rollout strategies for new machine learning systems, vector databases, and evaluation frameworks.
Act as the connective tissue between machine learning research, engineering, product, and data teams to align on capability roadmaps and deployment schedules.
Drive cost and latency optimization for real-time inference workloads operating at high scale.
Build lightweight internal processes and tools to speed up machine learning iteration cycles including model versioning and A/B testing infrastructure.
Identify and clear technical bottlenecks across training pipelines, serving architecture, and model evaluation workflows.
Partner directly with machine learning practitioners to turn research breakthroughs into observable, scalable production systems.

Requirements

Five or more years of experience in technical leadership or program management focused on machine learning platforms, infrastructure, or artificial intelligence tooling.
Strong technical background in machine learning systems, including hands-on experience working as a systems engineer, machine learning engineer, or infrastructure specialist.
Demonstrated experience coordinating cross-functional machine learning programs covering the full journey from model training to evaluation, serving, and monitoring.
Proven ability to convert complex research and machine learning requirements into robust and scalable infrastructure.
High comfort level navigating ambiguity and helping multidisciplinary teams resolve technical tradeoffs involving accuracy, latency, and cost.
Excellent communication capabilities suited for both technical and non-technical stakeholders.
Familiarity with fast-paced startup or high-growth business environments.

Nice to Have

Practical background using model serving frameworks such as vLLM, TensorRT, or TorchServe.
Experience optimizing speech, audio, or large language model inference through quantization, distillation, batching strategies, or KV-cache optimization.
Familiarity with versioning and tracking tools including MLflow, Weights & Biases, or DVC.
Background involving feature stores, vector databases, or real-time machine learning systems.
Knowledge regarding cost optimization for graphics processing unit and machine learning workloads across cloud and on-premise environments.
Experience with edge deployment or multi-region model serving.
Practical use of frameworks like PyTorch, CUDA, Hugging Face, or cloud platforms such as AWS SageMaker, GCP Vertex AI, and Azure ML.

Skills and Tools

PyTorch
AWS
GCP
Azure
Large Language Models (LLMs)

Salary and Benefits

Annual Salary: $152,000 to $208,000 USD

About the Company

Deepgram operates as a leading platform supporting the Voice artificial intelligence economy by supplying real-time application programming interfaces for speech-to-text, text-to-speech, and production-scale voice agents. Over 1,300 organizations and 200,000 developers utilize voice offerings powered by Deepgram. The company utilizes voice-native foundation models accessible through cloud APIs or self-hosted and on-premises software. Operating with an artificial intelligence-first mindset, team members across the organization are expected to actively experiment with and integrate advanced artificial intelligence capabilities into their daily workflows.

How to Apply

Candidates should apply directly on the official Deepgram careers page.

Skills and tech stack

PyTorchAWSGCPAzureLLM

Questions candidates ask

What is the salary range for this role?

The annual salary ranges from $152,000 to $208,000 USD.

Is this a remote position?

Yes, this role is listed as USA - Remote.

What department does this role belong to?

This position is part of the Engineering department.

What level of experience is required?

Candidates need 5+ years of program management or technical leadership experience in machine learning infrastructure, platforms, or AI tooling.

How should I submit my application?

Applications should be submitted directly through the official Deepgram careers page.

Ready to apply?

The application is on the official Deepgram careers page.

Apply on company site