Latest AI JobsBrowse Jobs
Abridge logo

Member of Technical Staff, Machine Learning Infrastructure

AbridgeSF OfficeBuilder
Apply on company site
Salary
$221K - $260K USD
Job type
Full-time
Work mode
Remote
Posted
25 Aug 2025
Status
Open · checked 7d ago

About this role

Abridge seeks a Member of Technical Staff for Machine Learning Infrastructure to develop core inference systems based in the San Francisco office with remote flexibility. This full-time role suits an experienced engineer with a strong background in distributed systems and production machine learning environments.

Role Overview

As a core member of the builder team, this professional focuses on designing, optimizing, and maintaining the infrastructure that powers advanced machine learning models. Collaboration with research and product groups ensures high performance, minimal latency, and efficient scaling of backend systems. The position centers on enhancing computational workflows and supporting automated AI-driven clinical documentation tools.

Key Responsibilities

Design, deploy, and maintain scalable Kubernetes clusters dedicated to machine learning training and model inference.
Develop and optimize model serving architectures to guarantee high-throughput and low-latency performance.
Scale backend infrastructure by working closely with product and research divisions.
Improve GPU utilization and manage compute-heavy workloads efficiently.
Build robust application programming interface orchestration systems for generative artificial intelligence models.
Partner with leadership to plan and execute long-term scalability strategies.

Requirements

Five or more years of professional experience building and deploying machine learning models in live production environments.
Comprehensive knowledge of distributed systems architecture and container orchestration.
Advanced expertise in Kubernetes cluster management, custom resource definitions, and operators.
Practical background in developing application programming interfaces for both batch and real-time processing.
Strong interpersonal communication capabilities to bridge research and product teams effectively.

Nice to Have

Familiarity with model serving technologies such as NVIDIA Triton Server, VLLM, and TRT-LLM.
Hands-on practice with machine learning toolchains like PyTorch or TensorFlow, along with distributed training libraries.
Exposure to GPU cluster administration and CUDA optimization.
Understanding of infrastructure as code utilities including Terraform and Ansible alongside GitOps methodologies.
Experience with container registries, image optimization, and multi-stage builds.
Background in orchestrating automatic speech recognition or large language models.

Skills and Tools

Kubernetes
PyTorch
TensorFlow
Terraform
Distributed systems architecture
Large Language Model infrastructure

Salary and Benefits

Annual salary range between $221,000 and $260,000 in United States Dollars.
Comprehensive medical, dental, and vision insurance plans for employees and dependents.
Generous health savings account contributions alongside pre-tax flexible spending accounts.
Retirement 401(k) matching programs.
Generous paid time off, 14 paid holidays, and paid parental leave.
Family forming resources, mental health support, and a lifestyle wallet for wellness and professional growth.
Personal device allowance and paid sabbatical leave following five years of service.

About the Company

Abridge builds an artificial intelligence platform purpose-built for medical conversations, transforming patient-clinician interactions into structured clinical notes in real-time. Operating with deep electronic medical record integrations, the enterprise-grade technology maps summaries to ground truth using auditable intelligence. The organization brings together practicing medical doctors, researchers, engineers, and technologists across offices in San Francisco, New York, and Pittsburgh.

How to Apply

Interested candidates should visit the official company careers page to submit an application and review further details.

Skills and tech stack

PyTorchTensorFlowKubernetesLLMTerraform

Questions candidates ask

What is the salary range for this position?

The salary ranges from $221,000 to $260,000 per year.

Where is this job located?

The position is based out of the San Francisco office with remote flexibility options.

How many years of experience are required?

Candidates must have at least five years of professional experience in building and deploying machine learning models in production.

What technical skills are necessary?

Required skills include Kubernetes administration, container orchestration, distributed systems, and experience with frameworks like PyTorch or TensorFlow.

What benefits does the company provide?

Benefits include comprehensive health plans, 401(k) matching, health savings account contributions, flexible time off, paid parental leave, mental health support, and lifestyle wallet stipends.

Ready to apply?

The application is on the official Abridge careers page.

Apply on company site