Latest AI JobsBrowse Jobs
Abridge logo

Member of Product Staff, AI/ML (Evals)

AbridgeSF OfficeBuilder
Apply on company site
Salary
$250K - $290K USD
Job type
Full-time
Work mode
Remote
Posted
22 Jun 2026
Status
Open · checked 7d ago

About this role

Role Overview

The Member of Product Staff, AI/ML (Evals) role at Generative AI for Clinical Conversations is a full-time position based in the SF Office with remote flexibility. This role suits an experienced product leader eager to drive the strategy, platform, and processes for measuring AI quality in healthcare technology.

Key Responsibilities

Drive product strategy and execution for the evaluations platform, owning the roadmap across the entire lifecycle.
Build shared measurement infrastructure enabling multiple teams to define quality, run experiments, compare models, and monitor production.
Make model selection fast and routine by establishing repeatable ways to evaluate frontier models and determine when specialty models are needed.
Own the operating model across pods, defining quality gates from early builds through general availability.
Collaborate cross-functionally with data engineering, data science, clinical science, and agent platform teams.

Requirements

5+ years of product management experience with significant ownership of machine learning-powered products or platform systems.
Deep understanding of model quality measurement, including evaluation frameworks, annotation pipelines, and benchmark design.
Strong technical fluency spanning machine learning, data pipelines, and distributed systems.
Experience collaborating closely with machine learning researchers and engineers to deliver production impact.
Ability to balance long-term architectural investments with near-term quality improvements.
Strong communication skills to translate complex technical concepts into clear decisions.
Track record of delivering high-quality products in domains where accuracy, reliability, and trust matter.

Nice to Have

Experience building evaluation platforms, machine learning observability systems, or quality measurement pipelines.
Background working in clinical, healthcare, or regulated environments with strict accuracy standards.
Experience working on domain-specific model adaptations.
Experience with personalization systems, context ingestion frameworks, or ambient intelligence products.
Experience shipping large-scale machine learning products featuring human-in-the-loop workflows.

Skills and Tools

Large Language Models (LLM)
Machine Learning Frameworks
Data Pipelines
Distributed Systems
Evaluation Frameworks and Annotation Pipelines

Salary and Benefits

Annual salary range of $250,000 to $290,000 USD
Comprehensive health plans including medical, dental, and vision coverage for employees and families
Generous Health Savings Account (HSA) contributions with eligible health plans
401(k) retirement contribution matching
Paid parental leave and family-forming support benefits
Generous time off featuring 14 paid holidays and flexible paid time off for salaried staff
Lifestyle wallet providing monthly contributions for fitness, professional development, and more
Personal device allowance, pre-tax commuter benefits, and flexible spending accounts
Mental health support access and paid sabbatical leave after five years of employment

About the Company

Abridge builds an AI-powered platform purpose-built for medical conversations to improve clinical documentation efficiencies. Founded in 2018, the company transforms patient-clinician interactions into structured clinical notes in real-time with deep electronic medical record integrations. A growing team of medical doctors, AI scientists, researchers, and engineers work across offices in San Francisco, New York, and Pittsburgh to set industry standards for responsible AI deployment in healthcare.

How to Apply

Interested candidates should visit the official company careers page at abridge.com to submit an application for this position.

Skills and tech stack

LLM

Questions candidates ask

What is the salary range for this role?

The annual salary for the Member of Product Staff, AI/ML (Evals) position is between $250,000 and $290,000 USD.

Where is this job located?

This position is based out of the SF Office with remote work options available.

What level of experience is required?

Applicants must have 5+ years of product management experience with significant ownership of machine learning-powered products or platform systems.

What are the primary responsibilities?

The role involves driving product strategy for the evaluations platform, building measurement infrastructure, standardizing model selection, and defining quality gates across multiple teams.

What benefits are provided?

Benefits include comprehensive health plans, HSA contributions, 401(k) matching, paid parental leave, flexible time off, lifestyle wallets, mental health support, and a personal device allowance.

Ready to apply?

The application is on the official Abridge careers page.

Apply on company site