Latest AI JobsBrowse Jobs
Lilt logo

Senior Quality Manager, Applied AI

LiltBoston, MAProduction
Apply on company site
Salary
$125K - $160K USD
Job type
Full-time
Work mode
Remote
Posted
1 Sept 2026
Status
Open · checked 7d ago

About this role

Role Overview

The Senior Quality Manager, Applied AI position at Lilt is a full-time hybrid role based out of the Boston, MA office. This opening suits an experienced quality professional with a background in machine learning systems who wants to lead evaluation frameworks for enterprise language technology.

Key Responsibilities

Ensure workflows are built for quality so every Applied AI deliverable ships with measured standards, reproducible rubric scores, and audit-ready figures.
Own technical tooling and quality infrastructure to track defect rates, acceptance rates, rework, and reviewer reliability without manual compilation.
Manage operational quality at scale by ensuring concurrent programs meet targets within agreed cost and throughput.
Provide formal delivery sign-offs, maintaining a documented go/no-decision process before shipping and investigating post-sign-off quality escapes.
Handle customer quality remediation by resolving disputes with quantitative analysis and identifying systemic annotator integrity issues internally.

Requirements

Bachelor of Science or Master of Science degree in a quantitative field such as Computer Science, Statistics, Data Science, Engineering, Linguistics, Human-Computer Interaction, or equivalent practical experience.
Six or more years of experience building or operating quality programs for machine learning or large language model systems.
Proven background in quality systems leadership, designing end-to-end quality frameworks across concurrent programs.
Strong grasp of measurement and statistics, including agreement methods, power and sample-size intuition, and error analysis.
Experience with rater and annotator operations involving calibration, drift monitoring, and integrity or fraud detection.
Hands-on familiarity with labeling and evaluation tooling and designing deterministic validations.
Strong understanding of data governance, dataset and version management, traceability, and audit-ready documentation.
Excellent communication skills to translate research goals into measurable quality targets and negotiate trade-offs with stakeholders.

Nice to Have

Fluency in multiple human languages.
Proficiency in a programming language alongside experience working with modern artificial intelligence frameworks.

Skills and Tools

Large Language Models (LLM)
Label Studio or similar labeling and evaluation tooling
Statistical reliability methods including Krippendorff’s alpha and Cohen’s kappa
Data governance and version management frameworks

Salary and Benefits

Annual Salary: $125,000 to $160,000 USD per year

About the Company

Lilt is an enterprise AI translation platform operating on a mission to make the world's information accessible to everyone regardless of spoken language. Founded by former Google Translate researchers, the company combines machine translation, Large Language Models, and human-in-the-loop expertise. Lilt is backed by Sequoia, Intel Capital, and Redpoint, and serves hundreds of global enterprises and government agencies.

How to Apply

To submit an application for this position, visit the official Lilt careers page and complete the application process.

Skills and tech stack

LLM

Questions candidates ask

What is the location and work arrangement for this role?

This position is based in the Boston, MA office and operates in a hybrid work capacity. U.S. work authorization is a precondition of employment.

What is the salary range for the Senior Quality Manager, Applied AI?

The annual salary for this role ranges from $125,000 to $160,000 USD per year.

How many years of experience are required?

Candidates must have 6+ years of experience building or operating quality programs for machine learning or large language model systems.

What educational background is needed?

Applicants need a B.S. or M.S. in a quantitative field such as Computer Science, Statistics, Data Science, Engineering, Linguistics, HCI, or equivalent practical experience.

What are some of the preferred qualifications?

Preferred qualifications include fluency in multiple human languages and proficiency in a programming language with modern AI framework experience.

Ready to apply?

The application is on the official Lilt careers page.

Apply on company site