Latest AI JobsBrowse Jobs
Snorkel AI logo

Director, Research - Evaluation & Training

Snorkel AINew York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote)316 - Research
Apply on company site
Salary
Not listed
Job type
Full-time
Work mode
Remote
Posted
11 Jun 2026
Status
Open · checked 7d ago

About this role

Snorkel AI seeks a Director of Research for Evaluation and Training to lead a team focused on data evaluation, error analysis, and valuation methods. This remote or hybrid role based out of New York City or San Francisco suits an experienced technical leader with a strong background in applied artificial intelligence and machine learning research.

Role Overview

As the Director of Research for Evaluation and Training, the individual steps into a managerial position to oversee a team dedicated to showcasing the value of data for model training and evaluation. The selected candidate will direct efforts to analyze model failures, identify capability gaps, and suggest strategic benchmark investments. This position connects research findings directly with product development, go-to-market strategies, and client needs.

Key Responsibilities

Manage a multi-quarter roadmap focused on advanced data valuation, error analysis, and novel evaluation techniques.
Translate model failure analysis and benchmarking trends into actionable recommendations that inform company data strategy.
Direct data valuation techniques designed to measure how curated data improves model performance.
Lead, recruit, and mentor a team of researchers while maintaining high standards for execution speed and rigor.
Serve as the main communication bridge between research outputs, product teams, GTM strategies, and clients.

Requirements

Seven or more years of professional experience in applied machine learning, artificial intelligence, or research roles.
Four or more years of experience managing technical teams.
Demonstrated ability to convert research and analysis into tangible business results.
Strong market judgment regarding the competitive artificial intelligence and machine learning landscape.
Technical expertise and credibility in large language model evaluation, benchmarking, and model behavior analysis.
Strong trend-spotting abilities to translate evaluation results and failure cases into product directives.
Outstanding storytelling and communication skills for presenting technical insights to non-research audiences.

Nice to Have

Familiarity with data valuation or data attribution research.
Experience working alongside frontier laboratories, public benchmarks, or commercial artificial intelligence data and evaluation products.

Skills and Tools

Large Language Models (LLM)
Model behavior analysis
Data evaluation and error analysis
Benchmarking
Data valuation and attribution techniques

Salary and Benefits

Annual salary range from $275,000 to $425,000 USD, determined by experience, qualifications, skills, and geographic location.
Opportunities to shape strategic priorities and influence key company initiatives within a rapidly scaling organization.
Equal employment opportunity environment with a commitment to diversity, inclusion, and reasonable accommodations for individuals with disabilities.

About the Company

Founded out of the Stanford AI Lab in 2019, Snorkel AI operates as a frontier artificial intelligence data lab. The organization helps enterprises and leading artificial intelligence laboratories build environments and data for high-performing agentic and frontier AI systems through research-driven data development.

How to Apply

Interested candidates should submit their application directly on the official company careers page.

Skills and tech stack

Questions candidates ask

What is the salary range for the Director, Research - Evaluation & Training role?

The salary range for this position is $275,000 to $425,000 USD, with actual compensation determined by geographic location, skills, qualifications, and experience.

Where is this job located?

This position offers hybrid options in New York City, NY or San Francisco, CA, as well as remote availability across the United States.

What qualifications are required for this position?

Candidates must have 7+ years of experience in applied AI, ML, or research roles, including at least 4+ years of experience managing technical teams, along with expertise in LLM evaluation and benchmarking.

What are the primary responsibilities of the research director?

The director owns a multi-quarter roadmap for evaluation and data valuation, leads a team of researchers, shapes company data strategy through failure analysis, and acts as a bridge between research and product teams.

How do I apply for this position?

Applicants can apply directly through the official company careers page of Snorkel AI.

Ready to apply?

The application is on the official Snorkel AI careers page.

Apply on company site