Latest AI JobsBrowse Jobs
Figma logo

Director, Research - AI Evals

FigmaSan Francisco, CA • New York, NY • United StatesDesign
Apply on company site
Salary
Not listed
Job type
Full-time
Posted
13 Jul 2026
Status
Open · checked 7d ago

About this role

The Director, Research - AI Evals role at Figma is a senior position focused on establishing how artificial intelligence quality is measured across the platform's features, operating from US hubs or remotely within the United States. This leadership opportunity is ideal for an experienced research professional with a background in evaluating LLM-powered systems and managing cross-functional technical teams.

Role Overview

Figma is seeking a Director, Research - AI Evals to spearhead the measurement and evaluation of its artificial intelligence product capabilities. In this capacity, the selected individual will define what quality represents for AI features, design robust assessment frameworks, and deliver actionable insights that guide product shipping decisions. Working upstream from major development choices, this professional bridges qualitative and quantitative data to ensure AI tools meet rigorous standards before reaching millions of users.

Key Responsibilities

Establish and govern AI evaluation methods, quality dimensions, and operational processes for platform features.
Construct evaluation rubrics, golden datasets, and benchmark frameworks that combine human assessment with automated techniques like LLM-as-judge.
Collaborate with engineering to implement reproducible evaluation pipelines and regression testing protocols.
Deliver transparent dashboards and reports to help stakeholders make confident prioritization and go/no-go decisions.
Evangelize a unified definition of quality across different departments to standardize evaluation metrics.
Lead and manage a dedicated team responsible for executing AI evaluations using internal staff, contractors, and automated models.

Requirements

Ten or more years of professional experience in product development, research, applied research, or related fields.
Minimum of two years of direct management experience.
Hands-on expertise managing the evaluation of AI and LLM-driven products.
Strong command of AI evaluation design, covering human testing programs, golden-dataset creation, and inter-rater reliability.
Proficiency in both qualitative and quantitative research methodologies with an ability to analyze model behavior.
Demonstrated ability to address ambiguous quality goals and secure buy-in from executive stakeholders.

Nice to Have

Practical background in co-building automated evaluation pipelines or familiarity with tools like Braintrust, LangSmith, or DeepEval.
Experience establishing a brand new discipline or functional practice from the ground up.
Background in product design, user-centric product management, data science, or front-end engineering.
Familiarity with utilizing Figma's software suite.

Skills and Tools

LLM evaluation frameworks and automated model-based assessment techniques
Qualitative and quantitative research methods
Data analysis and performance metrics tracking
Evaluation pipeline development and regression testing familiarity
Figma platform knowledge

Salary and Benefits

The annual base salary range for this position spans from $258,000 to $348,000 USD, with the exact compensation determined by qualifications, skills, experience, and work location. Additional compensation elements include employee equity and an annual bonus plan. Comprehensive benefits cover health, dental, vision, retirement plans with company contributions, paid time off, flexible sick leave, parental leave, family planning support, mental health benefits, cell phone and home internet reimbursements, and lifestyle spending accounts.

About the Company

Figma builds a collaborative product design platform that allows teams to brainstorm, prototype, translate designs into code, and iterate using AI in real time. Dedicated to making design accessible to all, the company fosters an inclusive environment focused on continuous learning, diverse perspectives, and equal employment opportunities.

How to Apply

Interested candidates should submit their application directly through the official Figma careers page.

Skills and tech stack

LLMFigma

Questions candidates ask

What is the primary focus of the Director, Research - AI Evals role?

The role centers on owning and defining how Figma measures the quality of its artificial intelligence capabilities, establishing frameworks, and providing data-driven signals to guide product shipping decisions.

What level of experience is required to apply?

Candidates must have 10 or more years of experience in product, research, applied research, or a closely related field, including at least 2 years of management experience.

Is this position remote?

Yes, this is a full-time position that can be held from one of Figma's US hubs or remotely anywhere within the United States.

What is the salary range for this position?

The annual base salary range is between $258,000 and $348,000 USD, alongside equity and comprehensive benefits.

How should I apply for this position?

Candidates can apply by visiting the official Figma careers page.

Ready to apply?

The application is on the official Figma careers page.

Apply on company site