Latest AI JobsBrowse Jobs
E

Research, Evals

ExaSan Francisco, CaliforniaResearch
Apply on company site
Salary
$180K - $350K USD
Job type
Full-time
Posted
15 Oct 2025
Status
Open · checked 7d ago

About this role

Role Overview

The Research, Evals position at Exa is a full-time opportunity based in San Francisco, California, centered on building and scaling evaluation frameworks for modern search engines. This role suits professionals with strong machine learning and software engineering backgrounds who want to shape the future of information retrieval in the artificial intelligence landscape.

Exa operates as an applied artificial intelligence lab constructing advanced search infrastructure, training state-of-the-art embedding models, and operating high-performance vector databases. The company powers search capabilities for major platforms and developers, backed by prominent investors, with the ultimate mission of organizing and retrieving global information.

Key Responsibilities

Investigate and establish evaluation methodologies specifically tailored for search engines in the age of large language models.
Design, build, and maintain comprehensive, creative, and effective evaluation suites that dictate optimization directions.
Develop scalable and reliable evaluation pipelines to monitor regressions, data drift, and quality signals across massive document sets.
Create golden datasets, synthetic benchmarks, agentic tasks, and real-world test suites reflecting human, developer, and agent usage.
Collaborate directly with machine learning researchers, data engineers, infrastructure teams, and product groups to refine search model feedback loops.

Requirements

Hands-on machine learning experience involving model training, fine-tuning, or evaluation, with an advantage for candidates familiar with embeddings or large language models.
Solid engineering fundamentals capable of producing reliable systems using Python, Rust, distributed pipelines, and GPU or cluster jobs.
A passion for data exploration through building evaluation sets, analyzing edge cases, and formulating creative measurement strategies.
Ability to work on-site at the San Francisco office location.

Skills and Tools

Python
Rust
Large Language Models (LLMs)
Distributed pipelines
GPU and cluster management tools
Vector databases and embedding models

Salary and Benefits

Annual salary range between $180,000 and $350,000 USD.
Premium healthcare benefits including medical, dental, and vision coverage.
Fertility benefits.
Sixteen weeks of fully paid parental leave for all new parents.
Monthly wellness stipend for all employees.
Visa sponsorship availability for international candidates such as STEM OPT, OPT, H1B, O1, and E3.

About the Company

Exa is an applied artificial intelligence lab developing an innovative search engine designed to process the entire web. The organization has built massive-scale infrastructure, trained foundational models for search, and designed high-performance vector databases to retrieve information over billions of documents. Serving hundreds of thousands of developers and major industry partners, Exa is backed by funding from Lightspeed, Benchmark, and a16z, with a mission to redefine how the world consumes information.

How to Apply

Interested candidates should visit the official Exa careers page to submit their application for the Research, Evals role.

Skills and tech stack

PythonRustLLM

Questions candidates ask

Where is this job located?

This is an in-person opportunity located in San Francisco, California.

What is the salary range for this position?

The annual salary ranges from $180,000 to $350,000 USD.

Does Exa provide visa sponsorship?

Yes, Exa sponsors international candidates for visas such as STEM OPT, OPT, H1B, O1, and E3.

What technical skills are required?

Candidates need hands-on machine learning experience, strong engineering fundamentals, and familiarity with technologies like Python, Rust, and large language models.

What benefits are offered to employees?

Employees receive premium healthcare benefits, fertility benefits, 16 weeks of fully paid parental leave, and a monthly wellness stipend.

Ready to apply?

The application is on the official Exa careers page.

Apply on company site