Latest AI JobsBrowse Jobs
Cohere logo

Senior Research Scientist, Model Evaluation

CohereTorontoModeling
Apply on company site
Salary
$250K - $535K CAD
Job type
Full-time
Work mode
Remote
Posted
22 Oct 2025
Status
Open · checked 8d ago

About this role

Cohere is hiring a Senior Research Scientist for Model Evaluation to design next-generation evaluation techniques and infrastructure for frontier AI systems. This full-time position can be performed remotely or out of the Toronto office, making it a great fit for AI researchers with strong software engineering skills who want to drive widespread enterprise AI adoption.

Role Overview

As models scale and become superhuman in practical use cases, developing advanced evaluation techniques becomes vital for tracking intelligence progress. This position centers on creating the evaluation methods and infrastructure needed to accurately measure large language model growth. The chosen professional will help establish what upcoming foundation models can accomplish.

Key Responsibilities

Design ambitious new evaluation benchmarks that test the boundaries of current model capabilities.
Collaborate across cross-functional teams to convert model feedback into reliable, repeatable evaluations.
Execute research to advance state-of-the-art evaluation methods, such as training LLM judges, refining data synthesis pipelines, and boosting evaluation efficiency.
Construct scalable, reusable tools designed to analyze model performance in depth.

Requirements

Experience rapidly building prototypes that reveal the limits of large language models and creating resources to gauge those abilities.
Hands-on background reviewing intricate data and model outputs to guarantee high data quality.
Passion for rigorously measuring artificial intelligence capabilities while aligning measurements with intended targets.
Strong software engineering abilities.

Skills and Tools

Large Language Models (LLM)

Salary and Benefits

Annual salary ranging from CAD 250,000 to CAD 535,000.
Weekly lunch stipend of $75 or local currency equivalent.
Comprehensive health and dental coverage, including a dedicated mental health budget.
Retirement plans including RRSP matching, 401K, and pension schemes.
Up to 6 months of 100% parental leave top-up for either parent.
Annual enrichment benefits covering arts, culture, fitness, wellness, and workspace improvements.
Education and learning stipends for coaching, courses, and conferences.
30 working days (6 weeks) of paid vacation.
Travel budget to visit other offices and an annual company offsite.
Home office setup stipend of $500, plus a co-working benefit for remote staff.

About the Company

Cohere is a prominent security-first enterprise artificial intelligence company building cutting-edge foundation models and end-to-end products to solve real-world business challenges. Headquartered in Toronto with major international offices in London, New York City, San Francisco, Montreal, Paris, Berlin, and Seoul, the organization brings together passionate global teams of researchers, engineers, and designers.

How to Apply

Interested candidates should submit their application directly through the official Cohere careers page.

Skills and tech stack

Questions candidates ask

What is the salary range for the Senior Research Scientist, Model Evaluation role?

The yearly salary spans between CAD 250,000 and CAD 535,000.

Can I work remotely for this position?

Yes, this role can be based remotely or from one of the company's designated office locations with no minimum in-office requirement.

What perks and benefits are included for full-time employees?

Employees receive health and dental benefits, retirement matching, a weekly lunch stipend, 6 weeks of paid vacation, parental leave top-ups, learning stipends, and wellness allowances.

Where is Cohere headquartered?

Cohere is headquartered in Toronto, Canada, with additional offices in London, New York City, San Francisco, Montreal, Paris, Berlin, and Seoul.

How should I apply for this job?

You should apply directly on the official Cohere careers page.

Ready to apply?

The application is on the official Cohere careers page.

Apply on company site