Latest AI JobsBrowse Jobs
Cohere logo

Staff Research Engineer, Model Efficiency

CohereNew YorkModeling
Apply on company site
Salary
$250K - $535K CAD
Job type
Full-time
Work mode
Remote
Posted
7 Nov 2025
Status
Open · checked 7d ago

About this role

Cohere is seeking a Staff Research Engineer for Model Efficiency to develop, prototype, and deploy techniques that improve foundation model speed and production efficiency. Based remotely or out of the New York office, this full-time role suits an experienced machine learning professional passionate about large language models.

Role Overview

Large Language Models continually advance AI capabilities, yet inference remains a primary operational bottleneck. The Model Efficiency team focuses on pushing the limits of inference efficiency across foundation models by exploring breakthroughs throughout the execution stack. Team members work on model architecture, mixture of experts routing optimization, decoding algorithms, software and hardware co-design for graphics processing units, and performance optimization while preserving model quality. This position is remote-friendly, with a concentration of team members located in Eastern and Pacific time zones.

Key Responsibilities

Create, prototype, and release methods that materially enhance how quickly and efficiently foundation models operate in production settings.
Investigate and ship advancements across the model execution stack.
Optimize large language model inference under specific resource constraints.

Requirements

Hold a Doctor of Philosophy degree in Machine Learning or a closely related discipline.
Possess a solid understanding of large language model architecture and inference optimization under resource constraints.
Bring significant hands-on experience utilizing techniques that boost model efficiency.
Demonstrate strong software engineering capabilities.
Show an appetite for operating within a fast-paced, high-ambiguity startup environment.
Have a record of publications at top-tier venues and conferences such as NeurIPS, ICLR, and ACL.
Exhibit a strong passion for mentoring colleagues.

Skills and Tools

Large Language Models
Machine Learning Research and Engineering
Model Architecture and Inference Optimization
Software and Hardware Co-Design

Salary and Benefits

Annual salary ranging between $250,000 and $535,000 CAD.
Comprehensive health and dental coverage, including a dedicated budget for mental health support.
Retirement savings options including 401K, RRSP matching, and pension schemes.
Up to six months of fully paid parental leave top-up for either parent.
Thirty working days (six weeks) of paid vacation.
Annual enrichment perks covering fitness, wellness, arts, culture, workspace improvements, and learning stipends.
Weekly lunch stipend of $75 or equivalent local currency, alongside home office and travel budgets.

About the Company

Cohere functions as a leading security-first enterprise artificial intelligence company building cutting-edge foundation models and end-to-end products to address real-world business challenges. Operating as a global technology firm headquartered in Toronto with major hubs in locations like New York City, San Francisco, London, Paris, Berlin, Seoul, and Montreal, the organization values inclusivity and equal opportunities.

How to Apply

Interested candidates should visit the official Cohere careers page to submit their application for this position.

Skills and tech stack

Questions candidates ask

What is the salary range for the Staff Research Engineer role?

The salary ranges from $250,000 to $535,000 CAD per year.

Can this position be performed remotely?

Yes, the role can be based remotely or from one of the company's designated office locations, with a preference for candidates aligned with Eastern or Pacific time zones.

What educational background is required?

Applicants must hold a PhD in Machine Learning or a related field.

What kind of time off does Cohere offer full-time employees?

Employees receive 6 weeks of paid vacation, which equals 30 working days.

How should I submit my application?

Candidates should apply directly through the official Cohere careers page.

Ready to apply?

The application is on the official Cohere careers page.

Apply on company site