Latest AI JobsBrowse Jobs
Cohere logo

Data Annotation Specialist, Generalist

CohereCanadaData Quality (Contract)
Apply on company site
Salary
Not listed
Job type
Contract
Work mode
Remote
Posted
24 Jul 2026
Status
Open · checked 7d ago

About this role

Cohere is seeking a remote Data Annotation Specialist, Generalist to join their Data Quality team on a contract basis in Canada. This part-time, independent contractor opportunity is well-suited for analytical professionals with a background in AI evaluation, research, or content moderation who want to directly shape frontier enterprise AI models.

Role Overview

Data quality serves as the foundation for building machines that understand the world and operate safely. In this judgment-driven role, the specialist evaluates, stress-tests, and improves Large Language Models by providing structured feedback on English-language data spanning multiple modalities, including text, images, and structured formats like JSON, CSV/TSV, and Markdown.

Key Responsibilities

Complete preference and comparison tasks by evaluating model outputs against project guidelines for accuracy, helpfulness, tone, and safety, while writing clear justifications for judgments.
Probe models adversarially to identify failure modes, capability gaps, and unsafe behaviors, documenting reproducible cases for engineering and research teams.
Author high-quality prompts, responses, and exemplars to construct training and evaluation datasets.
Help design grading criteria and rubrics, applying them consistently across various task types.
Audit, label, and rectify inaccuracies across text, image, and structured data to preserve high data integrity.
Participate in calibration exercises and consistency checks, flagging ambiguous edge cases instead of guessing.
Adapt to new and evolving task types as project requirements shift.
Communicate quality and performance trends regarding model and agent behavior to cross-functional partners.

Requirements

Minimum of 1 year of experience in AI data annotation, LLM evaluation, content moderation, research, or a related analytical role involving quality assurance or preference ranking.
Strong contextual and sociocultural judgment, with the ability to apply detailed guidelines to ambiguous content where no single correct answer exists.
Comfort with ambiguity and a willingness to flag unclear edge cases while working on novel, experimental tasks.
Strong critical eye for spotting subtle errors, inconsistencies, and model failure modes like hallucinations or instruction-following gaps.
Excellent written English proficiency and reading comprehension, with the ability to clearly justify evaluations and author precise prompts.
Strong attention to detail and ability to maintain consistency across high-volume tasks.
Comfort utilizing annotation platforms and working with structured data formats.
Proven execution in a remote environment with independent time management skills.
Availability to commit to 16 hours per week as an independent contractor based in Canada.
Provision of a personal device (BYOD laptop) for work purposes.
Willingness to review human-generated and model-generated tasks that may occasionally involve exposure to NSFW, explicit, or offensive material.

Nice to Have

Familiarity with how large language models behave.
Fluency in an additional language.

Skills and Tools

Large Language Models (LLMs)
JSON, CSV/TSV, Markdown, XML, and YAML formats
Annotation platforms and quality assurance tools
Preference ranking and adversarial testing methodologies

Salary and Benefits

Contract rate of CAD $30 per hour.
Part-time commitment of 16 hours per week.
Independent contractor arrangement with project-based workflow.
Note that health benefits and standard employee perks are not provided for this contractor position.

About the Company

Cohere is a leading security-first enterprise AI company that builds cutting-edge foundation models and end-to-end products designed to solve real-world business problems. Headquartered in Toronto with key global offices, the company brings together researchers, engineers, and designers dedicated to driving widespread AI adoption safely and effectively.

How to Apply

Interested candidates should visit the official Cohere careers page to submit an application and begin the candidate journey.

Skills and tech stack

LLM

Questions candidates ask

What is the employment type and location for this role?

This is a remote, part-time independent contractor position available exclusively within Canada.

What are the time commitment and compensation details?

Contractors are expected to commit to 16 hours per week at a contract rate of CAD $30 per hour.

What equipment is required to perform the job?

This is a BYOD (Bring Your Own Device) role, meaning contractors must use their own laptop.

Does this role involve viewing inappropriate content?

Yes, the position involves working with model-generated and human-generated tasks that may occasionally expose the contractor to NSFW, offensive, or explicit text content.

What does the candidate selection process look like?

The hiring journey includes an initial application review, a multiple-choice email assessment, a comprehensive secondary assessment, a video call with the Operations Team, and an Independent Contractor Agreement for selected candidates.

Ready to apply?

The application is on the official Cohere careers page.

Apply on company site