Latest AI JobsBrowse Jobs
Handshake logo

AI Model Policy Trainer, Generalist (Seattle)

HandshakeSeattle, WAHAI Delivery Ops
Apply on company site
Salary
$30 - $85 USD per hour
Job type
Full-time
Posted
28 Aug 2026
Status
Open · checked 7d ago

About this role

The AI Model Policy Trainer, Generalist position at Handshake in Seattle offers a unique opportunity to evaluate AI model behavior by turning complex guidelines into consistent decisions. This full-time onsite role is ideal for detail-oriented individuals who enjoy analyzing nuanced edge cases and applying structured rubrics to emerging artificial intelligence technologies.

Role Overview

In this full-time W-2 position supported by TCWGlobal, the chosen professional evaluates user prompts, model responses, and conversation histories to classify behaviors according to specific customer policies. Team members tackle intricate cases where subtle differences in intent, context, or wording alter the correct category. The position requires navigating sensitive topics responsibly while collaborating with researchers, project leads, and fellow evaluators to maintain high calibration standards.

Key Responsibilities

Master customer guidelines, taxonomies, and evaluation rubrics, adjusting as project needs evolve.
Review user queries and artificial intelligence outputs within full conversational contexts.
Differentiate between closely related classification labels, policy boundaries, and severity levels.
Draft concise, evidence-grounded rationales that cite exact policy terms and dialogue details.
Spot emerging edge cases, policy contradictions, or gaps, raising questions when guidelines remain unclear.
Engage in calibration sessions with researchers and project leads, offering respectful challenges and updating judgments based on new evidence.
Apply customer rules consistently across repeated evaluations and quickly integrate constructive feedback.
Contribute to the ongoing enhancement of decision rules, evaluation frameworks, and quality standards.

Requirements

Ability to identify subtle distinctions where a single word, detail, or intent change shifts the correct answer.
Skill in holding strong professional opinions loosely, discussing disagreements respectfully, and writing clear audit-worthy reasoning.
Capacity to ask productive questions during ambiguous policy scenarios rather than guessing.
Talent for separating personal perspectives from customer standards while understanding both the letter and purpose of rules.
Readiness to maintain careful, consistent focus during repetitive tasks and adapt quickly to feedback.
Aptitude for learning unfamiliar subjects rapidly, operating independently, and recognizing when additional context is required.
Maturity and sound judgment needed to handle sensitive information and challenging subject matter responsibly.

Nice to Have

Professional background in language model evaluation, AI assessment, data annotation, reinforcement learning from human feedback, trust and safety, or content moderation.
Experience working with detailed taxonomies, regulatory language, detailed rubrics, or quality frameworks.
Familiarity with adjudication, quality audits, calibration, or drafting evaluation examples and policy guidance.
Interest in artificial intelligence safety alongside comfort in evaluating lengthy dialogues, incomplete contexts, and conflicting evidence.

Skills and Tools

Critical thinking and meticulous attention to linguistic detail
Evidence-based writing and rationale documentation
Collaborative calibration and respectful professional debate
Policy interpretation and taxonomy application

Salary and Benefits

Compensation ranges from $30 to $85 per hour, with specific placement dependent on experience for this 40-hour weekly assignment. Benefits administered through TCWGlobal include medical, dental, and vision insurance, flexible spending accounts, pretax commuter benefits, and a 401(k) retirement plan with an employer match. Eligible workers also receive voluntary life, accident, and critical illness insurance, pet and wellness reimbursements, charitable matching, and employee discounts. Paid time off accrues from day one at one hour per 40 hours worked up to annual caps, accompanied by statutory sick leave and 13 paid holidays.

About the Company

Handshake connects millions of job seekers, thousands of educational institutions, and countless employers with the core belief that everyone deserves a pathway to a meaningful career regardless of background or network. Handshake AI collaborates directly with frontier artificial intelligence laboratory researchers to build evaluations, publish benchmarks, and enhance models through human expertise.

How to Apply

Interested candidates should visit the official Handshake careers page to submit an application and review further instructions.

Questions candidates ask

What is the location and schedule for this role?

The position is onsite in Seattle, WA, operating Monday through Friday from 8:00 a.m. to 5:00 p.m. Pacific Time for 40 hours per week.

Who is the direct employer for this position?

The employer of record is TCWGlobal, serving as a W-2 assignment supporting Handshake AI.

What is the hourly pay range?

The compensation rate spans from $30 to $85 per hour, with placement determined by individual experience.

Does this role involve viewing sensitive or disturbing material?

Yes, evaluations regularly involve sensitive subjects such as self-harm, violence, sexual content, emotional distress, abuse, and discrimination within structured professional frameworks.

What benefits are available to full-time employees?

Eligible workers receive medical, dental, vision, 401(k) with match, flexible spending accounts, commuter benefits, insurance options, wellness perks, accrued paid time off, and 13 paid holidays through TCWGlobal.

Ready to apply?

The application is on the official Handshake careers page.

Apply on company site