Latest AI JobsBrowse Jobs
Anthropic logo

Head of Policy Design, Societal Harms

AnthropicSan Francisco, CASafeguards (Trust & Safety)
Apply on company site
Salary
Not listed
Job type
Full-time
Posted
28 Aug 2026
Status
Open · checked 7d ago

About this role

Role Overview

Anthropic is seeking a Head of Policy Design, Societal Harms to join the Safeguards organization in San Francisco, CA. This leadership position directs the teams responsible for defining safety boundaries regarding user well-being, election integrity, harmful manipulation, radicalization, and child safety. It is an ideal role for an experienced professional with a background in consumer harm management and frontier artificial intelligence systems who wants to guide the development of safe AI technologies.

Key Responsibilities

Lead, mentor, and expand the managers and teams overseeing consumer harms portfolios such as user well-being, child safety, election integrity, and harmful manipulation.
Coordinate policy decisions across the portfolio to ensure consistency, clarity, and proper tracking among all internal stakeholders.
Establish strategic alignment for how model-level mitigations, product interventions, and enforcement systems complement training efforts led by the alignment team.
Prioritize resource allocation across competing harm areas and articulate clear trade-offs to organizational leadership.
Function as the main escalation point for complex, high-severity consumer harm decisions and rapid responses to emerging risks.
Collaborate across engineering, product, legal, research, and data science teams throughout the model development cycle.
Interact with regulators, civil society groups, and external experts to refine enforcement practices and safety policies.

Requirements

Experience leading teams that include managers or senior specialists within product policy, AI safety, or a related domain.
Applied familiarity with consumer harm areas like child safety, mental health, manipulation, or election integrity.
Proven track record of cross-team collaboration and building durable working relationships.
Solid understanding of frontier model development, including fine-tuning, training cycles, evaluations, and deployment environments.
Ability to translate policy requirements into measurable, enforceable mechanisms for technical and non-technical audiences.
Sound judgment in high-consequence, ambiguous situations with a willingness to make critical decisions.
Minimum of a Bachelor’s degree or an equivalent combination of education, training, and experience.
Ability to work on a location-based hybrid policy, expected to be in the office at least 25% of the time.
Note that some responsibilities may involve exposure to explicit, violent, or psychologically disturbing material.

Nice to Have

Subject-matter depth in portfolio harm areas acquired through academia, clinical practice, government, civil society, or trust and safety work.
Experience collaborating directly with model research or training teams to shape deployed AI behaviors.
Familiarity with generative AI safety systems, including LLM-based classification, evaluation, and enforcement pipelines.
Background engaging external stakeholders such as election authorities, regulators, or mental health experts.
Experience utilizing agentic AI tools to scale operational and analytical workflows.

Skills and Tools

LLM
Policy Design and Product Policy
Cross-functional Leadership
Safety Evaluations and Enforcement Pipelines

Salary and Benefits

Annual Salary: $330,000 to $395,000 USD
Competitive compensation and benefits
Optional equity donation matching
Generous vacation and parental leave
Flexible working hours

About the Company

Anthropic builds reliable, interpretable, and steerable artificial intelligence systems focused on safety and societal benefit. Operating as a public benefit corporation headquartered in San Francisco, the organization approaches AI research as an empirical science through large-scale, collaborative efforts.

How to Apply

Interested candidates should submit their application directly on the official company careers page.

Skills and tech stack

LLM

Questions candidates ask

What is the salary range for the Head of Policy Design position?

The annual salary range for this role is between $330,000 and $395,000 USD.

Where is this job located?

This position is located in San Francisco, CA, with a location-based hybrid policy requiring staff to be in the office at least 25% of the time.

Does Anthropic offer visa sponsorship for this role?

Yes, Anthropic does sponsor visas and retains an immigration lawyer to assist candidates who receive an offer.

What level of education is required?

A minimum of a Bachelor’s degree or an equivalent combination of education, training, and professional experience is required.

Does the role involve viewing sensitive material?

Yes, some of the work involves exposure to explicit content, including material of a sexual, violent, or psychologically disturbing nature.

Ready to apply?

The application is on the official Anthropic careers page.

Apply on company site