About this role
Designing and running third-party assessment programs for frontier models and safeguards forms the core of daily operations on the Frontier Assurance team. Team members build strategic research partnerships, translate external findings into actionable recommendations, and lead public transparency initiatives alongside research, engineering, product, policy, and communications groups.
This role exists to bring independent scrutiny into safety decisions while helping the public understand and assess that safety work. Professionals who possess deep experience in research partnerships, program management, and an understanding of AI evaluations will thrive here.
What you will do
- Design and run third-party assessment programs for frontier models and safeguards, covering independent evaluations, adversarial testing, and embedded auditing.
- Build and manage strategic research partnerships with third-party evaluators, academic labs, and independent experts.
- Bring external findings to safety decision-makers and translate them into actionable recommendations for safeguards, deployment, product, and policy.
- Partner with research, product, policy, and communications teams to explain the evidence behind safety approaches.
- Lead public transparency programs, including system cards, summaries of assessments, and updates on significant findings.
- Create channels for researchers and civil society to ask questions, provide feedback, and inform future assessments.
- Own program goals, milestones, dependencies, and risks across assessment and transparency work.
What you need
- Understand AI evaluations and measurement to engage with technical teams on evaluation design and results.
- Interpret evaluation findings and communicate methodological limitations, uncertainty, and disagreement.
- Demonstrate experience building research partnerships and managing external stakeholders such as academic researchers.
- Synthesize technical and social science research into clear executive summaries and accessible public explanations.
- Show experience delivering technical publications or public reports across multiple contributors with strong judgment.
- Work cross-functionally across product, research, and engineering teams to coordinate complex programs.
Benefits
- Offers Equity
- Relocation assistance
Questions candidates ask
What is the remote work policy?
This role is based in San Francisco, CA. The team uses a hybrid work model of 3 days in the office per week.
What is the salary for this position?
The salary range is $239K to $328K, and the position includes offers of equity.
What does the Frontier Assurance team actually do?
The Frontier Assurance team brings independent scrutiny into safety decisions and helps the public understand and assess safety work. They lead third-party assessments and safeguard testing for flagship launches.
