About this role
Edmentum builds tech-enabled learning solutions and AI-enabled features designed to support students and educators. Leading the applied AI research team involves designing studies to test whether these automated tools and algorithmic systems are reliable, valid, and fair. The person in this position will translate technical findings into practical guidance for product and policy decisions while building external credibility for the organization.
Responsibilities include setting the research agenda, managing external partnerships, and coaching researchers who evaluate educational technology. Candidates should possess a strong background in psychometrics, measurement science, or data science, alongside direct experience overseeing the validation of AI capabilities. Someone who thrives on bridging technical evaluation with real-world educational standards will succeed in this role.
What you will do
- Lead a team of researchers focused on producing defensible evidence regarding the fairness, reliability, and validity of AI-enabled features.
- Design and oversee validation approaches for automated scoring, algorithmic decision support, and emerging learning technologies.
- Represent the organization in academic, industry, standards-body, customer, and policy-facing forums.
- Collaborate with product management, technology, and learning design teams to shape critical research questions and deliver timely answers.
- Hire, coach, and develop researchers while establishing clear work plans aligned with senior research leadership priorities.
- Manage university and third-party research partnerships to ensure high standards of quality and research ethics.
What you need
- Hold a doctorate in psychometrics, quantitative psychology, educational measurement, statistics, data science, AI evaluation, or a related field.
- Bring 8 or more years of experience in psychometric analysis, measurement science, AI research, data science, or related technical domains.
- Demonstrate 2 to 3 years of experience managing complex research projects and leading individuals or a small team.
- Know the AERA/NCME/APA Standards for Educational and Psychological Testing well, along with the regulatory context governing assessment quality.
- Have built an external presence through peer-reviewed publications, conference presentations, or standards-body participation.
Benefits
- Medical, dental, and vision insurance with various plan options
- 401(k) retirement plan with company matching
- Time away program, volunteer time away, and a winter office closure at the end of December
- Resources to promote wellness for professional and personal support
Questions candidates ask
What is the remote work policy?
Edmentum is a Remote First organization with a strong commitment to excellence, innovation, and customer satisfaction.
What is the pay range for this role?
The salary range for this role is $145,000 to $155,000 USD. Actual compensation will be determined based on multiple factors, including relevant experience and skill sets.
What does the hiring process involve?
As part of the hiring process, the organization may use AI-powered tools to support the HR team in reviewing, screening, and managing applications. Final decisions are made by people, and applicant information may be processed by third-party AI tools for tasks like resume parsing and interview scheduling.