About this role
Sentry is seeking a Senior Software Engineer for the AI Evals role based in San Francisco, California or available remotely. This position suits an experienced developer with a strong background in building evaluation and testing infrastructure for complex systems.
Role Overview
As a member of the AI/ML team, the incoming engineer takes charge of constructing evaluation infrastructure that tracks the accuracy, reliability, and real-world performance of AI systems. The position ensures that debugging agents and artificial intelligence features operate safely and predictably at scale. The professional designs benchmarks, datasets, and test harnesses to convert ambiguous artificial intelligence behavior into quantifiable signals.
Key Responsibilities
Requirements
Nice to Have
Skills and Tools
Salary and Benefits
The expected base salary range spans from $155,000 to $400,000 USD per year. Final compensation is determined by factors including work location, education, relevant experience, skills, and job knowledge. Eligible employees participate in company benefit plans, which include equity grants, incentive compensation, paid time off, and group health insurance coverage.
About the Company
Sentry functions as an application monitoring standard trusted by over 200,000 organizations, helping development teams identify performance issues and errors proactively. The open-source organization focuses on making software accessible while building an inclusive culture where diverse team members can thrive.
How to Apply
Interested candidates should visit the official Sentry careers page to submit an application for this position.
Skills and tech stack
Questions candidates ask
What is the salary range for the Senior Software Engineer, AI Evals role?
The base salary ranges from $155,000 to $400,000 USD per year, depending on factors like location, experience, skills, and education.
Is this position remote?
Yes, this role is listed as remote with a company location based in San Francisco, California.
What programming languages are required?
Candidates must feel comfortable writing production-quality code in Python and TypeScript.
What experience level is required for this job?
Applicants must have a minimum of 5+ years of professional experience along with a Bachelor's degree in computer science, machine learning, or a related field.
What benefits are included with employment?
Eligible employees receive benefits including incentive compensation, equity grants, paid time off, and group health insurance coverage.