Software Engineers: Paid Code Review for AI Agent Evaluation
About this role
Software Engineers: Paid Code Review for AI Agent Evaluation is a contract role based in the United States that suits practicing software professionals with experience in testing complex systems. This remote position involves participating in a paid research study to evaluate programming tasks used for benchmarking artificial intelligence agents.
Role Overview
Terac seeks professionals for a paid study focused on examining coding environments and programming tasks that benchmark artificial intelligence models. The goal is to ensure that autonomous agents undergo testing against realistic scenarios in software engineering. Participants join a remote session involving guided conversations and screen-sharing exercises to provide feedback.
Key Responsibilities
Requirements
Skills and Tools
Salary and Benefits
About the Company
Terac builds a large pool of vetted human experts for artificial intelligence. Researchers, product teams, and AI labs rely on Terac to recruit, pay, and screen study participants across multiple industries, languages, and skill sets.
How to Apply
Apply directly on the official company careers page.
Skills and tech stack
Questions candidates ask
What is the compensation for this role?
Participants receive $65 per hour.
Where does the work take place?
The study takes place during a remote session.
Who is eligible to participate?
Active professional software engineers, backend engineers, full-stack developers, machine learning engineers, and software architects with experience building test suites or evaluation harnesses are eligible.
What activities are involved in the session?
Participants review coding tasks and evaluation harnesses, verify logic and test cases, assess coding environments, and share their thought process through guided conversation and screen-sharing exercises.