Software Engineers: Paid Interview on AI Evaluation Tasks
About this role
Based in the United States on a remote contract basis, the Software Engineer study at terac offers a paid interview opportunity focused on testing AI evaluation frameworks and suits developers with expertise in code review. This role involves participating in a study to help researchers benchmark artificial intelligence performance accurately.
Role Overview
Terac conducts a paid research initiative regarding coding environments built for testing artificial intelligence agents. Participants review programming challenges and evaluation harnesses to measure AI capabilities against practical engineering benchmarks. The engagement takes place remotely and centers on assessing technical realism and complexity.
Key Responsibilities
Requirements
Skills and Tools
Salary and Benefits
About the Company
Terac constructs a large network of verified human professionals to support artificial intelligence development. Labs, researchers, and product developers utilize the platform to source, screen, and compensate study participants across various industries, languages, and technical disciplines.
How to Apply
Interested candidates should apply on the official company careers page.
Questions candidates ask
What is the compensation for this role?
The position pays $75 per hour.
Where is the study conducted?
The session takes place remotely.
What kind of background is required?
Candidates need professional experience as a software engineer or developer, along with familiarity creating or verifying programming tasks and evaluation harnesses.
What will participants do during the session?
Participants review programming tasks, evaluate coding environments for AI testing, identify code flaws, and provide feedback on challenge realism and difficulty.
Who operates this study?
The study is run by terac, a company that builds pools of vetted human experts for artificial intelligence.