SWE-Bench AI Task Auditor - Freelance AI Trainer Project
About this role
Meridial needs experienced technical specialists to audit software engineering tasks that train and evaluate artificial intelligence systems. Successful execution ensures that AI training workflows remain technically rigorous, practical, and accurate within specific technical domains.
As an auditor, you will review software engineering tasks to verify they are realistic, solvable, reproducible, and backed by reliable testing criteria. You will also supply detailed feedback regarding codebase integration problems, logic errors, and test failures.
Professionals with deep software engineering backgrounds and strong analytical skills thrive in this freelance contract capacity. Independent specialists who enjoy troubleshooting complex technical scenarios and working remotely make great fits for the project.
What you will do
- Assess software engineering tasks to determine if they are technically accurate, realistic, and solvable.
- Verify that tasks are reproducible and supported by reliable tests and evaluation criteria.
- Provide clear and actionable feedback on codebase integration issues, test failures, or logic errors.
- Rigorously test, troubleshoot, and evaluate complex technical scenarios.
What you need
- Demonstrable professional experience and deep technical knowledge in software engineering.
- Familiarity with complex codebase navigation, real-world application development, and SWE-Bench standards.
- Strong analytical and problem-solving skills to test and troubleshoot technical scenarios.
- Ability to supply a secure computer and high-speed internet as a contractor.
Skills and tech stack
Questions candidates ask
What is the workplace policy for this role?
This is a remote freelance contract position that can be performed worldwide. Contractors must supply their own secure computer and high-speed internet.
What is the pay rate for the task auditor?
The project offers a pay rate of $60 per hour. The exact rate is determined after evaluating your experience, expertise, and geographic location.
Are company-sponsored benefits included?
No, company-sponsored benefits such as health insurance and PTO do not apply to this contractor position.