AI Benchmark Engineer | Native Language Specialist - Spanish (Argentina) - Remote
About this role
Lilt-production seeks an AI Benchmark Engineer and Native Language Specialist for Spanish in Argentina on a remote, freelance basis. This role suits experienced software engineers who want to design evaluation tasks and test large language models on multilingual software challenges.
Role Overview
The position involves building an evaluation suite of Terminal-Bench tasks to measure multilingual robustness in large language models. The contractor will design, build, and validate tasks that test model performance in Spanish without relying on English translations. This is an independent contractor role with flexible scheduling, requiring a commitment of 15 to 20 hours per week.
Key Responsibilities
Requirements
Skills and Tools
Salary and Benefits
About the Company
Lilt-production builds evaluation suites to test large language models on multilingual software challenges. The company focuses on measuring multilingual robustness across prompt language effects and complex locale edge cases. Lilt values a fair, inclusive, and transparent hiring process and operates as an equal opportunity employer.
How to Apply
Candidates should apply on the official company careers page by submitting an application with an updated CV in English, completing a GenAI assessment, and finalizing onboarding.
Skills and tech stack
Questions candidates ask
Is this position full-time or part-time?
This is a remote, freelance opportunity structured for independent contractors. It is not ideal as a primary income source and typically requires 15 to 20 hours per week.
What language proficiency is required?
Candidates must have native or near-native fluency in Spanish with a deep understanding of its grammar and phrasing rules, as well as high English proficiency.
What technical skills are needed for the role?
Applicants need strong proficiency in Python, standard shell scripting, data processing, and experience with Terminal or CLI-based development workflows.
Are employee benefits included with this role?
No, as an independent contractor, you do not receive benefits such as health insurance, paid time off, or retirement contributions.
How does the application process work?
Applicants must submit an application with an English CV, complete a GenAI assessment, and then finalize onboarding in the system.
The application is on the official lilt-production careers page.
Apply on company site