Latest AI JobsBrowse Jobs
lilt-production logo

AI Benchmark Engineer | Native Language Specialist - French (France) - Remote

lilt-productionFrance (Remote)LiltLancer Community
Apply on company site
Salary
Not listed
Job type
Contract
Work mode
Remote
Experience
Senior · 5+ yrs
Posted
8 Sept 2026
Status
Open · checked 9d ago

About this role

France (Remote) is the location for this remote freelance contract position as an AI Benchmark Engineer and Native Language Specialist for French. This role suits experienced software engineers with native French fluency who want to design and build evaluation tasks for large language models.

Role Overview

This independent contractor opportunity involves creating a verifiable evaluation suite of Terminal-Bench tasks to test large language models on multilingual software challenges. The work focuses on measuring multilingual robustness across prompt language effects and locale edge cases in terminal workflows.

Key Responsibilities

Design and engineer tasks for evaluating coding agents.
Build realistic task environments using datasets and files in French.
Identify AI failure points and analyze prompt behavior in French.
Develop reference implementations and write deterministic verifier scripts.
Analyze execution logs and calibrate task difficulty against various model tiers.
Participate in a four-layer quality control process involving human review and automated checks.

Requirements

Minimum of five years of industry experience in software engineering.
Proven track record at leading technology companies or graduation from a top-tier engineering university.
Native or near-native fluency in French with high English proficiency.
Strong proficiency in Python, standard shell scripting, and data processing.
Extensive experience with terminal and command line interface development workflows.
Deep understanding of multilingual text processing pitfalls, encoding robustness, and locale-dependent conventions.

Skills and Tools

Python
Standard shell scripting
Terminal and CLI development workflows
Coding agents
Unicode normalization and text encoding

About the Company

Lilt builds multilingual AI and human-verified services for enterprises, governments, and artificial intelligence developers worldwide. The organization works to make the world's information accessible regardless of the language spoken.

How to Apply

To apply for this role, submit an application with an updated CV in English on the official company careers page.

Skills and tech stack

Questions candidates ask

Is this position remote?

Yes, this is a remote and freelance opportunity based in France.

What is the required experience level?

Applicants need five or more years of industry experience in software engineering.

What language skills are required?

Native or near-native fluency in French is required, along with high English proficiency.

What technical skills are needed?

Candidates need strong proficiency in Python, standard shell scripting, data processing, and command line interface development workflows.

How does the application process work?

Candidates submit an application with an English CV, complete a GenAI assessment, and finalize onboarding in the system.

Ready to apply?

The application is on the official lilt-production careers page.

Apply on company site