Latest AI JobsBrowse Jobs
lilt-production logo

AI Benchmark Engineer | Native Language Specialist - French (Belgium) - Remote

lilt-productionBelgium (Remote)LiltLancer Community
Apply on company site
Salary
Not listed
Job type
Contract
Work mode
Remote
Experience
Senior · 5+ yrs
Posted
8 Sept 2026
Status
Open · checked 7d ago

About this role

AI Benchmark Engineer | Native Language Specialist - French (Belgium) - Remote is a freelance contract position based in Belgium for experienced software engineers. This role suits native French speakers with a background in software development who want to design evaluation tasks for large language models.

Role Overview

Lilt-production is looking for native French speakers located in Belgium for a remote, freelance opportunity focused on building evaluation suites for large language models. The position involves creating Terminal-Bench tasks to measure multilingual robustness in terminal workflows without relying on English translations. This contract role offers flexible scheduling as an independent contractor, requiring an availability of roughly 15 to 20 hours per week.

Key Responsibilities

Evaluate coding agents through task engineering.
Build realistic task environments using datasets and files in French.
Discover failure points in AI performance through prompting and translation in the native language.
Create reference implementations and write deterministic verifier scripts.
Calibrate task difficulty against various model tiers by analyzing execution logs.
Participate in a four-layer human quality control process alongside automated checks.

Requirements

Minimum of five years of industry experience in software engineering.
Proven track record at leading technology companies or graduation from a top-tier engineering university.
Native or near-native fluency in French with high English proficiency.
Strong proficiency in Python, standard shell scripting, and data processing.
Extensive experience with terminal and CLI-based development workflows.
Familiarity with coding agents and deep technical understanding of multilingual text processing pitfalls.

Skills and Tools

Python
Standard shell scripting
Terminal and CLI development workflows
Multilingual data processing and encoding tools

About the Company

Lilt builds multilingual AI and human-verified services for enterprises, governments, and AI developers globally. The company aims to make the world information accessible to everyone regardless of the language spoken.

How to Apply

Apply on the official company careers page by submitting an updated English CV, completing a GenAI assessment, and finalizing onboarding.

Skills and tech stack

Questions candidates ask

Is this a full-time job with benefits?

No, this is a remote, freelance independent contractor role. It does not provide benefits such as health insurance, paid time off, or retirement contributions, and it functions best as supplemental income.

What is the expected time commitment for this role?

Most tasks require a minimum commitment of 2 hours per day or 15 to 20 hours per week, with fluctuating project demand.

What language requirements are needed for this position?

Candidates must have native or near-native fluency in French with a deep understanding of its grammar, register, and phrasing rules, alongside high English proficiency.

What technical background is required?

Applicants need at least five years of software engineering industry experience, strong proficiency in Python and shell scripting, and familiarity with terminal-based workflows.

How does the application process work?

Candidates submit an application with an English CV, complete a generative AI assessment, and finalize their profile setup in the system.

Ready to apply?

The application is on the official lilt-production careers page.

Apply on company site