Latest AI JobsBrowse Jobs
lilt-production logo

AI Benchmark Engineer | Native Language Specialist - French (Canada) - Remote

lilt-productionCanada (Remote)LiltLancer Community
Apply on company site
Salary
Not listed
Job type
Contract
Work mode
Remote
Experience
Senior · 5+ yrs
Posted
8 Sept 2026
Status
Open · checked 7d ago

About this role

This freelance contractor role suits experienced French-speaking software engineers based in Canada who want to build evaluation benchmarks for large language models. The position involves designing terminal-based tasks and analyzing multilingual software challenges in a remote environment.

Role Overview

Lilt-production seeks an AI Benchmark Engineer and Native Language Specialist for French in Canada to operate on a remote contract basis. The project focuses on creating a verifiable evaluation suite of Terminal-Bench tasks to assess large language model capabilities in multilingual environments. Contractors design, build, and validate tasks that measure robustness against prompt language effects and locale edge cases.

Key Responsibilities

Build realistic task environments using datasets and native language files to test multilingual handling.
Identify failure points in AI models through prompting and translation work in the target language.
Develop reference implementations and write deterministic verifier scripts.
Review execution logs and calibrate task difficulty across multiple model tiers.
Participate in a human quality control process alongside automated checks for accuracy and fairness.

Requirements

Minimum of five years of industry experience in software engineering.
Background featuring experience at technology companies or graduation from top-tier engineering universities.
Native or near-native fluency in French with strong English proficiency.
Proficiency in Python, standard shell scripting, and data processing.
Experience with Terminal and CLI-based workflows alongside familiarity with coding agents.
Technical knowledge of multilingual text processing challenges including Unicode, encoding, and locale conventions.

Skills and Tools

Python
Terminal and CLI workflows
Standard shell scripting
Data processing tools
Coding agents
LLM tiers including Haiku, Sonnet, and Opus

About the Company

Lilt builds multilingual AI and human-verified services for enterprises, governments, and developers. The organization focuses on making global information accessible across different languages through innovative technology solutions.

How to Apply

Candidates should apply on the official company careers page by submitting an updated CV in English, completing a GenAI assessment, and finalizing the onboarding profile.

Skills and tech stack

Questions candidates ask

Is this position full-time?

No, this is a remote, freelance contract opportunity that functions as a supplemental income stream rather than a primary job.

What are the time commitment expectations?

Most tasks require a minimum commitment of two hours per day or 15 to 20 hours per week.

What language proficiency is required?

The role requires native or near-native fluency in French along with high English proficiency.

How many years of experience are required?

Candidates must have five or more years of industry experience in software engineering.

Are employment benefits provided?

No, as an independent contractor, you do not receive benefits such as health insurance, paid time off, or retirement contributions.

Ready to apply?

The application is on the official lilt-production careers page.

Apply on company site