Latest AI JobsBrowse Jobs
lilt-production logo

AI Benchmark Engineer | Native Language Specialist - Chinese (Hong Kong) - Remote

lilt-productionHong Kong (Remote)LiltLancer Community
Apply on company site
Salary
Not listed
Job type
Contract
Work mode
Remote
Experience
Senior · 5+ yrs
Posted
24 Sept 2026
Status
Open · checked 7d ago

About this role

This remote freelance role is an AI Benchmark Engineer and Native Language Specialist for Chinese (Hong Kong) at lilt-production, suited for experienced software engineers with native fluency and a background in terminal-based workflows. The position involves designing evaluation tasks to test large language models on multilingual software challenges.

Role Overview

The position is a remote, freelance contract opportunity focused on building evaluation suites of Terminal-Bench tasks. The goal is to measure multilingual robustness in large language models across non-English data processing and complex encoding edge cases.

Key Responsibilities

Evaluate coding agents through task engineering.
Build realistic task environments using datasets and files in the native language.
Identify failure points in AI through prompting and translation in the native language.
Implement robust solutions and write reliable, deterministic verifier scripts.
Analyze execution logs and calibrate task difficulty against various model tiers.
Participate in a four-layer human quality control process and automated checks.

Requirements

Five plus years of industry experience in software engineering.
Proven track record at leading technology companies or graduation from top-tier engineering universities.
Native or near-native fluency in Chinese (Hong Kong) with high English proficiency.
Strong proficiency in Python, standard shell scripting, and data processing.
Extensive experience with Terminal and CLI-based development workflows and coding agents.
Technical understanding of multilingual text processing pitfalls including Unicode normalization and locale-dependent conventions.

Skills and Tools

Python
Standard shell scripting
Terminal and CLI development environments
Coding agents
Multilingual data processing tools

About the Company

Lilt builds multilingual AI and human-verified services for enterprises, governments, and AI developers. The organization aims to make the world's information available to everyone regardless of language.

How to Apply

Candidates should submit an application with an updated English CV on the official company careers page.

Skills and tech stack

Questions candidates ask

Is this a full-time job?

No, this is a remote, freelance contract opportunity that is better suited as a supplemental income stream rather than a primary job.

What level of experience is required?

Candidates must have 5 or more years of industry experience in software engineering.

What languages are required for this role?

The role requires native or near-native fluency in Chinese (Hong Kong) and high English proficiency.

What is the expected time commitment?

Most tasks require a minimum of 2 hours per day or 15 to 20 hours per week.

How does the application process work?

Applicants must submit an application with an English CV on the official careers page, complete a GenAI assessment, and finalize onboarding.

Ready to apply?

The application is on the official lilt-production careers page.

Apply on company site