Latest AI JobsBrowse Jobs
lilt-production logo

AI Benchmark Engineer | Native Language Specialist - Chinese (Taiwan) - Remote

lilt-productionTaiwan (Remote)LiltLancer Community
Apply on company site
Salary
Not listed
Job type
Contract
Work mode
Remote
Experience
Senior · 5+ yrs
Posted
24 Sept 2026
Status
Open · checked 7d ago

About this role

This remote role suits experienced software engineers with native fluency in Chinese (Taiwan) who want to design evaluation tasks for large language models. The position involves freelance contracting work focused on building verifiable benchmark suites for multilingual software challenges.

Role Overview

The AI Benchmark Engineer role at lilt-production is a remote, freelance position focusing on Chinese (Taiwan). The project centers on building a rigorous evaluation suite of Terminal-Bench tasks to test large language models on multilingual software challenges, locale edge cases, and non-English data processing.

Key Responsibilities

Build realistic task environments using native language datasets and files.
Identify AI failure points through prompt engineering and translation work in the native language.
Implement reference solutions and write deterministic verifier scripts.
Calibrate task difficulty from Easy to Very Hard against various model tiers.
Participate in a four-layer human quality control process alongside automated checks.

Requirements

Five plus years of industry experience in software engineering.
Background at leading technology companies or graduation from top-tier engineering universities.
Native or near-native fluency in Chinese (Taiwan) with high English proficiency.
Strong proficiency in Python, standard shell scripting, and data processing.
Extensive experience with Terminal or CLI development workflows and familiarity with coding agents.
Technical understanding of multilingual text processing pitfalls including encoding robustness, locale conventions, and text I/O.

Skills and Tools

Python
Standard shell scripting
Terminal and CLI workflows
Coding agents
Unicode normalization and text encoding tools

About the Company

lilt-production builds multilingual AI and human-verified services for enterprises, governments, and AI developers. The organization aims to make the world's information accessible regardless of language through a global community of linguists and subject matter experts.

How to Apply

Candidates should apply on the official company careers page by submitting an updated English CV, completing a GenAI assessment, and finalizing the onboarding process.

Skills and tech stack

PythonTerminal/CLIShell ScriptingLLM

Questions candidates ask

Is this a full-time position?

No, this is a remote, freelance contract opportunity intended as a supplemental income stream rather than a primary full-time job.

What language proficiency is required?

Applicants must have native or near-native fluency in Chinese (Taiwan) along with high English proficiency.

How many years of experience are needed?

The position requires five or more years of industry experience in software engineering.

What technical skills are necessary?

Candidates need strong proficiency in Python, standard shell scripting, data processing, and terminal-based development workflows.

What is the application process?

Applicants must submit an English CV on the careers page, complete a GenAI assessment, and finish profile setup in the system.

Ready to apply?

The application is on the official lilt-production careers page.

Apply on company site