Latest AI JobsBrowse Jobs
lilt-production logo

AI Benchmark Engineer | Native Language Specialist - German (Austria) - Remote

lilt-productionAustriaLiltLancer Community
Apply on company site
Salary
Not listed
Job type
Contract
Work mode
Remote
Experience
Senior · 5+ yrs
Posted
8 Sept 2026
Status
Open · checked 7d ago

About this role

This freelance role suits experienced German-speaking software engineers who want flexible supplemental income while designing evaluation suites for large language models. The position is remote and based in Austria, focusing on terminal-based multilingual software challenges.

Role Overview

Lilt-production seeks a remote, freelance AI Benchmark Engineer and Native Language Specialist for German in Austria. The contractor will design, build, and validate evaluation tasks to test large language models on multilingual software challenges without relying on English translation. The position requires a commitment of 15 to 20 hours per week and is structured as an independent contractor arrangement.

Key Responsibilities

Evaluate coding agents through dedicated task engineering.
Build realistic task environments using native language datasets and files.
Identify AI failure points and translation limitations in the native language.
Implement reference solutions and write deterministic verifier scripts.
Analyze execution logs and calibrate task difficulty against various model tiers.
Participate in a four-layer quality control process alongside automated checks.

Requirements

Minimum of five years of industry experience in software engineering.
Proven track record at leading technology companies or graduation from a top-tier engineering university.
Native or near-native fluency in German with high English proficiency.
Strong proficiency in Python, standard shell scripting, and data processing.
Extensive experience with terminal and CLI-based development workflows.
Deep understanding of multilingual text processing pitfalls, encoding, and locale-dependent conventions.

Skills and Tools

Python
Shell Scripting
Terminal and CLI Workflows
Coding Agents
Unicode Normalization and Encoding

About the Company

Lilt provides multilingual AI and human-verified services to enterprises, governments, and AI developers globally. The company focuses on making the world's information accessible regardless of language through innovative technology and human expertise.

How to Apply

Candidates should apply on the official company careers page by submitting an application with an updated English CV, completing a GenAI assessment, and finalizing profile onboarding.

Skills and tech stack

PythonTerminalCLIShell ScriptingHaikuSonnetOpusLLM

Questions candidates ask

Is this a full-time position?

No, this is a remote, freelance independent contractor opportunity that is not ideal as a primary income source and requires 15 to 20 hours per week.

What language proficiency is required?

Native or near-native fluency in German is required, along with a deep understanding of its grammar and phrasing rules, plus high English proficiency.

What technical background do I need?

Applicants need five or more years of software engineering experience, strong Python and shell scripting skills, and familiarity with CLI workflows.

How does the application process work?

Candidates submit an application with an English CV, complete a GenAI assessment, and finalize system onboarding.

Ready to apply?

The application is on the official lilt-production careers page.

Apply on company site