About this role
Based in Berlin, the Senior or Staff AI Engineer for Quality and Evals at Cortea involves building evaluation and observability foundations for production-grade large language model agents in audit workflows. This role suits experienced backend and AI engineers who prefer working in a scaling startup environment.
Role Overview
The position centers on establishing the evaluation and observability infrastructure for multimodal retrieval agents used in complex audit workflows. The engineer designs data architecture, writes production code, and directly impacts the quality, performance, and reliability of large language model agents.
Key Responsibilities
Requirements
Nice to Have
Skills and Tools
Salary and Benefits
About the Company
Cortea operates as a Berlin-based startup focused on transforming manual document audits using artificial intelligence and specialized software agents. The organization is backed by top-tier venture capital firms with over 15 million euros in funding and maintains active products with paying customers. Core cultural values include speed, trust, kindness, and first-principles thinking.
How to Apply
Candidates should apply on the official company careers page.
Skills and tech stack
Questions candidates ask
Where is the job located?
The role is located in the central Berlin office.
What kind of experience is required for this position?
The role requires senior-level engineering judgment, strong Python or backend experience, cloud deployment knowledge (ideally GCP), and hands-on experience with LLM evaluation or ML pipeline evaluation systems.
What tools and technologies will I work with?
The tech stack includes Python, Google Cloud Platform, analytical databases like BigQuery and ClickHouse, workflow orchestration tools like Temporal, and observability platforms such as Braintrust, MLflow, Langfuse, and Weights & Biases.
What benefits and perks are offered?
Cortea offers a competitive salary with equity, a generous budget for coding tools, flexible vacation, team lunches, retreats, and a central Berlin office.
What does the interview process look like?
The interview process includes an initial introductory call, a technical interview, a culture deep dive with a co-founder, and an on-site day in Berlin to collaborate on a real problem.