Senior / Lead Machine Learning Engineer, Serving - Germany
About this role
Role Overview
Inworld AI seeks a Senior or Lead Machine Learning Engineer for Serving based in Germany. This full-time position suits adaptable engineers ready to build high-volume, realtime AI infrastructure that handles massive daily user traffic.
Key Responsibilities
Engineers in this role own the entire lifecycle of machine learning systems, taking models from the research team, containerizing them, optimizing serving performance, and ensuring production reliability. Professionals collaborate daily with US-based leadership and engineering teams, addressing ambiguous problems and creating fast, stable solutions for realtime workloads.
Requirements
Candidates must have professional fluency in English, both written and spoken. While traditional long-term experience requirements are flexible given the rapid evolution of agentic systems, applicants should demonstrate practical expertise in building backend or machine learning systems, supported by a relevant academic background or equivalent hands-on experience.
Skills and Tools
Core technical proficiencies for this position include Python, Kubernetes, Rust, C++, and Large Language Models (LLMs). Additional useful competencies span inference optimization using tools like vLLM or TRT-LLM, model acceleration techniques including quantization and caching, high-performance systems engineering with CUDA, and distributed systems scaling.
About the Company
Inworld AI operates as a research lab and inference provider focusing on realtime artificial intelligence for consumer-facing applications. The organization builds first-party speech models, serves large language models, and powers modular APIs for high-volume workloads across sectors like healthcare, education, fitness, and media. Backed by prominent venture funds and technology leaders, Inworld has been recognized globally as a top AI startup and innovation leader.
How to Apply
Interested candidates should visit the official Inworld AI careers page to review application guidelines and submit their information.
Skills and tech stack
Questions candidates ask
Where is this job located?
This position is based in Germany.
What department is this role in?
This role is part of the ML Engineering department.
What skills are required for this position?
Key skills include Python, Kubernetes, Rust, C++, and experience with Large Language Models (LLMs).
What language proficiency is necessary?
Professional fluency in English, both written and spoken, is required for daily collaboration with US-based teams.
How can I apply for this role?
You can apply by visiting the official Inworld AI careers page.