About this role
Based in Heidelberg, the Senior AI Researcher - Pre-training position at Aleph Alpha involves advancing the architecture and training recipes for next-generation foundation models. This role suits an experienced machine learning researcher and software engineer who can manage large-scale GPU clusters and collaborate on-site in Germany.
Role Overview
Aleph Alpha seeks a Senior AI Researcher to join the Pre-training team in Heidelberg. The person in this position will own critical technical areas like architecture, optimization, stability, and scaling for foundational models that serve sectors such as finance, manufacturing, and public administration. Working at the intersection of research and engineering, the professional will translate mathematical reasoning into principled training decisions across thousands of NVIDIA Blackwell GPUs.
Key Responsibilities
Requirements
Nice to Have
Skills and Tools
Salary and Benefits
About the Company
Aleph Alpha operates in Europe, focusing on serious foundation model pre-training. The company builds models designed to understand German, comply with European regulatory requirements, and function reliably in high-stakes settings for customers in finance, manufacturing, and public administration. The organization maintains a flat structure, an emphasis on ownership and autonomy, and a collaborative team environment utilizing pair programming and mob programming.
How to Apply
Interested candidates should visit the official company careers page to submit an application.
Skills and tech stack
Questions candidates ask
Where is the job located?
The role is located in Heidelberg, Germany, with regular on-site collaboration required as part of the Pre-training team.
What qualifications are needed for the AI Researcher position?
Candidates must be proficient in Python and PyTorch, have a strong mathematical foundation in optimization and scaling, possess a track record in machine learning research and software engineering, understand transformer training dynamics, and have hands-on experience pre-training large models on substantial infrastructure.
What tools and distributed frameworks are mentioned?
The posting mentions Python, PyTorch, Megatron-LM, DeepSpeed, torchtitan, and NVIDIA Blackwell GPUs.
What benefits does Aleph Alpha offer?
Benefits include 30 days of paid vacation, Wellhub fitness access, nilo.health mental health support, a subsidized company pension plan, a subsidized Germany-wide transportation ticket, a technical equipment budget, flexible working hours with a hybrid model, and a JobRad bike lease.
Do I need to be able to work in Germany?
Yes, applicants must be able to work in Germany and collaborate regularly on site in Heidelberg.