Staff Tech Lead Manager, Machine Learning, Simulator Evaluation
About this role
The Simulator Evaluation team at Waymo develops advanced virtual environments that blend deterministic logic, physical dynamics, and generative AI to train the autonomous driving system. Leadership of this applied machine learning group centers on scaling both the evaluation technology and the specialized engineering personnel responsible for proving the fidelity of complex virtual worlds. Responsibilities include building evaluation frameworks, infrastructure, and AI-powered tooling to assess world model understanding while steering technical direction alongside product and program management.
Candidates stepping into this position will architect machine learning-driven metrics that rigorously test world model quality and surface anomalies across large datasets. Success in the group requires bridging technical vision with execution by translating generative AI advancements into production-ready tools deployed across the organization. Individuals who excel here combine software engineering rigor in Python or C++ with a background in leading high-performing technical teams.
What you will do
- Lead a top-tier applied machine learning team focused on building evaluation frameworks, infrastructure, and AI-powered tooling for world model understanding and evaluation.
- Drive technical direction and provide guidance to team members while partnering with product and program managers to translate modeling challenges into business objectives.
- Architect machine learning-driven metrics and evaluation frameworks that rigorously test world model quality and automatically surface anomalies across vast datasets.
- Build AI-powered internal tools and products that streamline the model evaluation journey and transform complex model analysis into automated workflows.
- Partner with cross-functional partners including onboard, research, and other simulation teams to deploy solutions into production-critical systems.
What you need
- Degree in Computer Science, Robotics, Machine Learning, a related technical field, or equivalent practical experience.
- Three or more years of hands-on technical leadership experience directly managing and guiding high-performing engineering teams.
- Seven or more years of experience building, deploying, and optimizing machine learning systems in production environments.
- Strong software engineering proficiency in Python and/or C++.
- Experience with machine learning frameworks like PyTorch, JAX, or TensorFlow backed by a foundation in deep learning, transformers, and large-scale model deployment.
- Proven ability to design robust evaluation frameworks for complex systems combined with analytical skills and proficiency in large-scale data processing.
Nice to have
- M.S. or PhD. in Computer Science, Robotics, Machine Learning, or a related quantitative field
- Proven track record of training and/or evaluating large-scale generative models such as reinforcement learning, diffusion, world models, 3D generative models, or video generation
- Experience training and optimizing models on massive GPU/TPU clusters and managing large-scale data processing or MLOps systems
- Experience building and deploying AI-powered products or internal developer tools that streamline or automate complex workflows
Benefits
- Discretionary annual bonus program
- Equity incentive plan
- Generous Company benefits program
Skills and tech stack
Questions candidates ask
What is the salary range for this role?
The expected base salary range for this full-time position across US locations is $251,000 to $310,000 USD. Actual starting pay is based on job-related factors including work location, experience, relevant training, education, and skill level.
What kind of team will I be leading?
You will lead a top-tier applied ML team focused on building eval frameworks, infrastructure, and AI-powered tooling for World Model understanding and evaluation. The group consists of highly specialized engineers executing a vision within one of the most complex virtual environments ever built.
What are the core technical requirements for the position?
Candidates need 7+ years of experience building, deploying, and optimizing machine learning systems in production environments, alongside 3+ years of technical leadership experience managing engineering teams. Strong software engineering proficiency in Python and/or C++ is required, as well as experience with ML frameworks like PyTorch, JAX, or Tensorflow.
What additional benefits are included?
Employees are eligible to participate in Waymo's discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.