Latest AI JobsBrowse Jobs
Fireworks AI logo

Member of Technical Staff, AI Training Infrastructure

Fireworks AISan MateoEngineering
Apply on company site
Salary
$210K - $320K USD
Job type
Full-time
Work mode
Remote
Posted
31 Jul 2026
Status
Open · checked 7d ago

About this role

Fireworks AI is seeking a Member of Technical Staff for AI Training Infrastructure to design, build, and optimize large-scale model training systems. This full-time engineering position is based in San Mateo with remote flexibility, suiting professionals with at least three years of experience in distributed systems and machine learning infrastructure.

Role Overview

As a Training Infrastructure Engineer, the professional hired will shape the systems that drive large-scale model training operations. The role focuses on developing high-performance infrastructure, collaborating with AI researchers, and establishing reliable pipelines for advanced model development.

Key Responsibilities

Design and implement scalable architecture for large-scale model training workloads.
Develop and maintain distributed training pipelines for multimodal models and LLMs.
Optimize performance across multiple nodes, GPUs, and data centers.
Implement monitoring, debugging, and logging tools for training operations.
Architect and maintain storage solutions for massive training datasets.
Automate infrastructure scaling, orchestration, and provisioning.
Partner with researchers to execute and refine training methodologies.
Analyze and boost the cost-effectiveness, scalability, and efficiency of training systems.
Diagnose complex performance bottlenecks within distributed training setups.

Requirements

Bachelor’s degree in Computer Engineering, Computer Science, a related field, or equivalent practical experience.
Three or more years of professional background working with ML infrastructure and distributed systems.
Practical experience utilizing PyTorch.
Proficiency working across major cloud platforms including Azure, GCP, and AWS.
Familiarity with containerization and orchestration technologies like Docker and Kubernetes.
Understanding of distributed training strategies such as model parallelism, data parallelism, and FSDP.

Nice to Have

Master's degree or PhD in Computer Science or a related technical discipline.
Hands-on background training multimodal AI systems or large language models.
Experience working with machine learning workflow orchestration tools.
Background optimizing high-performance distributed computing frameworks.
Familiarity with ML DevOps methodologies.
Past contributions to open-source machine learning infrastructure or comparable projects.

Skills and Tools

PyTorch
AWS, GCP, and Azure cloud environments
Kubernetes and Docker
Distributed training methodologies (FSDP, data and model parallelism)
Infrastructure automation and monitoring tooling

Salary and Benefits

Annual salary range between $210,000 and $320,000 USD.

About the Company

Fireworks AI is a specialized intelligence platform that lets organizations build, serve, and train AI models customized to their specific data, workflows, and products. Founded by the team behind PyTorch, the company is backed by prominent investors such as NVIDIA, Sequoia Capital, and Benchmark Capital. Fireworks AI powers production AI workloads across hundreds of open models spanning audio, text, image, embedding, and multimodal tasks.

How to Apply

Interested candidates should submit their application directly on the official company careers page.

Skills and tech stack

PyTorchAWSGCPAzureKubernetesDocker

Questions candidates ask

What is the salary range for this position?

The salary ranges from $210,000 to $320,000 USD per year.

Is this role remote?

Yes, this position offers remote flexibility while being based out of San Mateo.

What level of experience is required?

Candidates must have 3 or more years of experience working with distributed systems and machine learning infrastructure.

What core technical skills are needed?

Required technical skills include PyTorch, cloud platforms like AWS, GCP, and Azure, containerization tools such as Docker and Kubernetes, and distributed training techniques.

How should I apply for this job?

Applicants should apply directly through the official company careers page.

Ready to apply?

The application is on the official Fireworks AI careers page.

Apply on company site