Latest AI JobsBrowse Jobs
Fireworks AI logo

Member of Technical Staff - AI Infrastructure Reliability

Fireworks AISan MateoEngineering
Apply on company site
Salary
$200K - $290K USD
Job type
Full-time
Work mode
Remote
Posted
17 Aug 2026
Status
Open · checked 7d ago

About this role

Role Overview

Fireworks AI is seeking a Member of Technical Staff for AI Infrastructure Reliability to join its engineering team in San Mateo or remotely. This full-time role suits an experienced systems engineer with a background in cloud-native operations and distributed architectures who wants to scale dependable AI platforms.

Key Responsibilities

Define and implement core reliability standards, including SLOs, error budgets, and production readiness criteria derived from real telemetry.
Manage the reliability toolchain, which encompasses telemetry pipelines, alerting standards, load testing, failure injection, and self-healing automation.
Protect the customer experience by monitoring inter-system seams and ensuring cross-service failures receive clear ownership and resolution.
Coordinate live production incidents, conduct blameless postmortems, and track follow-up tasks to completion.
Automate repetitive operational tasks to minimize manual toil and maintain manageable on-call loads during rapid company growth.
Collaborate closely with cloud infrastructure, inference, training, and product teams to manage capacity, zero-downtime rollouts, and multi-region risk.

Requirements

At least 5 years of experience with Linux internals, networking fundamentals such as TCP/IP, HTTP, and gRPC, and system performance troubleshooting.
Minimum of 5 years of software engineering experience using Python, Go, C++, or Rust to write production-grade tools and systems code.
Proven expertise operating and debugging Docker, Kubernetes, and Terraform in high-throughput production environments.
Background in distributed systems, including high-throughput control planes, multi-region setups, and microservices.
Strong grasp of reliability fundamentals like fault-tolerant design, automated failover, high-availability architecture, and SLO/SLA management.
Ability to influence other engineering teams to adopt standards through credibility and useful tooling.
A Bachelor's or Master's degree in Computer Science, Computer Engineering, or equivalent practical experience.

Nice to Have

Familiarity with observability tooling such as Prometheus, Grafana, OpenTelemetry, and actionable alerting.
Experience with GPU and machine learning infrastructure, including inference serving and distributed training.
Background in AI-assisted operations, such as building agents or LLM-based tooling for triage, investigation, or automation.
Contributions to open-source infrastructure, ML serving, or systems projects.
Experience working in fast-paced startup environments where pragmatism and teamwork take precedence over heavy process.

Skills and Tools

Python
PyTorch
Kubernetes
Docker
Rust
C++
LLM
Terraform
Linux
TCP/IP
gRPC
Prometheus
Grafana
OpenTelemetry

Salary and Benefits

Annual Salary Range: $200,000 to $290,000 USD per year

About the Company

Fireworks AI is a platform for specialized intelligence that empowers companies to build, train, and serve customized AI models. Founded by the team behind PyTorch and backed by prominent investors like AMD, Benchmark Capital, Index Ventures, Lightspeed, NVIDIA, Sequoia Capital, and TCV, the Series D company powers enterprise AI production for hundreds of open models across text, image, audio, and multimodal workloads.

How to Apply

Interested candidates should visit the official Fireworks AI careers page to submit an application for this position.

Skills and tech stack

PythonPyTorchKubernetesDockerRustC++LLMTerraform

Questions candidates ask

What is the salary range for the Member of Technical Staff position?

The annual salary for this position ranges from $200,000 to $290,000 USD.

Is this role remote friendly?

Yes, this position offers remote work flexibility alongside a physical office option in San Mateo.

What level of experience is required for this role?

Candidates must have 5 or more years of professional experience in software engineering and systems fundamentals.

What core programming languages are expected?

Applicants should have at least 5 years of production coding experience in Python, Go, C++, or Rust.

What background does Fireworks AI have?

Fireworks AI was founded by the team behind PyTorch, is valued at $17.5 billion as a Series D company, and is backed by major investors including NVIDIA, Sequoia Capital, and AMD.

Ready to apply?

The application is on the official Fireworks AI careers page.

Apply on company site