Latest AI JobsBrowse Jobs
Fireworks AI logo

Member of Technical Staff, Enterprise Foundations

Fireworks AINew YorkEngineering
Apply on company site
Salary
$165K - $240K USD
Job type
Full-time
Work mode
Remote
Posted
7 Aug 2026
Status
Open · checked 7d ago

About this role

Role Overview

Fireworks AI is hiring a remote Member of Technical Staff for the Enterprise Foundations team based out of New York. This full-time engineering role is tailored for professionals with four or more years of experience who want to design critical infrastructure for large-scale enterprise artificial intelligence platforms.

Key Responsibilities

Own foundational platform capabilities from initial data modeling and API design through the control plane, runtime, SDK, CLI, and console.
Design core primitives including organizations, sub-accounts, user groups, roles, and service identities, integrating them via SSO and SCIM.
Build multi-tenant authorization, policy enforcement, and comprehensive audit systems that satisfy strict enterprise security reviews.
Manage usage metering, spend controls, and billing logic to ensure high accuracy at scale.
Handle data isolation and customer-managed encryption keys across AWS, GCP, and Azure for datasets, fine-tuning, models, and inference.
Deploy and operate platform instances within customer-managed clouds while addressing regional data residency constraints.
Utilize modern artificial intelligence tooling to automate workflows and accelerate delivery.

Requirements

Bring a minimum of four years of hands-on experience building and operating large-scale production backend or distributed systems.
Possess robust server-side engineering proficiencies in languages like Go, Python, C++, or TypeScript, along with flexibility across different technology stacks.
Demonstrate proven expertise in designing and evolving APIs and data models under live production traffic without causing disruptions.
Show practical depth with major cloud providers such as AWS, GCP, or Azure, covering identity management, key management services, object storage, and networking.
Maintain a demonstrated history of taking ambiguous, cross-functional workstreams from initial scoping all the way to production.
Engage comfortably and directly with customers and enterprise security architects.

Nice to Have

Background in enterprise identity and tenancy setups like SCIM, RBAC, ABAC, and audit logging.
Experience developing billing, metering, or quota frameworks with strict accuracy requirements.
Knowledge of applied cryptography, threat modeling, and envelope encryption strategies.
Familiarity with Kubernetes, GitOps, and infrastructure-as-code tools such as Terraform.
Prior exposure to large language model fine-tuning and inference pipelines.

Skills and Tools

Python
PyTorch
TypeScript
C++
AWS, GCP, and Azure
Kubernetes and Terraform
Large Language Models (LLMs)

Salary and Benefits

Competitive annual base salary ranging from $165,000 to $240,000 paid in USD.
Full-time employment with opportunities to solve challenging artificial intelligence infrastructure problems.
Direct impact and ownership within a rapidly expanding technological environment.

About the Company

Fireworks AI operates a platform for specialized intelligence that empowers organizations to build, train, and deploy custom artificial intelligence models tailored to their own operational data. Established by the founding team behind PyTorch, the Series D company is supported by prominent investors including Benchmark Capital, AMD, Index Ventures, Lightspeed, NVIDIA, Sequoia Capital, and TCV. The enterprise currently powers production workloads across multiple modalities for global businesses.

How to Apply

Interested candidates should visit the official company careers page to submit their application for this position.

Skills and tech stack

PythonPyTorchAWSGCPAzureKubernetesTypeScriptC++LLMTerraform

Questions candidates ask

What is the salary range for this position?

The annual salary ranges from $165,000 to $240,000 USD.

Is this job remote?

Yes, this position allows for remote work with a location preference in New York.

How many years of experience are required?

Candidates must have four or more years of experience building and operating production backend or distributed systems at scale.

What technical skills are needed?

Required skills include server-side languages like Python, TypeScript, or C++, cloud platform experience across AWS, GCP, or Azure, and API design expertise.

What department does this role belong to?

This role is part of the Engineering department, specifically within the Enterprise Foundations team.

Ready to apply?

The application is on the official Fireworks AI careers page.

Apply on company site