Member of Technical Staff, Forward Deployed Engineer

InferactSan FranciscoResearch & Engineering

Apply on company site

Opens the official Inferact careers page

Salary

$200K – $400K

Job type

Full-time

Experience

Mid

Posted

2 Oct 2026

Status

Open · checked 7d ago

About this role

The Member of Technical Staff, Forward Deployed Engineer role at Inferact is based in San Francisco, California, and suits engineers with experience in ML systems and customer deployment. This position involves direct collaboration with clients to implement and optimize inference engines.

Role Overview

Inferact seeks a Member of Technical Staff, Forward Deployed Engineer to ensure successful implementations within client environments. This position focuses on deploying, integrating, and debugging vLLM-powered inference infrastructure across various cloud and hardware setups. The engineer bridges client requirements with core product development by translating field challenges into scalable platform features.

Key Responsibilities

Partner directly with clients to deploy, integrate, debug, and optimize inference systems in production.

Handle end-to-end technical production issues across cloud, Kubernetes, GPU, networking, and model-serving layers.

Collaborate closely with core product and engineering groups to transform field insights into reusable product capabilities.

Navigate ambiguous technical environments to drive architecture discussions and implementations to completion.

Requirements

Bachelor's degree or equivalent experience in computer science, engineering, systems, machine learning, or a related field.

Software engineering proficiency in Python, Go, TypeScript, or similar languages for building production-grade services, tooling, and integrations.

Practical background in operating machine learning systems, AI infrastructure, cloud platforms, Kubernetes, or high-scale backend services.

Strong systems debugging capabilities spanning application runtime, infrastructure, networking, storage, and distributed systems.

Analytical approach to evaluating latency, throughput, batching, scalability, reliability, and cost tradeoffs.

Nice to Have

Familiarity with vLLM, SGLang, TensorRT-LLM, TGI, Ray Serve, BentoML, or similar model-serving frameworks.

Background working with NVIDIA or AMD hardware, CUDA, ROCm, or accelerator-backed infrastructure.

Experience delivering infrastructure software into regulated or security-sensitive enterprise environments.

Contributions to open-source machine learning infrastructure, Kubernetes, or developer tooling.

Skills and Tools

Python

TypeScript

Kubernetes

vLLM

SGLang

TensorRT-LLM

TGI

Ray Serve

BentoML

NVIDIA and AMD GPUs

CUDA and ROCm

Salary and Benefits

Annual salary range between $200,000 and $400,000 USD.

Company equity.

Health, dental, and vision health coverage.

401(k) plan with company match.

About the Company

Inferact builds vLLM as an AI inference engine to make AI inference faster and more cost-effective. The organization is founded by the creators and core maintainers of vLLM, operating at the intersection of AI models and hardware infrastructure.

How to Apply

Candidates should apply on the official company careers page.

Skills and tech stack

Python Go TypeScript Kubernetes vLLM SGLang TensorRT-LLM TGI Ray Serve BentoML CUDA ROCm LLM Machine Learning

Questions candidates ask

Where is this job located?

This position is based in San Francisco, California, though remote candidates within the US may be considered.

What is the compensation range for the role?

The expected annual salary falls between $200,000 and $400,000 USD, along with company equity.

Is visa sponsorship available?

Yes, visas are sponsored on a case-by-case basis.

What education is required?

A Bachelor's degree or equivalent experience in computer science, engineering, systems, machine learning, or a similar field is required.

What benefits are included?

The company provides health, dental, and vision benefits as well as a 401(k) company match.

Ready to apply?

The application is on the official Inferact careers page.

Apply on company site

Job details

Salary

$200K – $400K

Location

San Francisco

Job type

Full-time

Experience

Mid

Education

Bachelor's degree or equivalent

Visa sponsorship

Available

Department

Research & Engineering

Posted

2 Oct 2026

Status

Open · checked 7d ago

Inferact vllm.ai

Inferact is a company whose mission is to grow vLLM as an AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, the organization focuses on the intersection of AI models and hardware. Its software product, vLLM, provides high-throughput and memory-efficient inference and serving for large language models, aiming to make high-performance LLM deployment accessible across a wide range of hardware and open-source models. The company serves developers, AI teams, and organizations seeking to deploy open-source models with integrated APIs and hardware efficiency. Its work in artificial intelligence and machine learning centers on optimizing model execution, low-level accelerator code, distributed serving, and cloud platforms. Core technological features include PagedAttention, advanced scheduling, and continuous batching designed to maximize GPU utilization and reduce inference costs. The open roles indicate that Inferact is building teams comprising technical staff and co-op students across engineering functions. The open positions are located in San Francisco and include roles such as Member of Technical Staff (Forward Deployed Engineer) and Inference Engineering Co-op. These roles involve hands-on systems engineering, customer integrations, and work across the vLLM stack, ranging from inference runtimes and kernel engineering to performance and scale.

View all 2 jobs

More jobs at Inferact

Inference Engineering, Co-op

San Francisco · 33d ago