Latest AI JobsBrowse Jobs
F

Director of Product

friendliaiSan FranciscoProduct
Apply on company site
Salary
Not listed
Job type
Full-time
Work mode
Remote
Experience
Senior · 10+ yrs
Posted
16 Sept 2026
Status
Open · checked 9d ago

About this role

The Director of Product is a full-time leadership position based in San Francisco with FriendliAI to direct the product strategy of their AI inference platform. This hands-on role suits a technically strong product professional experienced in AI infrastructure who can collaborate with engineering teams to simplify complex system deployments.

Role Overview

FriendliAI seeks a Director of Product to own the product vision and roadmap for their inference platform, spanning model serving, APIs, and developer-facing capabilities. The position requires balancing performance, cost, and usability while helping build and lead the product organization.

Key Responsibilities

Own the product vision, strategy, and roadmap for FriendliAI’s AI inference platform.
Define product direction across the inference stack, balancing performance, scalability, reliability, usability, and cost.
Identify and prioritize product opportunities across LLMs, multimodal models, and agentic applications.
Partner closely with engineering and research on routing, batching, scheduling, resource allocation, and inference performance.
Work directly with enterprise customers and technical users to validate product direction and gather feedback.
Lead product initiatives end-to-end and mentor Product Managers and Product Designers.

Requirements

10+ years of product management experience, with significant experience owning technically complex platforms or infrastructure products.
Proven experience leading product strategy for AI/ML infrastructure, cloud platforms, distributed systems, developer platforms, or related technical products.
Deep understanding of AI inference and LLM serving architectures, including prefill versus decode, KV cache, token streaming, batching, routing, and GPU utilization.
Strong technical fluency to work directly with senior engineering and research teams.
Experience leading and developing Product Managers or coordinating multiple product workstreams.
Strong customer orientation with experience working directly with enterprise customers and technical users.

Nice to Have

Experience with AI inference platforms, LLM serving, GPU infrastructure, or model deployment.
Familiarity with modern inference frameworks such as vLLM, TensorRT-LLM, SGLang, or similar technologies.
Experience building developer platforms, APIs, SDKs, or cloud-native infrastructure products.
Experience with multi-tenant SaaS or enterprise AI platforms.
Background in Computer Science, Engineering, or a closely related technical field.

Skills and Tools

AI inference platforms and LLM serving architectures
vLLM, TensorRT-LLM, SGLang
APIs, SDKs, and developer platforms
Cloud-native infrastructure and distributed systems

Salary and Benefits

Competitive compensation and startup equity
Health insurance and health check-up support
Flexible working hours
Daily lunch and dinner provided, along with unlimited snacks and beverages
Top-tier equipment and hardware support

About the Company

FriendliAI provides an inference cloud for agents designed to run frontier open-weight models in production at scale. The company delivers high-speed output token performance, reduced inference costs, and high uptime for demanding agent workloads.

How to Apply

Candidates should apply on the official company careers page.

Skills and tech stack

Questions candidates ask

Where is the Director of Product role located?

The position is based in San Francisco.

How many years of experience are required for this role?

Candidates must have 10+ years of product management experience, with significant experience owning technically complex platforms or infrastructure products.

What kind of background or technical understanding is needed?

Applicants need a deep understanding of AI inference and LLM serving architectures, including prefill versus decode, KV cache, token streaming, batching, routing, and GPU utilization.

What benefits are provided with this position?

Benefits include competitive compensation, startup equity, health insurance, health check-up support, flexible working hours, daily lunch and dinner, unlimited snacks and beverages, and top-tier equipment or hardware support.

Ready to apply?

The application is on the official friendliai careers page.

Apply on company site