Latest AI JobsBrowse Jobs
LiteLLM logo

Product Engineer

LiteLLMSan FranciscoProduct
Apply on company site
Salary
$200K - $260K USD
Job type
Full-time
Posted
10 Jul 2026
Status
Open · checked 7d ago

About this role

LiteLLM is seeking a Product Engineer to join the team in San Francisco for a full-time position focused on building the next generation of AI infrastructure. This unique role suits a versatile developer who enjoys talking to customers, designing solutions, and shipping production code to impact thousands of engineering teams.

Role Overview

This position blends product management and software engineering into a single dynamic role based in San Francisco. Team members collaborate directly with the founders to figure out developer needs, build new solutions, and help shape LiteLLM's second major product. The work involves taking total ownership of problems from initial idea all the way to production.

Key Responsibilities

Build new product features from concept to production while maintaining high quality standards.
Communicate directly with customers to discover pain points and validate potential solutions.
Prototype new ideas and iterate rapidly based on real user feedback.
Own major product areas and continuously improve them over time.
Design backend APIs and services using Python and FastAPI.
Construct intuitive developer experiences across the API, dashboard, and command-line interface.
Partner directly with the founders on product direction and technical choices.
Help define and build the company's second major product.

Requirements

Hold a Bachelor's or Master's degree in Computer Science or a related field.
Possess strong software engineering fundamentals.
Bring experience building production software, preferably utilizing Python.
Feel comfortable moving across the entire technology stack when required, including backend, frontend, infrastructure, and APIs.
Demonstrate strong product intuition alongside curiosity about how customers utilize software.
Exhibit excellent written and verbal communication skills.
Display high ownership by identifying and solving problems independently.
Feel comfortable operating within ambiguity and making decisions with incomplete information.
Show excitement for shipping quickly and learning directly from real users.

Nice to Have

Experience working at an early-stage startup.
Experience building developer tools or infrastructure products.
A history of open-source contributions.
Experience building and launching a personal product.
Familiarity with AI infrastructure, LLMs, or developer platforms.

Skills and Tools

Python
FastAPI
LLMs and AI infrastructure
APIs, Dashboards, and CLI development

Salary and Benefits

Competitive salary ranging from $200,000 to $260,000 per year in USD.
Equity options.
Health, dental, and vision benefits.

About the Company

LiteLLM is the creator of the world's most widely adopted AI Gateway, trusted by organizations like NASA, Netflix, and Adobe. The company delivers a unified API for over 100 large language model providers, offering routing, authentication, budgeting, governance, and observability for production AI systems.

How to Apply

Interested candidates should visit the official company careers page to submit their application and learn more about joining the team.

Skills and tech stack

PythonLLM

Questions candidates ask

What is the location of the Product Engineer role?

The position is based in San Francisco, CA, and is not a remote role.

What is the salary range for this position?

The salary ranges from $200,000 to $260,000 per year in USD, accompanied by equity and benefits.

What technologies and tools are used in this role?

The role involves working with Python, FastAPI, APIs, dashboards, command-line interfaces, and large language model infrastructure.

What educational background is required?

Candidates must have a Bachelor's or Master's degree in Computer Science or a related field.

Who will the Product Engineer work with?

The engineer will work directly with the company founders every day, as well as interact directly with customers.

Ready to apply?

The application is on the official LiteLLM careers page.

Apply on company site