Latest AI JobsBrowse Jobs
LiteLLM logo

AI Engineer

LiteLLMSan FranciscoEngineering
Apply on company site
Salary
$200K - $250K USD
Job type
Full-time
Posted
30 Jul 2026
Status
Open · checked 7d ago

About this role

LiteLLM is hiring an AI Engineer for a full-time position based in San Francisco. This role is ideal for a backend or full-stack professional with one to two years of experience who wants to shape the future of artificial intelligence infrastructure.

Role Overview

As an AI Engineer at LiteLLM, the chosen candidate will focus on unifying the format for calling artificial intelligence application programming interfaces within the broader OpenAI and Anthropic specifications. This position involves writing transformations to convert requests across various model provider formats and constructing provider-agnostic unification functionality, such as session management for the responses endpoint. Working directly alongside the chief executive officer and chief technology officer, the employee will tackle critical infrastructure projects and help define the developer experience for millions of users who rely on the Python software development kit.

Key Responsibilities

Design systems to support provider-level features at the gateway level, including skills, compaction, and batches.
Enhance developer experience for users interacting with the platform's Python software development kit.
Build across various large language models, model context protocols, and agents by maintaining a strong interoperability layer.
Support a wide range of model context protocol authentication flows and enable diverse agent use cases.
Collaborate closely with the leadership team on core technical initiatives and product decisions.

Requirements

Possess one to two years of backend or full-stack experience working with production systems.
Demonstrate a passion for open-source software and active user engagement.
Bring practical experience working with the OpenAI application programming interface, including understanding differences between chat completions and responses specifications.
Exhibit a strong work ethic with the ability to thrive and move quickly in small teams.
Show eagerness to interact with users and help solve real-world technical problems.

Skills and Tools

Python
Large Language Model APIs
FastAPI
Redis
Postgres

Salary and Benefits

Annual salary ranging from $200,000 to $250,000 in United States Dollars
Equity options
Health, dental, and vision insurance benefits
Direct daily collaboration with company founders
Opportunities to own meaningful product decisions and see code deployed immediately

About the Company

LiteLLM operates the world's most widely adopted artificial intelligence gateway, trusted by organizations like Adobe, Netflix, and NASA. The enterprise delivers a unified programming interface for over one hundred large language model providers alongside routing, authentication, budgeting, observability, and governance tools for production artificial intelligence systems.

How to Apply

Interested candidates should visit the official LiteLLM careers page on their website to submit an application.

Skills and tech stack

PythonLLM

Questions candidates ask

What is the location and employment type for this role?

The AI Engineer position is a full-time role located in San Francisco, California.

What salary range is offered for the AI Engineer position?

The compensation ranges from $200,000 to $250,000 per year in USD.

How much experience is required to apply?

Applicants should have 1 to 2 years of backend or full-stack experience with production systems.

What technology stack does LiteLLM use?

The core technology stack includes Python, FastAPI, Redis, and Postgres.

What benefits are included with employment?

Benefits include a competitive salary, equity, and health, dental, and vision coverage.

Ready to apply?

The application is on the official LiteLLM careers page.

Apply on company site