LlamaIndex is hiring a Head of Engineering in San Francisco to manage engineering execution, technical direction, and team development. This hands-on position suits an experienced technical leader with a background in B2B SaaS, model training, and API product delivery.
Role Overview
LlamaIndex focuses on making enterprise data useful for AI applications. The Head of Engineering directs technical strategy, oversees product delivery, and collaborates directly with leadership and product divisions.
Key Responsibilities
Direct and mentor the engineering organization while establishing clear priorities and accountability.
Collaborate with company leaders to turn customer requirements into a predictable product roadmap.
Maintain hands-on involvement in architecture reviews, code contributions, and production troubleshooting.
Define technical strategies across application services, APIs, data pipelines, and machine learning infrastructure.
Coordinate with researchers and machine learning engineers on training, fine-tuning, evaluation, and deployment.
Oversee model serving strategies concerning latency, throughput, GPU efficiency, capacity, and inference costs.
Refine engineering operations related to testing, security, observability, releases, and incident response.
Recruit new talent, mentor managers, and cultivate a culture centered on direct communication and accountability.
Requirements
Leadership experience across multiple engineering teams within B2B SaaS, matching the scope of a 20 to 30-person organization.
Active technical capabilities including writing production code, reviewing system architecture, and resolving complex bugs.
Hands-on familiarity with model training and serving operations, covering fine-tuning, evaluation, and deployment.
Knowledge of balancing model quality against latency, throughput, GPU capacity, reliability, and cost.
Background in backend architectures, distributed systems, cloud infrastructure, and APIs.
History of recruiting, coaching, and evaluating software engineers.
Sound product judgment regarding speed versus correctness and security.
Strong verbal and written communication skills for technical and leadership interactions.
Nice to Have
Scaling engineering organizations at Series A through Series C startups.
Working with document processing, OCR, extraction, indexing, and retrieval systems.
Experience with large language models, multimodal models, evaluation datasets, and quality monitoring.
Background in GPU infrastructure, distributed training, and inference optimization frameworks.
Constructing developer tools and API-first products.
Managing enterprise demands like multi-tenancy, access controls, auditability, and security compliance.
Developing engineering managers while keeping active in technical execution.
Skills and Tools
APIs
Backend systems
Distributed systems
Cloud infrastructure
Machine learning infrastructure
GPU infrastructure
Large language models
Multimodal models
OCR and document processing
Salary and Benefits
Salary range from $200,000 to $300,000
Equity offerings included
About the Company
LlamaIndex builds technology that makes enterprise data useful for artificial intelligence applications.
How to Apply
Interested candidates should apply on the official company careers page.
