Latest AI JobsBrowse Jobs
Luma AI logo

Software Engineer, Inference

Luma AIRedwood City, CAResearch & AI
Apply on company site
Salary
$195K – $345K
Job type
Full-time
Work mode
Remote
Experience
Senior
Posted
8 Oct 2026
Status
Open · checked 7d ago

About this role

Based in Redwood City, CA, Luma AI is hiring a full-time Software Engineer, Inference to manage model serving, fleet scaling, and inference reliability. This position suits an experienced systems engineer who prefers infrastructure and deployment over pure machine learning modeling.

Role Overview

Luma AI seeks a professional to take ownership of how generative models are served to users. The professional handles inference engine integration, GPU cluster management, and pipeline reliability across multiple hardware providers.

Key Responsibilities

Integrate fresh model architectures directly into the core inference engine.
Partner alongside research, infrastructure, and engineering teams to streamline deployment efficiency.
Develop internal measurement and profiling tools to monitor inference job lifecycles.
Maintain, test, and automate inference services to ensure high availability.
Scale deployments across extensive hardware clusters and optimize workloads.
Create scheduling systems that maximize GPU utilization while adhering to established service level objectives.

Requirements

Proficiency in Python and system architecture design.
Background in deploying models utilizing frameworks like PyTorch, Hugging Face, vLLM, SGLang, or TensorRT-LLM.
Practical knowledge of large-scale traffic control, queues, fleet management, and scheduling.
Familiarity with Linux, Kubernetes, Docker, and associated orchestration tools.
Working knowledge of Redis and S3-compatible storage systems.

Nice to Have

Understanding of modern networking stacks including RDMA, RoCE, InfiniBand, and NVLink.
Background working on large-scale machine learning systems managing over 100 GPUs.
Experience with CUDA, FFmpeg, and multimedia processing.

Skills and Tools

Python
PyTorch
Hugging Face
vLLM
SGLang
TensorRT-LLM
Linux
Docker
Kubernetes
Redis
S3-compatible storage
CUDA
FFmpeg

Salary and Benefits

The compensation package ranges from $195K to $345K with equity offerings included.

About the Company

Luma AI focuses on building unified general intelligence capable of generating, understanding, and operating within the physical world. The organization emphasizes multimodality and vision as the next progression beyond standard language models.

How to Apply

Interested candidates should apply on the official company careers page.

Skills and tech stack

Questions candidates ask

Where is the Software Engineer, Inference position located?

The role is located in Redwood City, CA.

What is the salary range for this job?

The position offers a salary between $195K and $345K, along with equity.

Is this a pure machine learning modeling role?

No, this is firmly on the systems side, focusing on inference engines, scheduling, fleet management, and infrastructure rather than model research.

What core technologies are required for this role?

Candidates need strong Python skills, experience with frameworks like PyTorch, vLLM, or Hugging Face, and proficiency with Linux, Docker, Kubernetes, Redis, and S3 storage.

Ready to apply?

The application is on the official Luma AI careers page.

Apply on company site