Latest AI JobsBrowse Jobs
Luma AI logo

Software Engineer, Inference

Luma AIRemote, EUResearch & AI
Apply on company site
Salary
Not listed
Job type
Full-time
Work mode
Remote
Experience
Senior
Posted
8 Oct 2026
Status
Open · checked 7d ago

About this role

Remote within the EU, Luma AI seeks a Software Engineer for Inference to manage and scale large model serving infrastructure across thousands of machines. This full-time position suits an experienced systems engineer who prefers infrastructure and deployment over pure machine learning modeling.

Role Overview

This position focuses on large-scale inference systems engineering, including scheduling, fleet management, deployment pipelines, and operational reliability. The professional will direct how models are served by integrating new architectures and maximizing GPU resource efficiency.

Key Responsibilities

Deliver new model architectures by integrating them directly into the inference engine.
Partner with research, infrastructure, and engineering teams to enhance deployment and model efficiency.
Create internal tooling to measure, profile, and monitor the lifecycle of inference workflows and jobs.
Maintain, test, and automate inference services to ensure high availability and uptime.
Scale deployments across thousands of machines while managing and optimizing workloads across clusters and hardware providers.
Construct scheduling systems for optimal GPU resource utilization within strict service level objectives, alongside maintaining continuous integration and deployment pipelines for SDKs and model checkpoints.

Requirements

Strong proficiency in Python combined with solid system-architecture capabilities.
Practical background deploying models utilizing frameworks like PyTorch, Hugging Face, vLLM, SGLang, TensorRT-LLM, or comparable technologies.
Operational knowledge of traffic control, queues, scheduling, and large-scale fleet management.
Hands-on familiarity with Linux, Docker, Kubernetes, orchestration, and deployment.
Working knowledge of Redis and S3-compatible storage systems.

Nice to Have

Familiarity with modern networking stacks such as NVLink, InfiniBand, and RDMA including RoCE.
Background in high-performance, large-scale machine learning systems managing over 100 GPUs.
Experience with CUDA along with multimedia processing or FFmpeg.

Skills and Tools

Python
PyTorch
Hugging Face
vLLM
SGLang
TensorRT-LLM
Linux
Docker
Kubernetes
Redis
S3-compatible storage
CUDA
FFmpeg
RDMA
NVLink

About the Company

Luma AI focuses on developing unified general intelligence capable of generating, understanding, and operating within the physical world. The organization emphasizes multimodality and vision as the next evolution beyond standard language models. Luma AI operates as an equal opportunity employer.

How to Apply

Interested candidates should visit the official Luma AI careers page to submit an application for this remote position.

Skills and tech stack

Questions candidates ask

Where is the Software Engineer, Inference position located?

The job is remote with a location requirement of the European Union (EU).

Does this role involve pure machine learning modeling?

No, this role is firmly on the systems side, focusing on inference infrastructure, model serving, and scaling, rather than pure modeling.

What specific framework and deployment experience is required?

Candidates need experience deploying models with tools such as PyTorch, Hugging Face, vLLM, SGLang, TensorRT-LLM, or similar technologies.

What infrastructure and container tools are needed?

The role requires familiarity with Linux, Docker, Kubernetes, orchestration, deployment, and scheduling.

What is the primary mission of Luma AI?

Luma AI aims to build unified general intelligence that can generate, understand, and operate in the physical world, prioritizing multimodality and vision.

Ready to apply?

The application is on the official Luma AI careers page.

Apply on company site