Latest AI JobsBrowse Jobs
D

Senior Inference Engineer

designworkstalentBellevueEngineering
Apply on company site
Salary
Not listed
Job type
Full-time
Work mode
Remote
Experience
Senior
Posted
2 Oct 2026
Status
Open · checked 7d ago

About this role

Hybrid in Bellevue, WA (downtown), the Senior Inference Engineer position involves building and operating model-serving systems for a next-generation AI infrastructure platform. This opportunity suits experienced engineers who want to focus on high-throughput, low-latency machine learning inference and large-scale distributed systems.

Role Overview

This foundational engineering role centers on moving artificial intelligence models from research settings into reliable production services. The engineer operates within a lean, collaborative team to design infrastructure that maximizes hardware efficiency, manages large model workloads, and ensures scalability. The position requires working on a hybrid schedule with approximately three days per week in the downtown Bellevue office.

Key Responsibilities

Build and operate production-grade model-serving and inference systems supporting high-throughput, low-latency artificial intelligence workloads.
Optimize inference infrastructure for token throughput, latency, scalability, and cost efficiency across different model architectures.
Design systems that maximize graphics processing unit utilization while maintaining predictable performance and reliability.
Improve the scalability and operational maturity of inference platforms as customer demand grows.
Partner with artificial intelligence training, graphics processing unit performance, orchestration, and infrastructure teams to ensure smooth production transitions.
Develop monitoring, alerting, and operational practices to maintain reliable inference services.
Investigate and resolve performance, reliability, and capacity challenges across inference workloads.
Contribute to architecture decisions and engineering standards as the platform evolves.

Requirements

Experience building and operating production machine learning inference or model-serving systems at scale.
Strong understanding of the performance trade-offs involved in serving large artificial intelligence models, including latency, throughput, memory utilization, and cost efficiency.
Experience designing reliable distributed systems or production infrastructure.
Understanding of graphics processing unit-backed artificial intelligence workloads and the challenges of scaling inference systems.
Strong engineering fundamentals and the ability to independently own complex technical problems.
Comfort working in a fast-moving environment where systems and processes are built from the ground up.

Nice to Have

Experience with modern inference-serving frameworks such as vLLM, SGLang, TensorRT-LLM, Triton Inference Server, or similar technologies.
Experience optimizing large language model inference workloads or large-scale artificial intelligence serving platforms.
Background operating application programming interface-based artificial intelligence products or high-volume production services.
Experience with graphics processing unit scheduling, distributed systems, Kubernetes, or cloud infrastructure platforms.
Familiarity with model optimization techniques such as quantization, batching, caching, or performance tuning.
Experience working at a hyperscaler, artificial intelligence lab, graphics processing unit cloud provider, or large-scale machine learning infrastructure organization.

Skills and Tools

vLLM
SGLang
TensorRT-LLM
Triton Inference Server
Kubernetes
Distributed systems
Graphics processing unit scheduling and optimization

Salary and Benefits

Competitive base pay for the Bellevue market with eligibility for merit increases, annual bonuses, and long-term incentives based on individual performance.
Medical, dental, and vision insurance for United States-based employees.
A 401(k) plan with company match and paid holidays.

About the Company

Designworkstalent represents a well-funded, rapidly growing artificial intelligence infrastructure company developing a next-generation cloud platform. The organization combines startup speed and ownership with the stability of an established parent organization, backed by significant long-term investment.

How to Apply

Candidates must have United States work authorization as visa sponsorship is not currently available. Interested applicants should apply on the official company careers page.

Skills and tech stack

vLLMSGLangTensorRT-LLMTriton Inference ServerKubernetesLLMMachine LearningFine-tuningDistributed Systems

Questions candidates ask

Where is the position located?

The role is hybrid and based in downtown Bellevue, WA, requiring approximately three days per week in the office. Candidates elsewhere in the United States who are open to relocation may also apply.

What level of experience is required?

The posting lists titles for Senior and Staff levels with multiple roles available.

Is visa sponsorship available?

No, United States work authorization is required and visa sponsorship is not currently available.

What benefits are included?

United States-based employees receive medical, dental, and vision insurance, a 401(k) plan with company match, and paid holidays, along with potential eligibility for merit increases, annual bonuses, and long-term incentives.

What tools and frameworks are relevant to the role?

Relevant frameworks and technologies include vLLM, SGLang, TensorRT-LLM, Triton Inference Server, Kubernetes, and distributed infrastructure systems.

Ready to apply?

The application is on the official designworkstalent careers page.

Apply on company site