Latest AI JobsBrowse Jobs
DDN logo

Senior Software Engineering Manager – KV Cache Platform

DDNSanta Clara ColocationDepartment
Apply on company site
Salary
Not listed
Job type
Full-time
Work mode
Remote
Posted
31 Jul 2026
Status
Open · checked 7d ago

About this role

DDN is hiring a remote Senior Software Engineering Manager to lead the engineering team for the KV Cache Platform, a distributed memory and storage solution that accelerates large-scale LLM inference. This high-visibility role suits an experienced engineering leader with a strong background in distributed systems and AI infrastructure.

Role Overview

In this position, the manager will lead geographically distributed teams to build low-latency, highly scalable distributed systems that power modern AI inference. The chosen candidate will set the technical vision and execute the platform roadmap while collaborating with executive leadership, Product Management, Sales, and partners like NVIDIA to deliver advanced AI infrastructure solutions.

Key Responsibilities

Guide, mentor, and expand a distributed engineering team while cultivating a collaborative and innovative culture.
Design and implement the technical strategy and roadmap for the KV Cache Platform to guarantee reliability, scalability, and security.
Direct the architecture and delivery of distributed systems focused on GPU memory optimization, distributed caching, RDMA networking, GPUDirect Storage, and NVIDIA BlueField DPUs.
Coordinate with Product Management, Sales, and strategic partners to prioritize customer needs, execute proof-of-concepts, and drive successful deployments.
Manage daily engineering operations, including release planning, feature development, bug triage, and customer escalations.
Implement engineering standards focused on software quality, automation, observability, testing, and production readiness.
Work alongside hardware and infrastructure teams to produce scalable AI infrastructure and mentor emerging technical leaders.

Requirements

Fifteen or more years of professional experience creating cloud infrastructure, distributed systems, storage platforms, or AI infrastructure software.
Seven or more years of experience managing high-performing engineering organizations, specifically with geographically distributed teams.
Demonstrated track record of shipping large-scale distributed infrastructure products from concept to production.
Comprehensive knowledge of Linux, networking, performance engineering, distributed systems, and cloud-native designs.
Hands-on coding proficiency in Go and Python.
Proven capability to guide cross-functional initiatives and shape technical strategies across multiple groups.
Direct exposure to building LLM serving platforms, AI infrastructure, distributed caching, or high-performance storage.
Familiarity with NVIDIA ecosystems, TensorRT-LLM, Triton, RDMA, GPUDirect Storage, BlueField DPUs, Kubernetes, or related AI technologies.
Professional background in enterprise infrastructure software, high-performance computing, or distributed storage.
Experience partnering directly with enterprise customers, hyperscalers, OEMs, or technology partners.

Nice to Have

Practical programming experience utilizing C or C++.

Skills and Tools

Python
Go
C/C++ (Optional)
Kubernetes
Linux
RDMA Networking
GPUDirect Storage
NVIDIA BlueField DPUs
TensorRT-LLM
Triton
Distributed Systems and Caching

About the Company

DDN delivers innovative infrastructure solutions tailored for artificial intelligence and high-performance computing, partnering with major industry leaders like NVIDIA to support complex customer deployments.

How to Apply

Interested candidates should visit the official DDN careers page to submit their application for this remote position.

Skills and tech stack

PythonKubernetesC++LLM

Questions candidates ask

What is the primary focus of this role?

The Senior Software Engineering Manager leads the engineering organization responsible for the KV Cache Platform, accelerating large-scale LLM inference across GPU clusters.

Is this position remote?

Yes, this role offers remote work flexibility.

What experience level is required?

Applicants must have 15+ years of experience building distributed systems, storage platforms, cloud infrastructure, or AI infrastructure software, along with 7+ years of engineering management experience.

What programming languages are required?

Hands-on programming experience with Go and Python is required, while experience with C or C++ is considered a plus.

How do I apply for this job?

Candidates can apply directly through the official DDN careers page.

Ready to apply?

The application is on the official DDN careers page.

Apply on company site