Senior Software Engineering Manager – KV Cache Platform

What this role involves

DDN is seeking a Senior Software Engineering Manager to lead the engineering organization for their KV Cache Platform, a distributed memory and storage platform for accelerating large-scale LLM inference across GPU clusters. The role involves leading geographically distributed teams, defining technical vision and execution strategy, and partnering with product management, sales, and NVIDIA. Responsibilities include driving architecture, development, and delivery of distributed systems supporting AI inference, GPU memory optimization, and related technologies.

Skills this posting asks for

• go
• python
• c++
• linux
• kubernetes
• rdma
• gpudirect storage
• nvidia dynamo
• tensorrt-llm
• triton
• bluefield dpu
• distributed systems
• cloud-native architectures
• hpc
• distributed storage
• networking
• performance engineering

Requirements

• 15 years of experience
• Level: senior

From the employer’s posting

DDN is seeking a Senior Software Engineering Manager to lead the engineering organization responsible for our KV Cache Platform—a distributed memory and storage platform that accelerates large-scale LLM inference across GPU clusters. In this role, you will lead geographically distributed engineeri…