Staff Software Engineer, Inference

What this role involves

Staff Software Engineer on the Inference Platform team at CoreWeave, responsible for building and operating a Kubernetes-native inference platform for low-latency, high-throughput AI workloads. The role involves technical leadership, cross-team design initiatives, and optimizing system performance and reliability at scale.

Skills this posting asks for

• go
• python
• c++
• kubernetes
• distributed systems
• networking
• performance optimization
• inference systems
• batching
• micro-batching
• caching
• memory optimization
• mixed precision
• bf16
• fp8
• streaming inference
• gpu resource management
• low-latency
• high-throughput
• metrics-driven
• scheduling
• service design

Requirements

• 8 years of experience
• Level: staff

From the employer’s posting

CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of…