Staff Software Engineer, Model Serving

What this role involves

This is a Staff Software Engineer role focused on building and scaling the Model Serving platform at Databricks. The engineer will design and implement core systems for high-throughput, low-latency inference across CPU and GPU workloads. The role involves cross-functional collaboration and technical leadership.

Skills this posting asks for

• distributed systems
• model serving
• inference systems
• cpu
• gpu
• apis
• system design
• routing
• caching
• observability
• autoscaling
• algorithms
• data structures
• scalability
• reliability
• operational excellence

Requirements

• 10 years of experience
• Level: staff

From the employer’s posting

At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platf…