Senior Software Engineer, Model Serving

What this role involves

This role involves designing and building core systems for Databricks' Model Serving product, which provides a unified platform for deploying and managing AI/ML models at scale. The engineer will drive architectural decisions, optimize performance for CPU and GPU workloads, and collaborate cross-functionally to deliver reliable, low-latency inference infrastructure. The position also includes mentoring and establishing best practices for code quality and operational readiness.

Skills this posting asks for

• large-scale distributed systems
• model serving
• inference systems
• routing
• scheduling
• autoscaling
• observability
• algorithms
• data structures
• system design
• cpu inference
• gpu inference
• container builds
• deployment workflows
• caching
• mentoring

Requirements

• 5 years of experience
• Level: senior

From the employer’s posting

At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platf…