Staff Software Engineer, Foundation Model Inference

What this role involves

Databricks is hiring a Staff Software Engineer for the Foundation Model Inference team to build LLM infrastructure for large-scale inference workloads. The role involves shaping the FMAPI product, improving reliability and latency of distributed AI workloads, and collaborating with platform and ML teams. Requires 8+ years of backend or infrastructure engineering experience.

Skills this posting asks for

• scala
• go
• python
• distributed systems
• scalable apis
• cloud-native infrastructure
• real-time serving
• ml infrastructure
• gpu orchestration
• service-oriented architecture
• deployment pipelines
• system observability
• sagemaker
• vertex ai
• azure ml

Requirements

• 8 years of experience
• Level: senior

From the employer’s posting

P-1930 At Databricks, we are passionate about enabling data and AI teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's…