Staff Software Engineer- Foundation Model Inference

What this role involves

Databricks is hiring a Staff Software Engineer for the Foundation Model Inference team. The role involves building LLM infrastructure for large-scale inference workloads, improving reliability and efficiency of distributed AI systems, and collaborating with platform, infra, and ML teams. Candidates need 8+ years of backend or infrastructure engineering experience with distributed systems and ML infrastructure.

Skills this posting asks for

• backend engineering
• infrastructure engineering
• distributed systems
• scalable apis
• cloud-native infrastructure
• real-time serving
• ml infrastructure
• gpu orchestration
• service-oriented architecture
• deployment pipelines
• system observability
• sagemaker
• vertex ai
• azure ml
• mlflow
• pytorch
• ray
• vllm
• sglang

Requirements

• 8 years of experience
• Level: senior

From the employer’s posting

P-1930 At Databricks, we are passionate about enabling data and AI teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI…