Staff Software Engineer - AI Research Infrastructure

What this role involves

This Staff Software Engineer role focuses on building and running the research infrastructure for Databricks AI Research, including job scheduling, orchestration, and tooling for large-scale experiments. The role involves close partnership with research scientists and ML engineers to turn experimental workloads into robust pipelines. Candidates need experience with distributed systems, cluster schedulers, and modern ML workflows.

Skills this posting asks for

• distributed systems
• infrastructure
• gpu clusters
• kubernetes
• slurm
• ray
• c++
• rust
• go
• java
• scala
• distributed training
• model parallelism
• fine-tuning
• evaluation
• experiment management
• ci/cd for research code
• data pipelines
• cloud providers
• backend services
• job orchestration
• resource management

Requirements

• 5 years of experience
• Level: staff

From the employer’s posting

Staff Software Engineer - AI Research Infrastructure P-1215 At Databricks, we are obsessed with enabling data teams to solve the world’s toughest problems, from security threat detection to cancer drug development. We do this by bu…