Senior Machine Learning Engineer

What this role involves

Rubrik is seeking a Senior Machine Learning Engineer to join the SAGE team, focusing on building and deploying small language models for real-time AI governance. The role involves training, fine-tuning, and distilling models, as well as engineering high-performance model serving infrastructure. The team works on productionizing LLM-as-judge for enterprise agent governance.

Skills this posting asks for

• small language models
• supervised fine-tuning
• preference optimization
• distillation
• classifiers
• model serving
• inference infrastructure
• quantization
• lora
• grpo
• fp8/int8 quantization
• speculative decoding
• kv-cache
• continuous batching
• adversarial training
• red-teaming
• python
• pytorch
• transformers
• vllm
• kubernetes

Requirements

• Level: senior

From the employer’s posting

About the Team & Role: We're building SAGE, Rubrik's Semantic AI Governance Engine, which is the first system designed to monitor, govern, and remediate autonomous AI agents in real time. SAGE powers Rubrik Agent Cloud: enterprises define governance…