Senior Machine Learning Engineer (Inference Platform)

What this role involves

This role involves owning the end-to-end lifecycle of production ML serving systems, focusing on the inference platform for a conversational shopping agent. The engineer will optimize performance, reliability, and scalability of multiple serving engines. Key responsibilities include building observability, enforcing SLAs, and collaborating with cross-functional teams.

Skills this posting asks for

• python
• aws
• gcp
• azure
• vllm
• tgi
• tensorrt-llm
• sglang
• llm
• continuous batching
• kv-cache
• quantization
• ci/cd
• gpu
• ml lifecycle
• model registries
• inference serving
• embedding models
• extraction models
• observability
• monitoring
• alerting
• testing
• docker

Requirements

• 5 years of experience
• Level: senior

From the employer’s posting

About Wizard AI At Wizard AI, we’re building the top-performing AI Shopping Agent that delivers the best products from across the web with unmatched accuracy, quality, and trust. Our ML models power the core of our platform, and we’re looking for a Senior M…