Staff Software Engineer, Model Infrastructure

What this role involves

Harvey is seeking a Staff Software Engineer to lead the design and development of the Model Infrastructure platform powering AI requests. The role involves building systems for model reliability, routing, observability, and cost optimization, collaborating with AI Research and Product Engineering. Requires 7+ years of experience in large-scale distributed systems.

Skills this posting asks for

• python
• go
• kubernetes
• terraform
• aws
• gcp
• azure
• openai
• anthropic
• model deployment
• model serving
• distributed systems
• infrastructure
• observability
• cost optimization

Requirements

• 7 years of experience
• Level: staff

From the employer’s posting

WHY HARVEY At Harvey, we’re transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come. This is a rare chance to help build a generat…