AI Engineer, Evaluation
Distyl AI · Remote
- Posted
- 65 days ago
- Last confirmed live
- 1 day ago
What this role involves
Distyl is seeking an AI Engineer focused on evaluation to design and implement evaluation frameworks for AI systems. The role involves building evaluation pipelines, golden test cases, and LLM-based graders to drive development and deployment decisions. Candidates need strong Python skills and experience with evaluation-driven or experiment-driven development.
Skills this posting asks for
- python
- evaluation-driven development
- experiment-driven development
- llm-based graders
- evaluation pipelines
- test generation
- golden test cases
- regression suites
- domain expertise elicitation
- software engineering
Requirements
- 2 years of experience
- Level: mid
From the employer’s posting
ABOUT DISTYL AI Distyl is an applied AI technology company partnering with the world’s most ambitious institutions to rearchitect critical operations for the frontier of AI. Our customers include the largest companies in telecom, healthcare, insurance, manufacturing, consumer goods, and global soc…
Read the full description on Distyl AI’s careers pageApply without filling the form
Approve this role and the application is completed for you, including a résumé tailored to it. You get a confirmation when it lands, and a credit is only spent when a submission is confirmed.
Other roles at Distyl AI
- Forward Deployed AI Engineer - Enterprise LeadRemote
- Forward Deployed AI Engineer - LeadRemote
- Forward Deployed AI EngineerRemote