Senior QA Engineer
Third Way Health, Inc. · Cambridge, MA
- Last confirmed live
- 2 days ago
What this role involves
Third Way Health is seeking a Senior QA Engineer to own and evolve the quality and evaluation infrastructure for their AI-powered patient engagement platform. The role involves building multi-layered eval pipelines, observability stacks, and adversarial test suites, requiring 5+ years of experience with strong Python skills and expertise in LLM evaluation systems.
Skills this posting asks for
- python
- pytest
- fastapi testclient
- pydantic
- llm evaluation
- deterministic testing
- model-graded assessment
- rule-based validation
- voice ai
- conversational ai
- tool-calling
- transcript analysis
- observability
- monitoring
- ci/cd
- api testing
- test frameworks
- eval pipelines
- prompt engineering
- guardrails
- adversarial testing
Requirements
- 5 years of experience
- Level: senior
Apply without filling the form
Approve this role and the application is completed for you, including a résumé tailored to it. You get a confirmation when it lands, and a credit is only spent when a submission is confirmed.
Other roles at Third Way Health, Inc.
- Product Manager, Voice AICambridge, MA
- AI / ML EngineerCambridge, MA