Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
Cresta is hiring an AI Agent Evaluation Engineer to shape how we measure agent quality across conversations. You will design evaluation rubrics, build automated judges, and calibrate them against human labels to ensure reliable metrics.
You’ll work on multilingual evaluations and collaborate with ML, engineering, and product teams to improve agent performance across languages and channels. You will develop scalable evaluation pipelines, define failure taxonomies, and communicate results clearly
Cresta is hiring an AI Agent Evaluation Engineer to shape how we measure agent quality across conversations. You will design evaluation rubrics, build automated judges, and calibrate them against human labels to ensure reliable metrics.
You’ll work on multilingual evaluations and collaborate with ML, engineering, and product teams to improve agent performance across languages and channels. You will develop scalable evaluation pipelines, define failure taxonomies, and communicate results clearly