A complete application in a minute
Tailored resume and cover letter, ready to send.
Cresta in Oregon is seeking an AI Agent Evaluation Engineer to define quality, build scalable evaluation systems, and measure performance of our AI receptionist across conversations. You will annotate data, design metrics, calibrate judges, and collaborate with engineers, product, and language teams to improve reliability and user experience.
This role blends hands-on analysis with engineering execution in a fast-moving AI company, with opportunities to influence product direction and customer
Cresta in Oregon is seeking an AI Agent Evaluation Engineer to define quality, build scalable evaluation systems, and measure performance of our AI receptionist across conversations. You will annotate data, design metrics, calibrate judges, and collaborate with engineers, product, and language teams to improve reliability and user experience.
This role blends hands-on analysis with engineering execution in a fast-moving AI company, with opportunities to influence product direction and customer