Staff AI Evaluation Engineer

Entendre; New York (NY); On-site; USD 90,000 - 120,000; Full time

Job summary

Entendre is seeking a Member of Technical Staff - Evals located in New York, NY, where you will ensure our AI-powered features are high quality and reliable. Your responsibilities include designing evaluation frameworks, building automated tests, and developing tools for seamless evaluations. Required qualifications include experience in quality assurance and evaluation tasks related to AI, along with exceptional communication skills. Familiarity with accounting or financial systems is preferred for this role.

Qualifications

• Experience in writing evaluation tasks for AI applications.
• Background in quality assurance within software or finance sectors.
• Ability to communicate effectively and articulate desired outcomes.

Responsibilities

• Design and maintain evaluation frameworks for AI performance.
• Build automated test harnesses for real data validation.
• Define metrics for clear insights into system performance.
• Create tools for engineers to easily conduct evaluations.
• Collaborate with teams to set standards for product quality.

Skills

Writing and reviewing evaluation tasks for AI

Quality assurance in software or financial analysis

Exceptional written communication skills

Familiarity with accounting or financial systems

Job description

Entendre is seeking a Member of Technical Staff - Evals located in New York, NY, where you will ensure our AI-powered features are high quality and reliable. Your responsibilities include designing evaluation frameworks, building automated tests, and developing tools for seamless evaluations. Required qualifications include experience in quality assurance and evaluation tasks related to AI, along with exceptional communication skills. Familiarity with accounting or financial systems is preferred for this role.