AI Product Evaluator Lead for Banking Ops

BRG; United States; Remote; USD 180,000 - 250,000; Full time

Job summary

Berkeley Research Group (BRG) is hiring a hands-on AI Product Engineer focused on evaluation for banking operations. You will build automated tests, investigate failures, and provide evidence for release decisions while contributing to product development.

Work with banking experts and engineers to define correct results, measure performance, and drive product improvements from early development through live use.

Qualifications

• Minimum 5 years of working experience in AI evaluation.
• Strong Python skills and experience building automated test software.
• Experience translating business requirements into practical tests and controls.

Responsibilities

• Define what each product must get right and what evidence is needed before use.
• Build reusable tests that run, score results, and compare versions.
• Reproduce failures with engineers to identify causes and verify fixes.
• Verify accuracy of extracted facts, dates, and totals; ensure citations support claims.
• Manage risk and monitor performance, document repeatable tests and unresolved failures.

Skills

Python

Automated testing

Data integration

Job description

Berkeley Research Group (BRG) is hiring a hands-on AI Product Engineer focused on evaluation for banking operations. You will build automated tests, investigate failures, and provide evidence for release decisions while contributing to product development.

Work with banking experts and engineers to define correct results, measure performance, and drive product improvements from early development through live use.