Global AI Evaluation Operations Leader

Harvey; California (MO); On-site; USD 130,000 - 190,000; Full time

Job summary

Harvey is seeking a technical, systems-minded operator to build and scale the evaluation engine behind its platform. As we expand globally, ensuring models are reliable, accurate, and jurisdictionally correct is mission-critical.

You'll work with Applied Legal Researchers, Product, Engineering, AI Research, and human data providers to operationalize methodologies and embed them into our product lifecycle.

Qualifications

• 4-7+ years in technical program management, product operations, research operations, or evaluation/benchmarking roles.
• Experience working with ML/AI evaluations, benchmarking frameworks, or scientific workflows.
• Comfort with statistical methodologies and SQL or Python to interpret evaluation data.

Responsibilities

• Build and scale the evaluation systems powering Harvey's platform.
• Embed evaluation workflows into the product development lifecycle.
• Create the single source of truth for evaluation status, results, and launch readiness.
• Drive evaluation readiness for major product and model launches across geographies.

Skills

ML/AI evaluations

SQL

Python

Cross-functional coordination

Communication skills

Documentation

ROI mindset

Legal collaboration

Tools

SQL

Python

Job description

Harvey is seeking a technical, systems-minded operator to build and scale the evaluation engine behind its platform. As we expand globally, ensuring models are reliable, accurate, and jurisdictionally correct is mission-critical.

You'll work with Applied Legal Researchers, Product, Engineering, AI Research, and human data providers to operationalize methodologies and embed them into our product lifecycle.