Remote Enterprise AI Evaluation & Readiness Lead

Ports North; Baltimore (MD); On-site; USD 138,000 - 207,000; Part time

Job summary

Korn Ferry, in partnership with a financial services client, seeks an AI Evaluation Infrastructure & Production Readiness Lead for a contract role. You will shape evaluation frameworks, establish go/no-go criteria, and build scalable testing infra across governance, risk, and compliance teams.

You will lead cross-functional efforts to ensure AI systems are accurate, safe, and production-ready, with emphasis on LLM evaluation, bias testing, and regulatory alignment for enterprise deployment.

Qualifications

• Bachelor's Degree in CS, Engineering, IT, Data Science or related field.
• 7+ years of professional work experience in AI/ML engineering, software quality engineering, data science, or ML.
• Experience building/testing enterprise LLM/ML evaluation frameworks.

Responsibilities

• Lead development of enterprise AI evaluation and production readiness framework with standardized testing, governance, and go/no-go criteria.
• Design scalable AI evaluation infrastructure including evaluation harnesses, data sets, regression testing and bias/fairness validation.
• Collaborate with AI Engineering, Risk, Compliance, Legal, and Model Governance to translate requirements into repeatable AI testing methods and reporting.

Skills

LLM evaluation

Regression testing

Statistical analysis

Production validation

AI testing methodologies

Cross-functional collaboration

Education

Bachelor's Degree in CS/Engineering/Data Science

Job description

Korn Ferry, in partnership with a financial services client, seeks an AI Evaluation Infrastructure & Production Readiness Lead for a contract role. You will shape evaluation frameworks, establish go/no-go criteria, and build scalable testing infra across governance, risk, and compliance teams.

You will lead cross-functional efforts to ensure AI systems are accurate, safe, and production-ready, with emphasis on LLM evaluation, bias testing, and regulatory alignment for enterprise deployment.