AI Model Quality & Evaluation Lead

Rise Data Labs; New York (NY); On-site; USD 120,000 - 160,000; Full time

Job summary

BAM Ventures is seeking an expert to evaluate and improve our AI models through rigorous testing and analysis. You will design evaluation frameworks, run model assessments, and deliver actionable insights to drive improvements.

Ideal candidates hold a PhD or Master’s in CS/ML, 5+ years in AI/ML evaluation, and strong statistical analysis skills. Excellent communication and experience with evaluation metrics are essential.

Qualifications

• PhD or Master's in CS/ML required
• 5+ years in AI/ML model evaluation
• Strong background in statistics
• Experience with evaluation frameworks and metrics
• Excellent communication skills

Responsibilities

• Design and implement evaluation metrics for AI models
• Conduct thorough testing of model performance across different scenarios
• Analyze model outputs for bias, fairness, and accuracy
• Collaborate with ML engineers to implement improvements
• Document findings and recommendations

Skills

AI/ML evaluation

Statistical analysis

Communication skills

Frameworks & metrics

Education

PhD or Masters in CS/ML

Job description

BAM Ventures is seeking an expert to evaluate and improve our AI models through rigorous testing and analysis. You will design evaluation frameworks, run model assessments, and deliver actionable insights to drive improvements.

Ideal candidates hold a PhD or Master’s in CS/ML, 5+ years in AI/ML evaluation, and strong statistical analysis skills. Excellent communication and experience with evaluation metrics are essential.