AI Model Evaluation Specialist

Rise Data Labs; New York (NY); On-site; USD 120,000 - 160,000; Full time

Job summary

BAM Ventures is seeking an expert to evaluate and improve our AI models through rigorous testing and analysis. You will design evaluation frameworks, run model assessments, and deliver actionable insights to drive improvements.

Ideal candidates hold a PhD or Master’s in CS/ML, 5+ years in AI/ML evaluation, and strong statistical analysis skills. Excellent communication and experience with evaluation metrics are essential.

Qualifications

• PhD or Master's in CS/ML required
• 5+ years in AI/ML model evaluation
• Strong background in statistics
• Experience with evaluation frameworks and metrics
• Excellent communication skills

Responsibilities

• Design and implement evaluation metrics for AI models
• Conduct thorough testing of model performance across different scenarios
• Analyze model outputs for bias, fairness, and accuracy
• Collaborate with ML engineers to implement improvements
• Document findings and recommendations

Skills

AI/ML evaluation

Statistical analysis

Communication skills

Frameworks & metrics

Education

PhD or Masters in CS/ML

Job description

We are seeking an expert to evaluate and improve our AI models through comprehensive testing and analysis. You will be responsible for designing evaluation frameworks, conducting model assessments, and providing actionable insights for model improvement.

Key Responsibilities:

• Design and implement evaluation metrics for AI models
• Conduct thorough testing of model performance across different scenarios
• Analyze model outputs for bias, fairness, and accuracy
• Collaborate with ML engineers to implement improvements
• Document findings and recommendations

Ideal Candidate:

• PhD or Masters in Computer Science, ML, or related field
• 5+ years experience in AI/ML model evaluation
• Strong background in statistical analysis
• Experience with evaluation frameworks and metrics
• Excellent communication skills