AI Model Evaluation Specialist

Risedatalabs; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Risedatalabs seeks a senior expert to evaluate and improve AI models through rigorous testing and analysis. You will design evaluation frameworks, assess model performance, and provide actionable insights to drive model improvements across diverse scenarios.

The ideal candidate has a PhD or Master’s in CS/ML, 5+ years in AI/ML evaluation, strong statistical expertise, experience with evaluation frameworks, and excellent communication to convey complex results to stakeholders.

Qualifications

• PhD or Master’s in Computer Science, ML, or related field.
• 5+ years of experience in AI/ML model evaluation.
• Strong background in statistical analysis.
• Experience with evaluation frameworks and metrics.
• Excellent communication skills.

Responsibilities

• Design and implement evaluation metrics for AI models.
• Conduct thorough testing of model performance across different scenarios.
• Analyze model outputs for bias, fairness, and accuracy.
• Collaborate with ML engineers to implement improvements.
• Document findings and recommendations.

Skills

Evaluation metrics design

Model testing

Bias and fairness analysis

Statistical analysis

Collaboration with ML engineers

Documentation

Education

PhD or Master in Computer Science/ML or related field

Job description

We are seeking an expert to evaluate and improve our AI models through comprehensive testing and analysis. You will be responsible for designing evaluation frameworks, conducting model assessments, and providing actionable insights for model improvement.

Key Responsibilities:

• Design and implement evaluation metrics for AI models
• Conduct thorough testing of model performance across different scenarios
• Analyze model outputs for bias, fairness, and accuracy
• Collaborate with ML engineers to implement improvements
• Document findings and recommendations

Ideal Candidate:

• PhD or Masters in Computer Science, ML, or related field
• 5+ years experience in AI/ML model evaluation
• Strong background in statistical analysis
• Experience with evaluation frameworks and metrics
• Excellent communication skills