AI Model Evaluation Architect

Risedatalabs; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Risedatalabs seeks a senior expert to evaluate and improve AI models through rigorous testing and analysis. You will design evaluation frameworks, assess model performance, and provide actionable insights to drive model improvements across diverse scenarios.

The ideal candidate has a PhD or Master’s in CS/ML, 5+ years in AI/ML evaluation, strong statistical expertise, experience with evaluation frameworks, and excellent communication to convey complex results to stakeholders.

Qualifications

• PhD or Master’s in Computer Science, ML, or related field.
• 5+ years of experience in AI/ML model evaluation.
• Strong background in statistical analysis.
• Experience with evaluation frameworks and metrics.
• Excellent communication skills.

Responsibilities

• Design and implement evaluation metrics for AI models.
• Conduct thorough testing of model performance across different scenarios.
• Analyze model outputs for bias, fairness, and accuracy.
• Collaborate with ML engineers to implement improvements.
• Document findings and recommendations.

Skills

Evaluation metrics design

Model testing

Bias and fairness analysis

Statistical analysis

Collaboration with ML engineers

Documentation

Education

PhD or Master in Computer Science/ML or related field

Job description

Risedatalabs seeks a senior expert to evaluate and improve AI models through rigorous testing and analysis. You will design evaluation frameworks, assess model performance, and provide actionable insights to drive model improvements across diverse scenarios.

The ideal candidate has a PhD or Master’s in CS/ML, 5+ years in AI/ML evaluation, strong statistical expertise, experience with evaluation frameworks, and excellent communication to convey complex results to stakeholders.