AI Model Evaluation Specialist

Rise Data Labs; United States; On-site; USD 140,000 - 190,000; Full time

Job summary

You will collaborate with ML engineers to implement improvements, document findings, and communicate results clearly to stakeholders. A PhD or Masters with 5+ years in AI/ML evaluation is expected.

Qualifications

• PhD or Masters in CS/ML or related field.
• 5+ years experience in AI/ML model evaluation.
• Strong background in statistics.
• Experience with evaluation metrics and frameworks.
• Excellent communication skills.

Responsibilities

• Design evaluation metrics for AI models.
• Conduct thorough testing of model performance across different scenarios.
• Analyze model outputs for bias, fairness, and accuracy.
• Collaborate with ML engineers to implement improvements.
• Document findings and recommendations.

Skills

Evaluation framework design

Model testing across scenarios

Bias fairness analysis

Collaboration with ML engineers

Technical reporting

Education

PhD in CS/ML

Master’s in CS/ML

Tools

Python

R

TensorFlow

Job description

We are seeking an expert to evaluate and improve our AI models through comprehensive testing and analysis. You will be responsible for designing evaluation frameworks, conducting model assessments, and providing actionable insights for model improvement.

Key Responsibilities

• Design and implement evaluation metrics for AI models
• Conduct thorough testing of model performance across different scenarios
• Analyze model outputs for bias, fairness, and accuracy
• Collaborate with ML engineers to implement improvements
• Document findings and recommendations

Ideal Candidate

• PhD or Masters in Computer Science, ML, or related field
• 5+ years experience in AI/ML model evaluation
• Strong background in statistical analysis
• Experience with evaluation frameworks and metrics
• Excellent communication skills