Lead AI Model Evaluation & Metrics Architect

Rise Data Labs; United States; On-site; USD 140,000 - 190,000; Full time

Job summary

You will collaborate with ML engineers to implement improvements, document findings, and communicate results clearly to stakeholders. A PhD or Masters with 5+ years in AI/ML evaluation is expected.

Qualifications

• PhD or Masters in CS/ML or related field.
• 5+ years experience in AI/ML model evaluation.
• Strong background in statistics.
• Experience with evaluation metrics and frameworks.
• Excellent communication skills.

Responsibilities

• Design evaluation metrics for AI models.
• Conduct thorough testing of model performance across different scenarios.
• Analyze model outputs for bias, fairness, and accuracy.
• Collaborate with ML engineers to implement improvements.
• Document findings and recommendations.

Skills

Evaluation framework design

Model testing across scenarios

Bias fairness analysis

Collaboration with ML engineers

Technical reporting

Education

PhD in CS/ML

Master’s in CS/ML

Tools

Python

R

TensorFlow

Job description

You will collaborate with ML engineers to implement improvements, document findings, and communicate results clearly to stakeholders. A PhD or Masters with 5+ years in AI/ML evaluation is expected.