Remote Data Science Evaluation Lead - Contractor

YO IT Consulting; North Carolina; On-site; USD 83,000 - 165,000; Full time

Job summary

YO IT Consulting is seeking a Data Scientist contractor to collaborate with a leading AI research organization. You will define what constitutes excellent work by designing task-specific grading criteria and scoring data science deliverables with rigorous, written justifications.

The role is fully remote and emphasizes structured evaluation, evidence-based scoring, and clear communication to executive stakeholders.

Qualifications

• 5+ years of data science experience in industry.
• Experience with AI training/evaluation is a plus.
• Strong written communication and ability to justify scores.
• Comfortable with independent contractor environment.

Responsibilities

• Design grading criteria for real-world data science deliverables
• Score samples with written justifications
• Ensure scores are reproducible and defensible
• Incorporate feedback from senior reviewers and iterate

Skills

Data science experience

Experiment design & A/B testing

SQL & Python analysis

Executive communication

Job description

YO IT Consulting is seeking a Data Scientist contractor to collaborate with a leading AI research organization. You will define what constitutes excellent work by designing task-specific grading criteria and scoring data science deliverables with rigorous, written justifications.

The role is fully remote and emphasizes structured evaluation, evidence-based scoring, and clear communication to executive stakeholders.