Data Science Quality Architect — Remote Contractor

YO IT Consulting; Phoenix (AZ); On-site; USD 82,656 - 165,312; Part time

Job summary

YO IT Consulting is seeking a Data Scientist for a fully remote contractor role partnering with a leading AI research organization. You will define what excellent work looks like by designing task-specific grading criteria and scoring real-world data science deliverables with rigorous written justifications.

The ideal candidate has 5+ years of data science experience, strong experiment design and SQL/Python skills, and the ability to communicate findings to executives.

Qualifications

• 5+ years of professional data science experience.
• Deep fluency in experiment design and A/B testing.
• Strong SQL and Python analysis skills.
• Excellent written communication.
• Experience with AI training/evaluation is a plus.

Responsibilities

• Design grading criteria for analyses, models, dashboards.
• Score samples with written justifications.
• Ensure scores are reproducible and defensible.
• Incorporate feedback from senior reviewers.

Skills

Data science

Experiment design

SQL

Python

Executive comms

Job description

YO IT Consulting is seeking a Data Scientist for a fully remote contractor role partnering with a leading AI research organization. You will define what excellent work looks like by designing task-specific grading criteria and scoring real-world data science deliverables with rigorous written justifications.

The ideal candidate has 5+ years of data science experience, strong experiment design and SQL/Python skills, and the ability to communicate findings to executives.