Senior Data Science Evaluator (Remote, Contract)

Alpheva; United States; Remote; USD 262,000 - 331,000; Part time

Job summary

Alpheva is seeking a senior data science expert to lead AI evaluation projects, focusing on statistical analysis, data quality, experiment design, and reproducibility. You will review model responses and worked examples for technical gaps and reliability issues, and you will write reference answers and scoring criteria grounded in rigorous statistical reasoning.

This is remote, project-based contract work. Hours and assignments depend on project matching, with the listed hourly range applicable

Qualifications

• 7+ years of substantive experience in data science or applied statistics.
• Senior-level judgment in statistical analysis, data quality, experiment design, and reproducibility.

Responsibilities

• Bring senior data science expertise to AI evaluation projects focused on statistical analysis, data quality, experiment design, and reproducibility.
• Review model responses and worked examples for incorrect technical assumptions, missing failure cases, and reliability or security gaps.
• Explain consequential errors, evidence gaps, and the reasoning behind your corrections with traceable evidence.

Skills

Data science experience

Senior-level judgment

Precise reference answers

Job description

Alpheva is seeking a senior data science expert to lead AI evaluation projects, focusing on statistical analysis, data quality, experiment design, and reproducibility. You will review model responses and worked examples for technical gaps and reliability issues, and you will write reference answers and scoring criteria grounded in rigorous statistical reasoning.

This is remote, project-based contract work. Hours and assignments depend on project matching, with the listed hourly range applicable