Data Science Expert

Weekday 1; United States; Remote; USD 165,000 - 234,000; Full time

Benefits offered by this job

Fully remote

Flexible scheduling

Job summary

Weekday 1 is recruiting Data Science Experts to define high-quality evaluation frameworks for AI performance on real-world data science tasks. You will assess AI outputs with structured, evidence-based feedback and help shape how complex analytical work is judged.

Ideal candidates bring 5+ years in industry data science, strong stats, SQL and Python, and exceptional written communication to produce reproducible, defensible assessments and actionable business recommendations.

Qualifications

• 5+ years of professional experience in Data Science in an industry environment.
• Strong background in business operations, product analytics, or growth analytics at technology-driven organizations.
• Deep expertise in experimental design and A/B testing, statistical analysis, SQL and Python, metric development and measurement.
• Excellent written communication skills with the ability to explain technical reasoning clearly.
• Exceptional attention to detail and ability to evaluate work against structured rubrics.
• Comfortable receiving feedback and calibrating evaluation standards with peers.

Responsibilities

• Design detailed evaluation criteria for data science deliverables, including analyses, models, dashboards, experiment results and business insights.
• Evaluate AI-generated and human-produced work using objective scoring frameworks.
• Provide detailed written justifications for each evaluation, ensuring consistency and accuracy.
• Apply analytical judgment to produce reproducible and defensible assessments.
• Incorporate structured reviewer feedback and refine methodologies.
• Collaborate with cross-functional teams to improve AI training quality and evaluation standards.

Skills

SQL

Python

Experiment design

A/B testing

Statistical analysis

Written communication

Tools

SQL databases

Python libraries

Job description

This role is for one of our clients

Compensation: $120-$170 per hour

Join a leading AI research organization working on the next generation of intelligent systems. We are seeking experienced Data Science Experts to help evaluate how effectively AI performs real-world data science tasks. Rather than building models or delivering business analyses yourself, you will define what high-quality work looks like by creating robust evaluation frameworks and assessing AI-generated outputs with structured, evidence-based feedback.

This is an excellent opportunity to apply your industry expertise to improve advanced AI systems while influencing how they reason through complex analytical problems.

Requirements

Key Responsibilities

• Design detailed, task-specific evaluation criteria for real-world data science deliverables, including:
  • Data analyses
  • Predictive and statistical models
  • Dashboards and visualizations
  • Experiment results
  • Executive recommendations and business insights
• Evaluate AI-generated and human-produced work using objective scoring frameworks.
• Provide detailed written justifications for each evaluation, ensuring consistency and technical accuracy.
• Apply sound analytical judgment to produce reproducible and defensible assessments.
• Incorporate structured reviewer feedback and continuously refine evaluation methodologies.
• Collaborate with cross-functional teams to improve AI training quality and evaluation standards.

Required Qualifications

• 5+ years of professional experience in Data Science within an industry environment.
• Strong background in business operations, product analytics, growth analytics, or similar data science functions at technology-driven organizations.
• Deep expertise in:
  • Experimental design and A/B testing
  • Statistical analysis
  • SQL and Python
  • Metric development and performance measurement
  • Translating analytical findings into business recommendations
• Excellent written communication skills with the ability to clearly explain technical reasoning.
• Exceptional attention to detail and the ability to evaluate work consistently against structured rubrics.
• Comfortable receiving feedback and calibrating evaluation standards with peer reviewers.

Preferred Qualifications

• Experience contributing to AI evaluation, model training, human feedback, or data annotation initiatives.
• Familiarity with large language models (LLMs), AI-assisted analytics, or machine learning workflows.
• Experience reviewing technical work or mentoring analytical teams is a plus.

Why Join?

• Contribute to the development of next-generation AI systems used for real-world analytical reasoning.
• Apply your professional data science expertise to high-impact AI evaluation projects.
• Work remotely with flexible scheduling.
• Collaborate with a network of experienced technical professionals helping define the future of AI quality and reasoning.

We welcome applicants from all backgrounds and are committed to providing equal opportunities and reasonable accommodations throughout the recruitment process.

Contract Details

• Independent contractor engagement.
• Fully remote with flexible working hours.
• Project duration may be extended or concluded based on project requirements and performance.
• Weekly payments based on approved work completed.<li>Please note that H1-B and STEM OPT sponsorship is not available for this engagement.</li>