Data Science Expert

Weekday AI; United States; Remote; USD 165,000 - 234,000; Part time

Benefits offered by this job

Fully remote

Weekly payments

Job summary

Weekday AI seeks Data Science Experts to define evaluation frameworks for evaluating AI outputs in real-world data tasks. You will assess quality by creating robust rubrics and providing structured, evidence-based feedback.

This fully remote, independent contractor role focuses on improving AI reasoning through rigorous evaluation standards and collaboration with cross-functional teams.

Qualifications

• 5+ years of professional Data Science experience in an industry setting.
• Experience in business operations or product analytics.
• Strong background in experimental design and statistics.

Responsibilities

• Design evaluation criteria for real-world data science deliverables.
• Evaluate AI-generated and human-produced work using scoring rubrics.
• Provide written justifications for evaluations and ensure technical accuracy.
• Collaborate with cross-functional teams to improve AI training quality.
• Incorporate reviewer feedback to refine evaluation methodologies.

Skills

Data Science

Experiment design

AB testing

Statistical analysis

SQL

Python

Business analytics

Communication skills

Job description

This role is for one of our clients

Compensation: $120-$170 per hour

Join a leading AI research organization working on the next generation of intelligent systems. We are seeking experienced Data Science Experts to help evaluate how effectively AI performs real-world data science tasks. Rather than building models or delivering business analyses yourself, you will define what high-quality work looks like by creating robust evaluation frameworks and assessing AI-generated outputs with structured, evidence-based feedback.

This is an excellent opportunity to apply your industry expertise to improve advanced AI systems while influencing how they reason through complex analytical problems.

Key Responsibilities

• Design detailed, task-specific evaluation criteria for real-world data science deliverables, including:
  • Data analyses
  • Predictive and statistical models
  • Dashboards and visualizations
  • Experiment results
  • Executive recommendations and business insights
• Evaluate AI-generated and human-produced work using objective scoring frameworks.
• Provide detailed written justifications for each evaluation, ensuring consistency and technical accuracy.
• Apply sound analytical judgment to produce reproducible and defensible assessments.
• Incorporate structured reviewer feedback and continuously refine evaluation methodologies.
• Collaborate with cross-functional teams to improve AI training quality and evaluation standards.

Required Qualifications

• 5+ years of professional experience in Data Science within an industry environment.
• Strong background in business operations, product analytics, growth analytics, or similar data science functions at technology-driven organizations.
• Deep expertise in:
  • Experimental design and A/B testing
  • Statistical analysis
  • SQL and Python
  • Metric development and performance measurement
  • Translating analytical findings into business recommendations
• Excellent written communication skills with the ability to clearly explain technical reasoning.
• Exceptional attention to detail and the ability to evaluate work consistently against structured rubrics.
• Comfortable receiving feedback and calibrating evaluation standards with peer reviewers.

Preferred Qualifications

• Experience contributing to AI evaluation, model training, human feedback, or data annotation initiatives.
• Familiarity with large language models (LLMs), AI-assisted analytics, or machine learning workflows.
• Experience reviewing technical work or mentoring analytical teams is a plus.

Why Join?

• Contribute to the development of next-generation AI systems used for real-world analytical reasoning.
• Apply your professional data science expertise to high-impact AI evaluation projects.
• Work remotely with flexible scheduling.
• Collaborate with a network of experienced technical professionals helping define the future of AI quality and reasoning.

We welcome applicants from all backgrounds and are committed to providing equal opportunities and reasonable accommodations throughout the recruitment process.

Contract Details

• Independent contractor engagement.
• Fully remote with flexible working hours.
• Project duration may be extended or concluded based on project requirements and performance.
• Weekly payments based on approved work completed.
• Please note that H1-B and STEM OPT sponsorship is not available for this engagement.