Data Analyst for AI Training and Evaluation

SaidGig; New York (NY); Remote; USD 96,000 - 165,000; Full time

Job summary

SaidGig is seeking analytics and data practitioners for ongoing AI training and evaluation work. This remote, hourly engagement involves applying professional data judgment to help evaluate and improve advanced AI systems.

Projects start as opportunities arise and qualified candidates are contacted for suitable assignments. As part of the talent pool, you will design analysis problems, assess AI-generated analyses, and flag issues such as data leakage or misleading metrics to support

Qualifications

• Professional analytics experience in data science, ML, or related fields.
• Ability to design and interpret analyses that inform decisions.
• Clear written communication and reasoning ability.
• Comfort working through ambiguity and following instructions.

Responsibilities

• Create analysis problems based on deliverables, data, questions, constraints, and reference answers.
• Review AI-written analyses and data pipelines for validity and biases.
• Identify outputs that could mislead decisions due to data issues or metrics.

Skills

Analytics experience

Data engineering

Statistics

Machine learning

Job description

Role Overview

Apply your data judgment to help evaluate and improve advanced AI systems. Your professional standards and subject-matter expertise will inform the reference criteria used to assess AI-generated analysis. This is an ongoing talent-pool listing for analytics and data practitioners interested in AI training and evaluation work, rather than a guarantee of an immediate project. New projects may begin with short notice, and qualified candidates are contacted when a suitable assignment becomes available.

Key Responsibilities

• Create analysis problems based on work you have delivered, including the data, business question, constraints, and a reference answer against which model responses can be evaluated.
• Review AI-written analyses and data pipelines, assessing whether queries answer the requested question, joins create unintended fan-out, and metrics support the conclusions claimed.
• Identify technically valid outputs that could still mislead decision-makers because of selection effects, data leakage, or metrics that do not reflect the intended outcome.

Qualifications

• Professional experience in analytics, data engineering, statistics, or machine learning.
• Experience delivering analyses that informed real decisions.
• Clear written communication and the ability to explain your reasoning.
• Comfort working through ambiguity and raising unclear instructions.

Work Terms

Remote, hourly engagement.

Eligibility

Complete registration once to be considered across all networks for which you qualify. Completing the domain‑expert interview and joining each network you qualify for can improve the likelihood of being matched.

Compensation

$70 to $120 per hour. Specific project terms are provided in the matching project listing.

Application Process

Complete a short AI interview, approximately 20 minutes. Your background is verified and, if appropriate, you are added to the data analysis talent pool for future project matching.