AI Training Data Analyst for Model Evaluation

SaidGig; New York (NY); Remote; USD 96,000 - 165,000; Full time

Job summary

SaidGig is seeking analytics and data practitioners for ongoing AI training and evaluation work. This remote, hourly engagement involves applying professional data judgment to help evaluate and improve advanced AI systems.

Projects start as opportunities arise and qualified candidates are contacted for suitable assignments. As part of the talent pool, you will design analysis problems, assess AI-generated analyses, and flag issues such as data leakage or misleading metrics to support

Qualifications

• Professional analytics experience in data science, ML, or related fields.
• Ability to design and interpret analyses that inform decisions.
• Clear written communication and reasoning ability.
• Comfort working through ambiguity and following instructions.

Responsibilities

• Create analysis problems based on deliverables, data, questions, constraints, and reference answers.
• Review AI-written analyses and data pipelines for validity and biases.
• Identify outputs that could mislead decisions due to data issues or metrics.

Skills

Analytics experience

Data engineering

Statistics

Machine learning

Job description

SaidGig is seeking analytics and data practitioners for ongoing AI training and evaluation work. This remote, hourly engagement involves applying professional data judgment to help evaluate and improve advanced AI systems.

Projects start as opportunities arise and qualified candidates are contacted for suitable assignments. As part of the talent pool, you will design analysis problems, assess AI-generated analyses, and flag issues such as data leakage or misleading metrics to support