Role Overview
Apply your data science and statistical analysis expertise to create high-quality benchmark tasks that help train and evaluate advanced AI systems. This remote contract role centers on interpreting complex visualizations, designing rigorous quantitative questions, and documenting objectively verifiable solutions.
Key Responsibilities
- Interpret Sankey diagrams, heatmaps, calibration curves, residual plots, correlation matrices, distribution plots, and other complex statistical visualizations using precise professional terminology.
- Create clear, objective, multi-step analytical tasks and questions that require quantitative reasoning beyond surface-level chart reading.
- Provide accurate, unambiguous answers with detailed written explanations, including calculations, statistical inferences, and modeling logic when needed.
- Use exact terminology for units, scales, axes, legends, annotations, and other chart elements.
- Develop tasks involving graphical reasoning, trend analysis, comparison, interpolation, and statistical inference while avoiding subjective or ambiguous prompts.
- Produce objectively verifiable tasks and solutions that support rigorous AI training and evaluation.
- Collaborate remotely through written and verbal channels, incorporate feedback, and maintain consistent communication with project stakeholders.
Qualifications
- Bachelor''s degree or equivalent professional experience in Data Science, Statistics, Applied Mathematics, Computer Science, Operations Research, or a related quantitative field.
- At least two years of professional, academic, or research experience with statistical models, data visualizations, or analytical reporting.
- Strong chart-interpretation accuracy, multi-step quantitative reasoning, and ability to design unambiguous analytical tasks.
- Advanced ability to interpret axes, legends, units, scales, confidence intervals, and statistical annotations across varied chart types.
- Excellent written and verbal English communication, including the ability to explain analytical processes and quantitative reasoning clearly.
- Bilingual English proficiency and a second language relevant to your domain are preferred.
- Experience with technical documentation, publications, assessment design, structured analytical task development, data annotation, benchmark questions, technical reports, or related data science, statistics, or AI-focused materials is preferred.
Work Terms
Remote contract engagement.
No prior AI experience is required, domain expertise is the primary requirement.
Compensation
$25 to $50 per hour.