Role overview
Contribute data science and analytics expertise to training and evaluating AI models through paid, task-based work. After a short skills assessment, successful applicants may be invited to review technical responses and help improve how models reason about data. Tasks vary in length; some require an uninterrupted hour. The opportunity is listed for Edinburgh, UK.
Responsibilities
- Assess AI-generated analyses for statistical accuracy, clarity, and completeness.
- Check mathematical reasoning, formulas, and data-based conclusions against reliable references.
- Run data scripts in Python or R to check results and edge cases.
- Provide feedback on model reasoning in areas such as statistical analysis and predictive modelling.
- Check that responses follow task guidelines and professional standards.
Requirements
- A bachelor’s, master’s, or doctoral degree in data science, statistics, mathematics, or a closely related quantitative field.
- Practical experience in data analysis, predictive modelling, or machine learning engineering.
- Strong statistical problem-solving skills and the ability to interpret complex visualisations independently.
- Careful reasoning, including the ability to spot subtle errors in statistical arguments or interpretations.
- Substantial experience using large language models in data workflows, with an understanding of their common failure modes.
- Clear written communication of mathematical concepts and data insights, plus a PayPal account for payment.
Nice to have
- Familiarity with Python libraries such as Pandas, NumPy, and scikit-learn, or with R; advanced SQL; and visualisation tools such as Tableau, Power BI, Matplotlib, or Seaborn.
- Knowledge of machine learning frameworks such as PyTorch or TensorFlow and statistical modelling methods.
Benefits and work setup
- Flexible, remote participation is described. Work is paid by task; the source says rates may reach $80 per hour, depending on the work. A 10–15-minute assessment is part of the selection process.