Role overview
Use your data science expertise to assess and improve the quality of AI-generated analysis. You’ll test a language model across statistical, machine learning, and data engineering topics, then explain where its reasoning or conclusions fall short.
Responsibilities
- Work through practical scenarios and conceptual questions in data science with the model.
- Check responses for factual accuracy, sound reasoning, and appropriate methods.
- Record reproducible examples of errors and describe how they occur.
- Offer feedback on prompts and evaluation measures to help improve model performance.
- Explain your reasoning clearly so findings can be understood and reviewed.
Requirements
- Expertise in areas such as machine learning, statistical modeling, data engineering, visualization, natural language processing, time series analysis, deep learning, or algorithm development.
- Ability to assess topics including supervised and unsupervised learning, regression, feature engineering, anomaly detection, and model evaluation.
- Strong written communication and a methodical approach to explaining and documenting conclusions.
- A master’s or doctoral degree in data science, computer science, statistics, or a related discipline is preferred.
Nice to have
- Peer-reviewed research, applied industry experience, cloud platform experience, or open-source contributions.
Benefits and work setup
- Remote contract work, with an advertised rate of $6–$65 per hour; the final rate depends on experience, expertise, and location and may differ from the range.
- You provide a secure computer and high-speed internet. Health insurance and paid time off are not included.