Data Science & Analysis - AI Training - Portland, US

Prolific; Portland (OR); On-site; USD 82,656 - 110,208; Part time

Benefits offered by this job

Competitive pay rates

Flexible hours

Work from home

Job summary

Prolific is looking for Data Scientists and Data Analysts to join our Expert Network in Portland, OR. The role involves evaluating AI-generated data insights, fact-checking technical claims, and ensuring alignment with system guidelines. Candidates should have a BS, MS, or PhD in a related quantitative field and experience in data analysis and machine learning. Enjoy competitive pay rates of up to $80 per hour, flexible hours, and the ability to work from home after passing our assessment.

Qualifications

• Must have real-world experience in data analysis, predictive modeling, or machine learning engineering.
• Strong attention to detail with an analytical mindset is essential.
• Ability to explain complex mathematical concepts clearly.

Responsibilities

• Evaluate AI-generated data insights for accuracy and clarity.
• Fact-check technical claims using authoritative references.
• Validate code outputs and ensure correct results.
• Annotate model performance and identify strengths and weaknesses.
• Ensure model responses adhere to system guidelines.

Skills

Data analysis

Predictive modeling

Machine learning engineering

Statistical problem-solving

LLM fluency

Communication

Education

BS, MS, or PhD in Data Science, Statistics, Mathematics, or related field

Tools

Python (Pandas, NumPy, Scikit-learn)

R

SQL

Tableau

PowerBI

PyTorch

TensorFlow

Job description

About Prolific Prolific is not just another player in the AI space – we are building the biggest pool of quality human data in the world. Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.

Role Overview

We’re looking for Data Scientists and Data Analysts to join our Expert Network to help train and evaluate cutting‑edge AI models using real technical expertise. If you have the necessary experience, we’ll send you a quick 10‑ to 15‑minute test to assess your skills and suitability for AI tasks. Successful candidates will be invited to join Prolific as a participant, getting paid to train and evaluate powerful AI models. Researchers pay up to $80 per hour for your skills. You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter.

Qualifications

• Education: a BS, MS, or PhD in Data Science, Statistics, Mathematics, or a closely related quantitative field.
• Professional Experience: real‑world experience in data analysis, predictive modeling, or machine learning engineering.
• Technical Rigor: the ability to solve complex statistical problems and interpret high‑level data visualizations independently.
• Analytical Mindset: strong attention to detail with the ability to identify subtle logical fallacies in statistical reasoning or data interpretations.
• LLM Fluency: significant experience using LLMs to assist with data workflows, with a clear understanding of where these models typically hallucinate or fail.
• Communication: the ability to explain complex mathematical concepts or data insights clearly and concisely.
• PayPal account to receive payment from our clients.

Responsibilities

• Evaluate LLM Responses: review AI‑generated data insights and statistical analysis for accuracy, clarity, and completeness.
• Fact‑Check Technical Claims: use authoritative references to validate mathematical proofs, statistical formulas, and data‑driven conclusions.
• Validate Code & Outputs: execute data‑related scripts (e.g., Python/R) to ensure they produce correct results and handle edge cases properly.
• Annotate Model Performance: identify strengths and weaknesses in how a model reasons through data problems or builds predictive models.
• Ensure Alignment: verify that model responses follow specific system guidelines and maintain a high standard of professional technical behaviour.

Key Technologies

• Programming: proficiency in Python (Pandas, NumPy, Scikit‑learn) or R.
• Data Querying: advanced SQL for complex data extraction and manipulation.
• Visualization: experience with tools like Tableau, PowerBI, or Matplotlib/Seaborn.
• Modeling: deep understanding of Machine Learning frameworks (PyTorch, TensorFlow) and statistical modeling techniques.

Benefits

Once you pass our assessment, you can join Prolific in just 15 minutes and start enjoying competitive pay rates, flexible hours, and the ability to work from home.