Data Science & Analysis - AI Training - Austin, US

Prolific; Austin (TX); On-site; USD 60,000 - 90,000; Part time

Benefits offered by this job

Competitive pay rates

Flexible hours

Ability to work from home

Job summary

Prolific is seeking Data Scientists and Data Analysts to join their Expert Network, utilizing your technical expertise to train and evaluate cutting-edge AI models. This role offers competitive pay rates, up to $80 per hour, for your contributions to AI projects. Candidates must have at least a relevant degree (BS, MS, or PhD) and experience in data analysis or machine learning. Enjoy the flexibility of remote work upon joining, making it an ideal fit for professionals looking to apply their skills in a dynamic environment.

Qualifications

• Bachelor's, Master's, or PhD in Data Science, Statistics, Mathematics, or a related field.
• Real-world experience in data analysis, predictive modeling, or machine learning engineering.
• Ability to solve complex statistical problems and interpret data visualizations independently.
• Strong attention to detail, identifying logical fallacies in statistical reasoning.
• Significant experience using LLMs for data workflows with knowledge of model limitations.
• Ability to communicate complex mathematical concepts clearly.
• PayPal account to receive payment.

Responsibilities

• Review AI-generated data insights for accuracy and completeness.
• Use references to validate mathematical proofs and statistical conclusions.
• Execute data scripts to ensure correct results.
• Identify strengths and weaknesses in model reasoning and predictions.
• Verify model responses against system guidelines.

Job description

About Prolific Prolific is not just another player in the AI space – we are building the biggest pool of quality human data in the world. Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.

Role Overview

We’re looking for Data Scientists and Data Analysts to join our Expert Network to help train and evaluate cutting‑edge AI models using real technical expertise. If you have the necessary experience, we’ll send you a quick 10‑ to 15‑minute test to assess your skills and suitability for AI tasks. Successful candidates will be invited to join Prolific as a participant, getting paid to train and evaluate powerful AI models. Researchers pay up to $80 per hour for your skills. You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter.

Qualifications

• Education: a BS, MS, or PhD in Data Science, Statistics, Mathematics, or a closely related quantitative field.
• Professional Experience: real‑world experience in data analysis, predictive modeling, or machine learning engineering.
• Technical Rigor: the ability to solve complex statistical problems and interpret high‑level data visualizations independently.
• Analytical Mindset: strong attention to detail with the ability to identify subtle logical fallacies in statistical reasoning or data interpretations.
• LLM Fluency: significant experience using LLMs to assist with data workflows, with a clear understanding of where these models typically hallucinate or fail.
• Communication: the ability to explain complex mathematical concepts or data insights clearly and concisely.
• PayPal account to receive payment from our clients.

Responsibilities

• Evaluate LLM Responses: review AI‑generated data insights and statistical analysis for accuracy, clarity, and completeness.
• Fact‑Check Technical Claims: use authoritative references to validate mathematical proofs, statistical formulas, and data‑driven conclusions.
• Validate Code & Outputs: execute data‑related scripts (e.g., Python/R) to ensure they produce correct results and handle edge cases properly.
• Annotate Model Performance: identify strengths and weaknesses in how a model reasons through data problems or builds predictive models.
• Ensure Alignment: verify that model responses follow specific system guidelines and maintain a high standard of professional technical behaviour.

Key Technologies

• Programming: proficiency in Python (Pandas, NumPy, Scikit‑learn) or R.
• Data Querying: advanced SQL for complex data extraction and manipulation.
• Visualization: experience with tools like Tableau, PowerBI, or Matplotlib/Seaborn.
• Modeling: deep understanding of Machine Learning frameworks (PyTorch, TensorFlow) and statistical modeling techniques.

Benefits

Once you pass our assessment, you can join Prolific in just 15 minutes and start enjoying competitive pay rates, flexible hours, and the ability to work from home.