Data Science Expert, AI Trainer

Sovrano AI; United States; Remote; USD 55,000 - 172,000; Full time

Job summary

Sovrano AI is looking for data scientists for fully remote, project-based work to test frontier AI with real data science tasks including analysis, experiments, modeling and SQL. You create tasks from your own experience, run them through frontier models, and judge results as a peer reviewer, setting your own schedule.

Compensation is $40–$125 USD per hour (min 10 hours/week), paid via PayPal; independent contractor arrangement with no AI-assisted work unless allowed.

Qualifications

• Based in the United States, United Kingdom, Ireland, Canada, or Australia.
• Bachelor's degree or higher in a quantitative field.
• 2+ years of applied data science experience preferred.
• Available at least 10 hours per week.
• PayPal account for payment.
• Willing to work without LLM assistance where the project does not permit it.
• Use one email address to sign up, take the assessment, and get paid.

Responsibilities

• Build realistic tasks from your own data science work.
• Run tasks through frontier AI models and judge results against the standard of your profession.
• Weigh paired model answers against each other and explain which one holds up.
• Write grading rubrics for your tasks and set out your reasoning in writing.
• Review and improve tasks written by other experts.

Skills

Python

SQL

Statistics

Experimentation

Machine learning

Rubric writing

Education

Bachelor's degree or higher in a quantitative field

Job description

Fully remote, project-based work checking how well frontier AI does real data science: analysis, experiments, modeling, and SQL. You write tasks based on your own experience and grade where the model gets it wrong. $40 to $125 USD an hour, at least 10 hours a week, as an independent contractor. For data scientists in the US, UK, Ireland, Canada, or Australia.

About the role

AI models write plausible analysis code quickly, and the conclusions are not always right. This role puts your experience to work finding out where. You turn problems from your own work into realistic tasks, run them through frontier models, and judge the answers the way you would review a colleague's analysis. You set your own schedule, and the work rewards careful writing as much as expertise.

What you'll do

• Build realistic tasks out of problems from your own data science work, along with the material needed to solve them
• Give those tasks to frontier AI models and judge the results against the standard of your profession
• Weigh paired model answers against each other and explain which one holds up
• Write grading rubrics for your tasks and set out your reasoning in writing
• Review and improve tasks written by other experts

Requirements

• Based in the United States, United Kingdom, Ireland, Canada, or Australia
• Bachelor's degree or higher in a quantitative field, completed or in progress
• 2+ years of applied data science experience preferred
• Available at least 10 hours per week
• PayPal account for payment
• Willing to work without LLM assistance where the project does not permit it
• Use one email address to sign up, take the assessment, and get paid

Ideal qualifications

• 2+ years of applied data science or analytics work preferred
• Fluent in Python and/or SQL
• Degree in a quantitative field, completed or in progress
• Full professional or native-level written English
• Based in the United States, United Kingdom, Ireland, Canada, or Australia

Nice to have

• A graduate degree in a quantitative field (welcome, not required)
• Have used Claude or ChatGPT in your professional work

What success looks like

• You clear the skills assessment on your own work, with no AI assistance
• Your task proposals come from real problems in your own practice, and a frontier model genuinely fails them
• Your rubrics are specific enough that another expert would grade the same response the same way
• You act on reviewer feedback without needing to be walked through it
• You keep at least 10 hours a week going, week after week

Pay and contract

$40 to $125 USD an hour. The rate varies with your expertise, education, and experience. Minimum 10 hours a week with no weekly maximum; full-time hours are available.

Independent contractor, fully remote. Payment runs through PayPal, so you need a PayPal account. As an independent contractor, you handle your own taxes.

Getting on: a skills assessment that takes most people four to six hours. You are paid $240 for it if you pass, and you get one attempt, so take your time and do your best work. Work produced with AI tools is rejected.

After you pass: onboarding and a short training project, then you propose a task from your own practice, build it, and run it against frontier models. Each stage is reviewed before you move on, and you are paid for the work you complete.

Skills

Python, SQL, Statistics, Experimentation, Machine learning, Rubric writing