Remote Data Science Expert & AI Task Evaluator

Sovrano AI; United States; Remote; USD 55,000 - 172,000; Full time

Job summary

Sovrano AI is looking for data scientists for fully remote, project-based work to test frontier AI with real data science tasks including analysis, experiments, modeling and SQL. You create tasks from your own experience, run them through frontier models, and judge results as a peer reviewer, setting your own schedule.

Compensation is $40–$125 USD per hour (min 10 hours/week), paid via PayPal; independent contractor arrangement with no AI-assisted work unless allowed.

Qualifications

• Based in the United States, United Kingdom, Ireland, Canada, or Australia.
• Bachelor's degree or higher in a quantitative field.
• 2+ years of applied data science experience preferred.
• Available at least 10 hours per week.
• PayPal account for payment.
• Willing to work without LLM assistance where the project does not permit it.
• Use one email address to sign up, take the assessment, and get paid.

Responsibilities

• Build realistic tasks from your own data science work.
• Run tasks through frontier AI models and judge results against the standard of your profession.
• Weigh paired model answers against each other and explain which one holds up.
• Write grading rubrics for your tasks and set out your reasoning in writing.
• Review and improve tasks written by other experts.

Skills

Python

SQL

Statistics

Experimentation

Machine learning

Rubric writing

Education

Bachelor's degree or higher in a quantitative field

Job description

Sovrano AI is looking for data scientists for fully remote, project-based work to test frontier AI with real data science tasks including analysis, experiments, modeling and SQL. You create tasks from your own experience, run them through frontier models, and judge results as a peer reviewer, setting your own schedule.

Compensation is $40–$125 USD per hour (min 10 hours/week), paid via PayPal; independent contractor arrangement with no AI-assisted work unless allowed.