Remote Data Science & AI Evaluation Architect

Alignerr Corp.; Adelaide; Remote; AUD 83,000 - 152,000; Part time

Job summary

Alignerr is seeking a Data Science Expert to design advanced AI evaluation challenges and author gold-standard solutions using Python and R. You will audit AI-generated code across major libraries like Scikit-Learn, PyTorch, and TensorFlow, ensuring rigor and efficiency.

Ideal candidates are pursuing or holding a Master's or PhD, with strong ML, NLP, and statistical modeling foundations. This remote, hourly contract role offers flexible scheduling and potential ongoing engagement.

Qualifications

• Pursuing or holding a Master's or PhD in Data Science, Statistics, Computer Science, or a heavily quantitative field.
• Strong foundational expertise in core data science domains: supervised and unsupervised learning, deep learning, NLP, big data technologies (Spark, Hadoop), or statistical modeling.
• Able to communicate complex algorithmic and statistical concepts clearly and precisely in writing.
• Meticulous when reviewing code syntax, mathematical notation, and the validity of statistical conclusions.
• Self-directed, reliable, and comfortable working independently on technical tasks.
• No prior AI or annotation experience required.

Responsibilities

• Design Advanced Challenges — Craft complex, domain-spanning data science problems covering hyperparameter optimization, Bayesian inference, cross-validation strategies, dimensionality reduction, and more.
• Author Ground-Truth Solutions — Develop rigorous, step-by-step reference solutions including Python and R scripts, SQL queries, and mathematical derivations that serve as the definitive benchmark for AI evaluation.
• Audit AI-Generated Code — Critically evaluate AI outputs built with Scikit-Learn, PyTorch, TensorFlow, and other major libraries for technical accuracy, efficiency, and best practices.
• Sharpen AI Reasoning — Identify logical flaws in AI-generated analysis — such as data leakage, overfitting, or improper handling of imbalanced datasets — and provide structured, actionable feedback to improve model reasoning.
• Work Independently — Complete task-based assignments asynchronously on a schedule that fits your life.

Skills

Data science expertise

NLP

Machine learning

Statistical modeling

Python

R

SQL

Communication of complex concepts

Independent working

Education

Master's or PhD in Data Science, Statistics, Computer Science

Tools

Scikit-Learn

PyTorch

TensorFlow

Spark

Hadoop

Job description

Alignerr is seeking a Data Science Expert to design advanced AI evaluation challenges and author gold-standard solutions using Python and R. You will audit AI-generated code across major libraries like Scikit-Learn, PyTorch, and TensorFlow, ensuring rigor and efficiency.

Ideal candidates are pursuing or holding a Master's or PhD, with strong ML, NLP, and statistical modeling foundations. This remote, hourly contract role offers flexible scheduling and potential ongoing engagement.