Remote Data Science Expert - AI Benchmark & Audit Lead

Alignerr; Australia; On-site; AUD 83,000 - 165,000; Part time

Job summary

Alignerr is seeking a Data Science Expert – AI Content Specialist for a remote hourly contract (10-40 hours/week). You will design advanced challenges, author ground-truth solutions with Python/R, SQL, and math derivations to benchmark AI responses, and audit AI-generated code for correctness and efficiency.

You bring a Master's or PhD in a quantitative field and strong knowledge of supervised/unsupervised learning, deep learning, NLP, and big data tools like Spark/Hadoop.

Qualifications

• Holds or is pursuing a Master's or PhD in Data Science, Statistics, Computer Science, or a related quantitative field.
• Strong foundational knowledge across supervised/unsupervised learning, deep learning, big data technologies (Spark/Hadoop), or NLP.
• Able to communicate complex algorithmic concepts and statistical results clearly in writing.
• Highly precise - you catch errors in code syntax, mathematical notation, and statistical conclusions.
• Self-motivated and reliable when working independently on task-based assignments.
• No prior AI or annotation experience required.

Responsibilities

• Design Advanced Challenges - Create rigorous data science problems spanning hyperparameter optimization, Bayesian inference, cross-validation strategies, dimensionality reduction, and more.
• Author Ground-Truth Solutions - Develop step-by-step expert solutions including Python/R scripts, SQL queries, and mathematical derivations.
• Audit AI-Generated Code - Evaluate code for correctness, efficiency, and best practices using libraries like Scikit-Learn, PyTorch, and TensorFlow.
• Refine AI Reasoning - Identify flaws in AI logic and provide structured feedback to improve model reasoning.
• Document Failure Modes - Surface how AI models break down on complex topics to guide research teams.

Skills

Data science

Statistics

Deep learning

NLP

Supervised learning

Unsupervised learning

Education

Master's or PhD in Data Science, Statistics or CS

Tools

Spark

Hadoop

PyTorch

TensorFlow

Scikit-Learn

Job description

Alignerr is seeking a Data Science Expert – AI Content Specialist for a remote hourly contract (10-40 hours/week). You will design advanced challenges, author ground-truth solutions with Python/R, SQL, and math derivations to benchmark AI responses, and audit AI-generated code for correctness and efficiency.

You bring a Master's or PhD in a quantitative field and strong knowledge of supervised/unsupervised learning, deep learning, NLP, and big data tools like Spark/Hadoop.