Remote ML Engineer - AI Model Evaluation & Quality

Alignerr Corp.; Sydney; Remote; AUD 83,000 - 152,000; Full time

Job summary

Alignerr is seeking experienced ML engineers in Sydney and across Australia to evaluate AI-generated machine learning solutions — catching errors, improving quality, and helping frontier AI models get genuinely better at one of the hardest things they do.

This is a fully remote, flexible contract role. Work asynchronously on your own schedule, from wherever you are in Australia. No fixed hours, no meetings — just high-impact, expert work that matters.

Qualifications

• 3–5+ years working on machine learning projects, pipelines, or MLOps.
• Experience with model evaluation, cloud deployment, or production ML systems.
• Bachelor's, Master's, or PhD in CS, ML, or a related field.
• Background in data labeling, RLHF, or other AI training workflows.
• Prior experience with code review or technical writing.

Responsibilities

• Review and evaluate AI-generated machine learning code — including Python, TensorFlow, PyTorch, and scikit-learn — for correctness, efficiency, scalability, and clarity
• Write high-quality ML solutions to modeling, data processing, and deployment problems across a range of difficulty levels
• Craft clear, developer-friendly explanations for model architecture decisions, code logic, and problem-solving approaches
• Identify edge cases, ambiguities, and weaknesses in problem statements, datasets, or AI-generated responses
• Help set the quality bar for how AI understands and produces machine learning code

Skills

Model development

Data preprocessing

Training pipelines

Deployment

Education

Bachelor's/Master's/PhD in CS/ML

Tools

TensorFlow

PyTorch

scikit-learn

Job description

Alignerr is seeking experienced ML engineers in Sydney and across Australia to evaluate AI-generated machine learning solutions — catching errors, improving quality, and helping frontier AI models get genuinely better at one of the hardest things they do.

This is a fully remote, flexible contract role. Work asynchronously on your own schedule, from wherever you are in Australia. No fixed hours, no meetings — just high-impact, expert work that matters.