Senior AI/ML Engineer (Remote) — Expert Model Auditor

prolificacademicltd; United States; Remote; USD 91,000 - 129,000; Full time

Benefits offered by this job

Hourly pay for tasks

Fully remote with flexible hours

Skills assessment gates entry

Job summary

Prolific Academic Ltd is seeking experienced AI/ML engineers to join a paid expert network that supports training and evaluation of large language models. You will review model outputs, audit code, and provide structured feedback to improve alignment and reasoning quality.

This remote, task-based role offers hourly compensation for completed tasks. The role emphasizes deep technical judgment, with several responsibilities around model explanations, code audits, and evaluation of reasoning

Qualifications

• BS/MS/PhD in CS, AI, Robotics or related quantitative field with ML focus.
• Hands-on experience building, deploying, or fine-tuning ML models in production.
• Knowledge of neural networks (Transformers/CNNs/RNNs) and optimization.
• Experience with RLHF or retrieval-augmented generation workflows.
• Ability to reason about ML proofs and audit model logic.
• Strong attention to detail for identifying hallucinations and biased outputs.

Responsibilities

• Review AI-generated explanations of architectures, losses, and backpropagation for technical accuracy.
• Audit ML code and notebooks, including training loops and preprocessing, for correctness.
• Provide structured human feedback to refine RLHF and improve alignment and safety.
• Evaluate how models reason through chain-of-thought prompts and identify logic breakdowns.
• Run benchmarks across outputs using defined technical criteria.
• Identify hallucinations, data contamination, and flawed mathematical reasoning in content.

Skills

Machine learning

Transformer architectures

RLHF

Prompt engineering

Model evaluation

Education

BS/MS/PhD in CS/AI/Robotics

Tools

PyTorch

TensorFlow

HuggingFace

NumPy

Job description

Prolific Academic Ltd is seeking experienced AI/ML engineers to join a paid expert network that supports training and evaluation of large language models. You will review model outputs, audit code, and provide structured feedback to improve alignment and reasoning quality.

This remote, task-based role offers hourly compensation for completed tasks. The role emphasizes deep technical judgment, with several responsibilities around model explanations, code audits, and evaluation of reasoning