Remote AI/ML Engineer — Expert Model Auditor

prolificacademicltd; United States; Remote; USD 91,000 - 129,000; Full time

Benefits offered by this job

Hourly compensation up to $80

Fully remote with flexible hours

Skills assessment gates entry

Job summary

Prolific Academic Ltd. seeks experienced AI/ML engineers to join a paid expert network that supports training and evaluation of large language models. You will audit code, review model explanations, and provide structured feedback to improve alignment and reasoning quality.

This remote role offers hourly compensation for completed tasks. Responsibilities include examining training loops, preprocessing scripts, and evaluation routines, plus assessing model reasoning and identifying failures in

Qualifications

• Experience building or fine-tuning ML models in production.
• Experience with Transformers and ML optimization.
• Ability to audit ML code and reason about proofs behind ML algorithms.
• Strong attention to detail to spot hallucinations and biased outputs.

Responsibilities

• Review AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
• Audit ML code and notebooks, including training loops, preprocessing scripts, and evaluation routines, for correctness and efficiency.
• Supply structured human feedback used to refine RLHF processes and improve model alignment, safety, and helpfulness.
• Critically evaluate how a model reasons through chain-of-thought prompts and pinpoint where the logic breaks down.
• Run comparative benchmarks across model outputs against defined technical taxonomies and performance criteria.
• Identify hallucinations, bias, training-data contamination, and flawed mathematical reasoning in AI-generated technical content.

Skills

Transformers

RLHF

Prompt engineering

Model evaluation

ML debugging

Education

BS/MS/PhD in CS/AI/Robotics

Tools

PyTorch

TensorFlow/Keras

NumPy

Pandas

Hugging Face Transformers

LangChain

Job description

Prolific Academic Ltd. seeks experienced AI/ML engineers to join a paid expert network that supports training and evaluation of large language models. You will audit code, review model explanations, and provide structured feedback to improve alignment and reasoning quality.

This remote role offers hourly compensation for completed tasks. Responsibilities include examining training loops, preprocessing scripts, and evaluation routines, plus assessing model reasoning and identifying failures in