Remote AI Trainer & Evaluator for LLMs (RLHF)

prolificacademicltd; United States; Remote; USD 91,000 - 129,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Up to $80/hour

Job summary

prolificacademicltd is seeking experienced AI/ML engineers to join a paid expert network that supports training and evaluation of large language models. You will audit outputs, review model reasoning, and provide structured feedback to improve alignment and safety.

This remote, task-based role offers hourly compensation for completed work. Candidates should have advanced degrees in CS/AI or related fields and hands-on production ML experience.

Qualifications

• BS, MS or PhD in Computer Science, AI, Robotics or related quantitative field with ML focus.
• Hands-on experience building, deploying or fine-tuning ML models in production.
• Knowledge of neural network architectures (Transformers/CNNs/RNNs) and related optimization techniques.
• Experience with prompt engineering, RLHF or RAG workflows.
• Ability to reason about ML math proofs and audit complex model logic.
• Strong attention to detail in spotting hallucinations, bias or faulty reasoning.

Responsibilities

• Review explanations of model architectures, losses and backpropagation for technical accuracy.
• Audit ML code and notebooks for correctness and efficiency.
• Supply structured human feedback to refine RLHF and model alignment.
• Evaluate how a model reasons through chain-of-thought prompts and identify logic breakdowns.
• Run benchmarks comparing model outputs against defined technical taxonomies and performance criteria.
• Identify hallucinations, bias, data contamination, and flawed mathematical reasoning in AI content.

Skills

ML model production

Neural network architectures

Prompt engineering RLHF RAG

Proof-based reasoning

Detail-oriented auditing

Education

BS/MS/PhD in CS/AI/Robotics

Tools

PyTorch

TensorFlow/Keras

NumPy

Pandas

Hugging Face Transformers

LangChain

Weights & Biases

Pinecone

Job description

prolificacademicltd is seeking experienced AI/ML engineers to join a paid expert network that supports training and evaluation of large language models. You will audit outputs, review model reasoning, and provide structured feedback to improve alignment and safety.

This remote, task-based role offers hourly compensation for completed work. Candidates should have advanced degrees in CS/AI or related fields and hands-on production ML experience.