Remote AI Engineer for LLM Training & Evaluation

Prolific; United States; Remote; USD 83,000 - 138,000; Full time

Job summary

Prolific, a leading platform for AI data, is seeking an AI & Machine Learning Engineer to join its Expert Network to train and evaluate next‑gen LLMs. You'll assess model explanations, audit training code, and improve RLHF frameworks while working on high‑impact AI tasks from home in the United States.

The role requires advanced degree and hands‑on ML experience; you’ll interact with researchers and pay up to $80 per hour for paid tasks, with flexible hours and remote work.

Qualifications

• BS, MS, or PhD in Computer Science, AI, Robotics, or related quantitative field with a focus on ML.
• Experience building, deploying, or fine-tuning ML models in production.
• Professional-level understanding of neural network architectures (Transformers, CNNs, RNNs) and optimization.
• Hands‑on experience with Prompt Engineering, RLHF, or RAG workflows.
• Ability to audit complex model logic, identify training data contamination, and evaluate mathematical proofs behind ML algorithms.
• High attention to detail in spotting “hallucinations,” biased outputs, or logical failures in AI‑generated technical content.

Responsibilities

• Evaluate LLM Architecture Logic: review AI‑generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
• Audit Code & Notebooks: validate ML‑specific code (training loops, data preprocessing scripts, or model evaluations) for efficiency and correctness.
• Refine RLHF Frameworks: provide the high‑quality human feedback necessary to align models with human intent, safety, and helpfulness.
• Analyze Model Reasoning: critically assess how an AI model navigates complex chain‑of‑thought (CoT) prompts and identify where the reasoning breaks down.
• Benchmark Performance: conduct comparative testing between different model outputs based on specific technical taxonomies and performance metrics.

Skills

Education

Production ML

Deep Learning

LLM Specialization

Technical Rigor

Analytical Critique

Education

BS/MS/PhD in CS/AI/Robotics or related field with ML focus

Job description

Prolific, a leading platform for AI data, is seeking an AI & Machine Learning Engineer to join its Expert Network to train and evaluate next‑gen LLMs. You'll assess model explanations, audit training code, and improve RLHF frameworks while working on high‑impact AI tasks from home in the United States.

The role requires advanced degree and hands‑on ML experience; you’ll interact with researchers and pay up to $80 per hour for paid tasks, with flexible hours and remote work.