Senior AI Engineer (Remote) — Train & Evaluate LLMs

Prolific; United States; Remote; USD 66,000 - 110,000; Full time

Benefits offered by this job

Flexible hours

Work from home

Competitive pay

Job summary

Prolific is recruiting AI & Machine Learning Engineers to join its Expert Network, helping train and evaluate next‑gen LLMs. You’ll complete quick skill tests and, if successful, join Prolific as a participant to get paid for AI tasks requiring one hour of work or less.

Researchers pay up to $80 per hour for tasks, with opportunities to work from home and flexible hours. Ideal candidates have ML production experience, deep learning mastery, and hands-on LLM specialization.

Qualifications

• Education: BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with focus on ML.
• Production ML experience: building, deploying, or fine-tuning ML models in production.
• Deep learning mastery: transformers, CNNs, RNNs, and optimization techniques.
• LLM specialization: Prompt Engineering, RLHF, or RAG workflows.
• Technical rigor: audit model logic, data contamination, proofs behind ML algorithms.
• Analytical critique: detect hallucinations, bias, or logical errors in AI outputs.

Responsibilities

• Evaluate LLM architecture logic for technical accuracy.
• Audit code and notebooks for efficiency and correctness.
• Refine RLHF frameworks with high-quality human feedback.
• Analyze model reasoning and CoT prompts to identify breakdowns.
• Benchmark performance across model outputs using technical metrics.

Skills

BS/MS/PhD in CS

Production ML experience

Deep learning mastery

LLM specialization

Technical rigor

Analytical critique

Education

BS/MS/PhD in CS/AI

Tools

PyTorch

TensorFlow/Keras

NumPy/Pandas

Hugging Face Transformers

Weights & Biases

Job description

Prolific is recruiting AI & Machine Learning Engineers to join its Expert Network, helping train and evaluate next‑gen LLMs. You’ll complete quick skill tests and, if successful, join Prolific as a participant to get paid for AI tasks requiring one hour of work or less.

Researchers pay up to $80 per hour for tasks, with opportunities to work from home and flexible hours. Ideal candidates have ML production experience, deep learning mastery, and hands-on LLM specialization.