Senior AI/ML Engineer - Remote | LLM Training & Evaluation

Prolific Academic Ltd; United States; Remote; USD 66,000 - 110,000; Full time

Job summary

Prolific is seeking AI/ML engineers to join our Expert Network to train and evaluate the next generation of LLMs. After a brief 10–15 minute test, successful applicants may join Prolific as participants to perform paid tasks.

Researchers pay up to $80 per hour for tasks that may take an hour, with many shorter tasks possible. Join our Expert Network to influence the future of AI, with flexible hours and the option to work from home.

Qualifications

• BS/MS/PhD in a quantitative field with ML focus (CS/AI/Robotics).
• Experience building, deploying, or fine-tuning ML models in production.
• Deep learning mastery: Transformers/CNNs/RNNs and optimization techniques.
• Hands-on Prompt Engineering, RLHF, or RAG workflows.
• Ability to audit model logic and identify data contamination; evaluate proofs.

Responsibilities

• Evaluate LLM architecture logic for technical accuracy.
• Audit ML code and notebooks for efficiency and correctness.
• Refine RLHF frameworks with high-quality human feedback.
• Analyze model reasoning and identify breakdowns in chain-of-thought.
• Benchmark performance across model outputs using taxonomy and metrics.

Skills

PhD in ML

Production ML

Transformers

RLHF/RAG

Code audit

Prompt engineering

Education

BS/MS/PhD in CS/AI/Robotics

Tools

PyTorch

TensorFlow/Keras

NumPy

Pandas

Hugging Face Transformers

Weights & Biases

Job description

Prolific is seeking AI/ML engineers to join our Expert Network to train and evaluate the next generation of LLMs. After a brief 10–15 minute test, successful applicants may join Prolific as participants to perform paid tasks.

Researchers pay up to $80 per hour for tasks that may take an hour, with many shorter tasks possible. Join our Expert Network to influence the future of AI, with flexible hours and the option to work from home.