Remote AI Engineer - Drive LLM Training & Evaluation

Prolific Academic Ltd; United States; Remote; USD 66,000 - 110,000; Full time

Benefits offered by this job

Competitive pay

Flexible hours

Work from home

Job summary

Prolific is seeking AI & Machine Learning Engineers to join its Expert Network to train and evaluate next-gen LLMs using deep technical expertise. You will complete a test, then join Prolific as a paid participant, contributing to AI tasks and model evaluation from home.

Role emphasizes research rigor, prompt engineering, RLHF/RAG workflows, and production-grade ML experience with PyTorch or TensorFlow. Competitive pay and flexible hours are offered.

Qualifications

• Education: a BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with a focus on Machine Learning.
• Professional Experience: experience building, deploying, or fine-tuning ML models in a production environment.
• Deep Learning Mastery: neural networks architectures and optimization techniques at a professional level.
• LLM Specialization: Prompt Engineering, RLHF, or RAG workflows.
• Technical Rigor: audit complex model logic and data contamination; evaluate proofs behind ML algorithms.
• Analytical Critique: detect hallucinations, biases, or logical failures in AI content.

Responsibilities

• Evaluate LLM Architecture Logic: review explanations of architectures, losses, and backpropagation.
• Audit Code & Notebooks: validate training loops and preprocessing scripts for correctness.
• Refine RLHF Frameworks: provide high-quality human feedback to align models with intent and safety.
• Analyze Model Reasoning: assess chain-of-thought prompts and identify breakdowns.
• Benchmark Performance: run comparative tests based on technical metrics.

Skills

Educational background

ML model production

Deep learning

LLM workflows

Model evaluation

Scientific critique

Education

BS/MS/PhD in CS/AI/Robotics

Tools

PyTorch

TensorFlow/Keras

Python (NumPy; Pandas; Scikit-learn)

Hugging Face Transformers

Job description

Prolific is seeking AI & Machine Learning Engineers to join its Expert Network to train and evaluate next-gen LLMs using deep technical expertise. You will complete a test, then join Prolific as a paid participant, contributing to AI tasks and model evaluation from home.

Role emphasizes research rigor, prompt engineering, RLHF/RAG workflows, and production-grade ML experience with PyTorch or TensorFlow. Competitive pay and flexible hours are offered.