Remote AI/ML Engineer for LLM Training & Evaluation

Prolific Academic Ltd; United States; Remote; USD 66,000 - 110,000; Full time

Job summary

Prolific is seeking AI and Machine Learning Engineers to join our Expert Network to help train and evaluate the next generation of LLMs using deep technical expertise. If successful, you’ll be invited to join Prolific as a participant, where you’ll get paid to train and evaluate powerful AI models.

Researchers pay up to $80 per hour for tasks, with many requiring one hour of uninterrupted work; opportunities are flexible and can be done from home.

Qualifications

• Education: a BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with a focus on Machine Learning.
• Professional Experience: experience building, deploying, or fine-tuning ML models in a production environment.
• Deep Learning Mastery: professional‑level understanding of neural network architectures (Transformers, CNNs, RNNs) and optimization techniques.
• LLM Specialization: hands‑on experience with Prompt Engineering, RLHF, or RAG workflows.
• Technical Rigor: the ability to audit complex model logic, identify training data contamination, and evaluate mathematical proofs behind ML algorithms.
• Analytical Critique: high attention to detail in spotting “hallucinations,” biased outputs, or logical failures in AI-generated technical content.

Responsibilities

• Evaluate LLM Architecture Logic: review AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
• Audit Code & Notebooks: validate ML‑specific code (e.g., training loops, data preprocessing scripts, or model evaluations) for efficiency and correctness.
• Refine RLHF Frameworks: provide the high‑quality human feedback necessary to align models with human intent, safety, and helpfulness.
• Analyze Model Reasoning: critically assess how an AI model navigates complex chain‑of‑thought (CoT) prompts and identify where the reasoning breaks down.
• Benchmark Performance: conduct comparative testing between different model outputs based on specific technical taxonomies and performance metrics.

Skills

Prompt Engineering

RLHF

RAG workflows

Transformer models

Deep Learning

Audit model logic

PyTorch

TensorFlow/Keras

NumPy

Pandas

Scikit-learn

Hugging Face Transformers

AWS SageMaker

Google Cloud Vertex AI

Weights & Biases

LangChain

Pinecone

Milvus

Weaviate

Education

BS/MS/PhD in Computer Science / Artificial Intelligence / Robotics or related quantitative field

Tools

PyTorch

TensorFlow/Keras

Hugging Face Transformers

NumPy

Pandas

Scikit-learn

LangChain

AWS SageMaker

Google Cloud Vertex AI

Weights & Biases

Pinecone

Milvus

Weaviate

Job description

Prolific is seeking AI and Machine Learning Engineers to join our Expert Network to help train and evaluate the next generation of LLMs using deep technical expertise. If successful, you’ll be invited to join Prolific as a participant, where you’ll get paid to train and evaluate powerful AI models.

Researchers pay up to $80 per hour for tasks, with many requiring one hour of uninterrupted work; opportunities are flexible and can be done from home.