Remote AI Engineer — Model QA & RLHF Reviewer

prolificacademicltd; United States; Remote; USD 55,000 - 110,000; Full time

Benefits offered by this job

Remote work from home

Flexible hours

Competitive pay up to $80/hr

Job summary

Prolific Academic Ltd is seeking experienced AI/ML engineers to join our expert network for remote, paid engagements that review, audit, and refine AI outputs. Work is flexible and performed from home, with tasks that focus on training and evaluation of next‑generation language models.

You'll review explanations of architectures and loss functions, audit code and notebooks, provide feedback for RLHF workflows, and benchmark model outputs against technical metrics.

Qualifications

• BS, MS or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with a machine learning focus.
• Hands-on experience building, deploying, or fine-tuning ML models in production environments.
• Professional-level understanding of neural network architectures such as Transformers, CNNs, and RNNs, plus modern optimization techniques.
• Practical experience with prompt engineering, RLHF, or retrieval-augmented generation (RAG) workflows.
• Strong analytical rigor with the ability to audit complex model logic, detect training data contamination, and evaluate mathematical proofs.
• Attention to detail in identifying hallucinations, biased outputs, and logical failures in AI-generated technical content.

Responsibilities

• Review AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
• Audit machine learning code and notebooks, including training loops, data preprocessing scripts, and evaluation pipelines.
• Provide high-quality human feedback used in RLHF workflows to align model behavior with human intent.
• Critically evaluate chain-of-thought reasoning, identifying where AI model logic breaks down or produces flawed outputs.
• Conduct comparative benchmarking of model outputs against defined technical taxonomies and performance metrics.

Skills

ML model deployment

NN architectures

Prompt engineering

Model auditing

Data integrity analysis

Education

BS/MS/PhD in CS/AI/Robotics or related quantitative field

Tools

PyTorch

TensorFlow/Keras

SageMaker

Vertex AI

Weights & Biases

LangChain

Pinecone

Milvus

Weaviate

Job description

Prolific Academic Ltd is seeking experienced AI/ML engineers to join our expert network for remote, paid engagements that review, audit, and refine AI outputs. Work is flexible and performed from home, with tasks that focus on training and evaluation of next‑generation language models.

You'll review explanations of architectures and loss functions, audit code and notebooks, provide feedback for RLHF workflows, and benchmark model outputs against technical metrics.