Remote AI/ML Engineer for LLM Training & Evaluation

Prolific Academic Ltd; United States; Remote; USD 66,000 - 110,000; Full time

Job summary

Prolific Academic Ltd seeks AI & Machine Learning Engineers to join its Expert Network and help train and evaluate the next generation of LLMs with deep technical expertise. A brief skills test will determine eligibility, and successful candidates will be invited to join Prolific as participants, earning pay to work on AI tasks from home.

Researchers in this network typically command up to $80 per hour, with flexible hours and remote work arrangements across the United States.

Qualifications

• A BS/MS/PhD in CS/AI/Robotics or related quantitative field with ML focus.
• Experience building, deploying, or fine-tuning ML models in production.
• Deep learning mastery of neural networks (Transformers/CNNs/RNNs) and optimization techniques.
• Hands-on experience with Prompt Engineering, RLHF, or RAG workflows.
• Ability to audit complex model logic, data contamination, and proofs behind ML algorithms.
• Strong analytical critique, attention to hallucinations, bias, or logical failures.

Responsibilities

• Evaluate LLM Architecture Logic: review explanations of architectures, losses, and backpropagation.
• Audit Code & Notebooks: validate training loops, preprocessing scripts, and model evaluations.
• Refine RLHF Frameworks: provide high-quality human feedback to align models with intent and safety.
• Analyze Model Reasoning: assess chain-of-thought prompts and identify reasoning breakdowns.
• Benchmark Performance: run comparative tests across model outputs using technical metrics.

Skills

ML model deployment

Transformer models

RLHF

RAG workflows

Prompt engineering

Model evaluation

Code auditing

Analytical critique

Education

BS/MS/PhD in Computer Science / AI / Robotics or related quantitative field with ML focus

Tools

PyTorch

TensorFlow/Keras

NumPy

Pandas

Scikit-learn

Hugging Face Transformers

AWS SageMaker

Google Vertex AI

Weights & Biases

LangChain

Pinecone / Milvus / Weaviate

Job description

Prolific Academic Ltd seeks AI & Machine Learning Engineers to join its Expert Network and help train and evaluate the next generation of LLMs with deep technical expertise. A brief skills test will determine eligibility, and successful candidates will be invited to join Prolific as participants, earning pay to work on AI tasks from home.

Researchers in this network typically command up to $80 per hour, with flexible hours and remote work arrangements across the United States.