Remote AI & ML Engineer: Training & Evaluation

Prolific

United States

Remote

USD 91,000 - 129,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Prolific is seeking AI & ML Engineers to join its Expert Network to help train and evaluate state-of-the-art AI models. You will undergo a quick skill test and, if successful, join Prolific as a participant paid to train and evaluate powerful AI systems.

Responsibilities include evaluating architectures, auditing ML code, and refining RLHF frameworks while ensuring high-quality, unbiased outputs. This role emphasizes rigorous analysis, data integrity, and collaboration with researchers worldwide.

Qualifications

  • Education: a BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with a focus on Machine Learning.
  • Experience: building, deploying, or fine-tuning ML models in production environments.
  • Deep Learning Mastery: neural network architectures (Transformers, CNNs, RNNs) and optimization techniques.
  • LLM Specialization: hands-on experience with Prompt Engineering, RLHF, or RAG workflows.
  • Technical Rigor: auditing model logic, data contamination checks, and understanding proofs behind ML algorithms.

Responsibilities

  • Evaluate LLM architecture logic for technical accuracy.
  • Audit code and notebooks for efficiency and correctness.
  • Refine RLHF frameworks to align models with human intent and safety.
  • Analyze model reasoning and CoT prompts to identify breakdowns.
  • Benchmark performance across model outputs using technical metrics.

Skills

ML model deployment
Transformer models
RLHF/RAG workflows
Prompt engineering
Model evaluation & debugging

Education

BS/MS/PhD in CS/AI/Robotics with ML focus

Tools

PyTorch
TensorFlow
Hugging Face Transformers
LangChain
Vector stores (Pinecone/Milvus/Weaviate)

Job description

Prolific is seeking AI & ML Engineers to join its Expert Network to help train and evaluate state-of-the-art AI models. You will undergo a quick skill test and, if successful, join Prolific as a participant paid to train and evaluate powerful AI systems.

Responsibilities include evaluating architectures, auditing ML code, and refining RLHF frameworks while ensuring high-quality, unbiased outputs. This role emphasizes rigorous analysis, data integrity, and collaboration with researchers worldwide.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI & ML Engineer for LLM Training & Evaluation
Remote AI & ML Engineer for LLM Training & Evaluation

Prolific • United States

Remote
USD 66,000 - 110,000
Remote AI/ML Engineer — Train & Evaluate LLMs
Remote AI/ML Engineer — Train & Evaluate LLMs

Prolific • United States

Remote
USD 91,000 - 129,000
Senior AI Engineer - Remote ML Training & Evaluation
Senior AI Engineer - Remote ML Training & Evaluation

Prolific • United States

Remote
USD 91,000 - 129,000
Competitive pay rates
Flexible hours
Work from home
Remote AI/ML Engineer — Train & Evaluate LLMs
Remote AI/ML Engineer — Train & Evaluate LLMs

Prolific • United States

Remote
USD 91,000 - 129,000
Competitive pay rates
Flexible hours
Work from home
Remote AI/ML Engineer for LLM Training & Evaluation
Remote AI/ML Engineer for LLM Training & Evaluation

Prolific • United States

Remote
USD 138,000 - 207,000
Remote AI Training Engineer - Senior ML & LLM Evaluator
Remote AI Training Engineer - Senior ML & LLM Evaluator

Prolific • United States

Remote
USD 91,000 - 129,000
Remote AI Training Engineer — LLM & RLHF Expert
Remote AI Training Engineer — LLM & RLHF Expert

Prolific • United States

Remote
USD 66,000 - 110,000
LLM AI Engineer — Training & Evaluation (Remote)
LLM AI Engineer — Training & Evaluation (Remote)

Prolific Academic Ltd • United States

Remote
USD 83,000 - 110,000
Remote CS Specialist for AI Training & Evaluation
Remote CS Specialist for AI Training & Evaluation

Prolific • United States

Remote
USD 68,000 - 97,000
Competitive pay
Flexible hours
Work from home
Remote AI Training Engineer (LLM Evaluation & RLHF)
Remote AI Training Engineer (LLM Evaluation & RLHF)

Prolific • United States

Remote
USD 91,000 - 129,000