Senior AI/ML Engineer — Train & Evaluate LLMs (Remote)

Prolific Academic Ltd

United States

Remote

USD 66,000 - 110,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Prolific is seeking an AI & Machine Learning Engineer to join our Expert Network to help train and evaluate the next generation of LLMs using deep technical expertise. If you have the necessary experience, we'll send you a quick 10- to 15-minute test to assess your skills and suitability for AI tasks.

If successful, you'll be invited to join Prolific as a participant, where you'll get paid to train and evaluate powerful AI models.

Qualifications

  • Education: BS, MS, or PhD in CS/AI/Robotics or related field with ML focus.
  • Experience building, deploying, or fine-tuning ML models in production.
  • Deep learning mastery: Transformers, CNNs, RNNs, optimization techniques.
  • LLM specialization: Prompt Engineering, RLHF, or RAG workflows.
  • Technical rigor: audit model logic, detect data contamination, prove ML algorithms.
  • Analytical critique: detect hallucinations, bias, or logical errors in AI content.

Responsibilities

  • Evaluate LLM architecture logic with technical accuracy.
  • Audit ML code and notebooks for efficiency and correctness.
  • Refine RLHF frameworks with high-quality human feedback.
  • Analyze model reasoning and identify failure points in prompts.
  • Benchmark model outputs using defined performance metrics.

Skills

Python
ML evaluation
Code auditing

Education

BS/MS/PhD in CS/AI/Robotics or related quantitative field with ML focus

Tools

PyTorch
TensorFlow/Keras
Hugging Face Transformers
NumPy
Pandas
Scikit-learn
Weights & Biases
LangChain
Pinecone
Milvus
Weaviate
AWS SageMaker
Google Vertex AI

Job description

Prolific is seeking an AI & Machine Learning Engineer to join our Expert Network to help train and evaluate the next generation of LLMs using deep technical expertise. If you have the necessary experience, we'll send you a quick 10- to 15-minute test to assess your skills and suitability for AI tasks.

If successful, you'll be invited to join Prolific as a participant, where you'll get paid to train and evaluate powerful AI models.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI/ML Engineer - Training & Evaluation (Remote)
Senior AI/ML Engineer - Training & Evaluation (Remote)

Prolific Academic Ltd • United States

Remote
USD 91,000 - 129,000
Competitive pay
Flexible hours
Work from home
Remote AI/ML Engineer — Train & Evaluate LLMs
Remote AI/ML Engineer — Train & Evaluate LLMs

Prolific • United States

Remote
USD 91,000 - 129,000
Remote AI/ML Engineer — Train & Evaluate LLMs
Remote AI/ML Engineer — Train & Evaluate LLMs

Prolific • United States

Remote
USD 91,000 - 129,000
Competitive pay rates
Flexible hours
Work from home
AI & ML Engineer — Train & Evaluate LLMs (Remote)
AI & ML Engineer — Train & Evaluate LLMs (Remote)

Prolific Academic Ltd • United States

Remote
USD 66,000 - 110,000
Competitive pay rates
Flexible hours
Work from home
LLM Research Engineer — Train & Evaluate Models (Remote)
LLM Research Engineer — Train & Evaluate Models (Remote)

Prolific Academic Ltd • United States

Remote
USD 55,000 - 110,000
Competitive pay rates
Flexible hours
Work from home
Remote AI & ML Engineer for LLM Training & Evaluation
Remote AI & ML Engineer for LLM Training & Evaluation

Prolific • United States

Remote
USD 66,000 - 110,000
LLM AI Engineer — Training & Evaluation (Remote)
LLM AI Engineer — Training & Evaluation (Remote)

Prolific Academic Ltd • United States

Remote
USD 83,000 - 110,000
Remote AI/ML Engineer for LLM Training & Evaluation
Remote AI/ML Engineer for LLM Training & Evaluation

Prolific • United States

Remote
USD 138,000 - 207,000
Senior AI Engineer - Remote, High-Impact ML & LLM Expert
Senior AI Engineer - Remote, High-Impact ML & LLM Expert

Prolific Academic Ltd • United States

Remote
USD 66,000 - 110,000
Senior AI Engineer - Remote ML Training & Evaluation
Senior AI Engineer - Remote ML Training & Evaluation

Prolific • United States

Remote
USD 91,000 - 129,000
Competitive pay rates
Flexible hours
Work from home