Remote AI & ML Engineer: Train & Evaluate LLMs

Prolific Academic Ltd; United States; Remote; USD 130,000 - 180,000; Full time

Benefits offered by this job

Flexible hours

Work from home

Job summary

Prolific is seeking an AI & Machine Learning Engineer to join our Expert Network, helping train and evaluate next-gen LLMs with deep technical expertise. A quick 10– to 15-minute test may be required to assess suitability for AI tasks. If successful, you’ll join Prolific as a participant and get paid for tasks, often at up to $80 per hour.

Responsibilities include auditing and refining architectures, training loops, and RLHF/RAG workflows. Expect flexible hours and the ability to work from home.

Qualifications

• BS, MS or PhD in CS/AI/Robotics or related quantitative field with ML focus.
• Experience building, deploying, or fine-tuning ML models in production.
• Professional-level understanding of neural architectures (Transformers, CNNs, RNNs) and optimization.
• Hands-on experience with Prompt Engineering, RLHF, or RAG workflows.
• Ability to audit model logic, detect data contamination, and evaluate ML proofs.
• High attention to detail in spotting hallucinations, biases, or failures in AI content.

Responsibilities

• Review AI-generated explanations of architectures, loss functions, and backpropagation for accuracy.
• Validate ML training code, data preprocessing, and model evaluation for efficiency and correctness.
• Provide high-quality human feedback to align models with safety and helpfulness.
• Critically assess model reasoning and identify where CoT prompts break down.
• Conduct comparative testing of model outputs using technical taxonomies and metrics.

Skills

ML model development

Model evaluation

CoT analysis

Hallucination detection

Data model auditing

Prompt engineering

Education

BS/MS/PhD in CS/AI/Robotics or related field

Tools

PyTorch

TensorFlow/Keras

Python

Hugging Face Transformers

AWS SageMaker

Vertex AI

Weights & Biases

LangChain

Pinecone

Milvus

Weaviate

Job description

Prolific is seeking an AI & Machine Learning Engineer to join our Expert Network, helping train and evaluate next-gen LLMs with deep technical expertise. A quick 10– to 15-minute test may be required to assess suitability for AI tasks. If successful, you’ll join Prolific as a participant and get paid for tasks, often at up to $80 per hour.

Responsibilities include auditing and refining architectures, training loops, and RLHF/RAG workflows. Expect flexible hours and the ability to work from home.