LLM AI Engineer — Training & Evaluation (Remote)

Prolific Academic Ltd; United States; Remote; USD 83,000 - 110,000; Full time

Job summary

Prolific is seeking AI & ML engineers to join our Expert Network to help train and evaluate next‑gen LLMs. You’ll complete paid micro-tasks and may be invited to join Prolific as a participant, with pay up to $80/hour and flexible, work-from-home hours.

Required is a strong ML background (BS/MS/PhD in CS/AI or related field), production experience with ML models, and hands-on expertise in transformers, RLHF, or RAG workflows. Remote work is supported globally.

Qualifications

• BS/MS/PhD in CS/AI/Robotics with ML focus.
• Experience deploying or fine-tuning ML models in production.
• Expert-level understanding of Transformers, CNNs, RNNs.
• Hands-on experience with RLHF or RAG workflows.
• Ability to audit model logic and data contamination.
• Strong attention to detail to identify hallucinations or biases.

Responsibilities

• Evaluate LLM architecture logic.
• Audit code & notebooks.
• Refine RLHF frameworks.
• Analyze model reasoning.
• Benchmark performance.

Skills

ML model development

Deep learning architectures

Prompt engineering

RLHF workflows

RAG integration

Model auditing

Analytical critique

Python programming

Education

ML-focused degree (BS/MS/PhD)

Tools

PyTorch

TensorFlow/Keras

Python

Hugging Face Transformers

SageMaker

Vertex AI

Weights & Biases

LangChain

Pinecone

Milvus

Weaviate

Job description

Prolific is seeking AI & ML engineers to join our Expert Network to help train and evaluate next‑gen LLMs. You’ll complete paid micro-tasks and may be invited to join Prolific as a participant, with pay up to $80/hour and flexible, work-from-home hours.

Required is a strong ML background (BS/MS/PhD in CS/AI or related field), production experience with ML models, and hands-on expertise in transformers, RLHF, or RAG workflows. Remote work is supported globally.