Senior AI Engineer — Remote LLM Training & Evaluation

Prolific Academic Ltd; United States; Remote; USD 66,000 - 110,000; Full time

Job summary

Prolific is seeking AI & Machine Learning Engineers to join our Expert Network to train and evaluate next-gen LLMs with deep technical expertise. You may complete a short test to assess fit, and, if successful, join as a paid participant for AI tasks.

Pay is competitive, with researchers offering up to $80 per hour for paid tasks requiring focused, hour-long work. Remote-friendly and flexible work hours are highlighted as part of Prolific's platform.

Qualifications

• Education: BS, MS, or PhD in CS/AI/Robotics or related field with ML focus.
• Experience: building, deploying, or fine-tuning ML models in production.
• Deep learning mastery with transformers, CNNs, RNNs.
• LLM specialization: prompt engineering, RLHF, or RAG workflows.
• Technical rigor to audit model logic and data contamination.
• Analytical critique to identify hallucinations and biases.

Responsibilities

• Evaluate LLM architecture logic for technical accuracy.
• Audit ML code and notebooks for efficiency and correctness.
• Refine RLHF frameworks with high-quality human feedback.
• Analyze model reasoning and chain-of-thought prompts.
• Benchmark model outputs using technical taxonomies and metrics.

Skills

Deep Learning

Prompt Engineering

RLHF

Model Auditing

Hallucination detection

Education

BS/MS/PhD in CS/AI/Robotics or related field

Tools

PyTorch

TensorFlow/Keras

Python (NumPy/Pandas)

Hugging Face Transformers

AWS SageMaker

Vertex AI

Weights & Biases

LangChain

Pinecone/Milvus/Weaviate

Job description

Prolific is seeking AI & Machine Learning Engineers to join our Expert Network to train and evaluate next-gen LLMs with deep technical expertise. You may complete a short test to assess fit, and, if successful, join as a paid participant for AI tasks.

Pay is competitive, with researchers offering up to $80 per hour for paid tasks requiring focused, hour-long work. Remote-friendly and flexible work hours are highlighted as part of Prolific's platform.