Senior AI/ML Engineer — LLM Training & Evaluation (Remote)

Prolific Academic Ltd; United States; Remote; USD 66,000 - 110,000; Full time

Job summary

Prolific is seeking AI and Machine Learning Engineers to join its Expert Network to train and evaluate the next generation of LLMs with deep technical expertise. You’ll complete a 10–15 minute test to assess your skills and suitability for AI tasks, and if successful, you’ll be invited to join Prolific as a participant and get paid to train and evaluate powerful AI models.

Researchers looking for your skills tend to pay up to $80 per hour.

Qualifications

• Education in CS/AI/related quantitative field with ML focus.
• Experience building, deploying, or fine-tuning ML models in production.
• Deep learning mastery over neural nets (Transformers, CNNs, RNNs).
• Hands-on experience with Prompt Engineering, RLHF, or RAG workflows.
• Audit of model logic and data contamination detection.

Responsibilities

• Review AI explanations of architectures, losses, backpropagation for technical accuracy.
• Validate ML code, training loops and data preprocessing for efficiency.
• Provide high-quality human feedback to align models with human intent and safety.
• Assess AI reasoning in chain-of-thought prompts and identify breakdowns.
• Conduct benchmarking between model outputs using technical metrics.

Skills

ML model deployment

LLM evaluation

Prompt engineering

RLHF workflows

Code & notebook auditing

Model reasoning analysis

Education

BS/MS/PhD in CS/AI/robotics

Tools

PyTorch

TensorFlow/Keras

Hugging Face Transformers

AWS SageMaker

Vertex AI

Weights & Biases

LangChain

Pinecone/Milvus/Weaviate

Job description

Prolific is seeking AI and Machine Learning Engineers to join its Expert Network to train and evaluate the next generation of LLMs with deep technical expertise. You’ll complete a 10–15 minute test to assess your skills and suitability for AI tasks, and if successful, you’ll be invited to join Prolific as a participant and get paid to train and evaluate powerful AI models.

Researchers looking for your skills tend to pay up to $80 per hour.