Remote AI & ML Engineer for LLM Training & Evaluation

Prolific; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Prolific is seeking AI & Machine Learning Engineers to join its Expert Network to train and evaluate the next generation of LLMs using deep technical expertise. If successful, you’ll be invited to join Prolific as a participant, where you’ll get paid to train and evaluate powerful AI models.

This role emphasizes evaluating architectures, auditing code, RLHF frameworks, and RAG workflows, with up to $80 per hour paid tasks. You’ll be remote with flexible hours and the ability to work from home.

Qualifications

• :"BS/MS/PhD in Computer Science, AI, Robotics, or related field with ML focus.",

Responsibilities

• Evaluate LLM architecture logic for technical accuracy.
• Audit ML-specific code and notebooks for efficiency and correctness.
• Refine RLHF frameworks with high-quality human feedback.
• Analyze model reasoning and breakdowns in chain-of-thought prompts.
• Benchmark performance across model outputs using defined metrics.
• Collaborate with researchers and participants to improve models.

Skills

ML model deployment

LLM expertise

Transformers

RLHF

RAG workflows

Code audit

Audit complex model logic

Education

BS/MS/PhD in CS/AI/Robotics

Tools

PyTorch

TensorFlow

Keras

Hugging Face

Python

NumPy/Pandas

Scikit-learn

SageMaker

Vertex AI

Weights & Biases

LangChain

Pinecone

Milvus

Weaviate

Job description

Prolific is seeking AI & Machine Learning Engineers to join its Expert Network to train and evaluate the next generation of LLMs using deep technical expertise. If successful, you’ll be invited to join Prolific as a participant, where you’ll get paid to train and evaluate powerful AI models.

This role emphasizes evaluating architectures, auditing code, RLHF frameworks, and RAG workflows, with up to $80 per hour paid tasks. You’ll be remote with flexible hours and the ability to work from home.