Remote AI/ML Engineer for LLM Training & Evaluation

Prolific; United States; Remote; USD 66,000 - 110,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Competitive pay

Job summary

Prolific is seeking an AI & ML Engineer to join our Expert Network to train and evaluate next-gen LLMs using your deep technical expertise. You'll perform paid tasks that require focused, hour-long work and contribute to high-quality AI systems.

You'll evaluate model architectures, audit code and notebooks, and refine RLHF/RAG workflows. The role offers flexible hours, remote work, and compensation up to $80 per hour for top performers.

Qualifications

• BS, MS, or PhD in Computer Science, AI, Robotics, or related quantitative field with an ML focus.
• Experience building, deploying, or fine-tuning ML models in production.
• Deep learning mastery: transformers, CNNs, RNNs, and optimization techniques.
• LLM specialization: Prompt Engineering, RLHF, or RAG workflows.
• Technical rigor: audit model logic, data contamination, and proofs behind ML algorithms.
• Analytical critique: identify hallucinations, biases, or failure modes in AI content.

Responsibilities

• Evaluate LLM architecture logic for technical accuracy.
• Audit ML code/notebooks for efficiency and correctness.
• Refine RLHF frameworks with high-quality human feedback.
• Analyze model reasoning and chain-of-thought prompts.
• Benchmark performance across models using defined metrics.

Skills

ML model development

Prompt engineering

RLHF workflows

RAG workflows

Code review

Model evaluation

Analytical thinking

Education

BS in Computer Science

MS/PhD in AI/ML

Tools

PyTorch

TensorFlow/Keras

Python (NumPy/Pandas/Scikit-learn)

Hugging Face Transformers

AWS SageMaker

Google Vertex AI

Weights & Biases

LangChain

Vector Databases (Pinecone)

Job description

Prolific is seeking an AI & ML Engineer to join our Expert Network to train and evaluate next-gen LLMs using your deep technical expertise. You'll perform paid tasks that require focused, hour-long work and contribute to high-quality AI systems.

You'll evaluate model architectures, audit code and notebooks, and refine RLHF/RAG workflows. The role offers flexible hours, remote work, and compensation up to $80 per hour for top performers.