AI & ML Engineer - Train & Evaluate LLMs (Remote)

Prolific Academic Ltd; United States; Remote; USD 120,000 - 190,000; Full time

Job summary

Prolific is seeking an AI & Machine Learning Engineer to join our Expert Network and help train and evaluate next‑gen LLMs with deep technical expertise. You’ll complete a quick skills test, then participate as a paid contributor, with tasks ranging up to an hour.

You’ll work from home with flexible hours and competitive pay rates. The role emphasizes evaluating architectures, auditing code and notebooks, refining RLHF workflows, and analyzing reasoning in chain-of-thought prompts.

Qualifications

• BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with a focus on Machine Learning.
• Professional experience building, deploying, or fine-tuning ML models in a production environment.
• Deep Learning mastery: transformers, CNNs, RNNs and optimization techniques.
• LLM specialization: Prompt Engineering, RLHF, or RAG workflows.
• Technical rigor: audit complex model logic, training data contamination, and proofs behind ML algorithms.
• Analytical critique: identify hallucinations, biased outputs, or logical failures in AI content.

Responsibilities

• Evaluate LLM architecture logic and technical accuracy of explanations.
• Audit ML code and notebooks for efficiency and correctness.
• Refine RLHF frameworks to align models with human intent, safety and helpfulness.
• Analyze model reasoning and CoT prompts to find failure points.
• Benchmark model outputs using defined metrics and taxonomies.

Skills

ML engineering

Transformers

RLHF

RAG workflows

Code auditing

Analytical reasoning

Education

BS/MS/PhD in CS/AI/Robotics with ML focus

Tools

PyTorch

TensorFlow/Keras

Python

Hugging Face Transformers

AWS SageMaker

Vertex AI

Weights & Biases

LangChain

Pinecone

Milvus

Weaviate

Job description

Prolific is seeking an AI & Machine Learning Engineer to join our Expert Network and help train and evaluate next‑gen LLMs with deep technical expertise. You’ll complete a quick skills test, then participate as a paid contributor, with tasks ranging up to an hour.

You’ll work from home with flexible hours and competitive pay rates. The role emphasizes evaluating architectures, auditing code and notebooks, refining RLHF workflows, and analyzing reasoning in chain-of-thought prompts.