Remote AI Engineer: LLM Alignment & Evaluation

Prolific Academic Ltd; United States; Remote; USD 96,000 - 138,000; Full time

Benefits offered by this job

Competitive pay rates

Flexible hours

Work from home

Job summary

Prolific is seeking AI and Machine Learning Engineers to join our Expert Network. You will help train and evaluate next-generation LLMs, with a quick skill test. Successful candidates can join as paid experts, with the opportunity to work remotely from home.

Roles emphasize deep learning mastery, prompt engineering, and alignment with human intent, safety, and usefulness. Compensation is competitive and tasks can vary in duration, often one hour of work.

Qualifications

• Education: a BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or related quantitative field with ML focus.
• Professional experience: building, deploying, or fine-tuning ML models in production.
• Deep Learning mastery: neural networks and optimization techniques.
• LLM specialization: Prompt Engineering, RLHF, or RAG workflows.
• Technical rigor: audit model logic and data contamination.

Responsibilities

• Evaluate LLM architecture logic for technical accuracy.
• Audit code and notebooks for ML training loops and evaluations.
• Refine RLHF frameworks with high-quality human feedback.
• Analyze model reasoning and identify where chain-of-thought breaks down.
• Benchmark performance across model outputs using specific metrics.

Skills

ML fundamentals

Neural networks

Prompt Engineering

RLHF

RAG workflows

Model evaluation

Auditing ML code

Education

BS/MS/PhD in CS/AI/Robotics

Tools

PyTorch

TensorFlow/Keras

NumPy

Pandas

Scikit-learn

Hugging Face Transformers

Job description

Prolific is seeking AI and Machine Learning Engineers to join our Expert Network. You will help train and evaluate next-generation LLMs, with a quick skill test. Successful candidates can join as paid experts, with the opportunity to work remotely from home.

Roles emphasize deep learning mastery, prompt engineering, and alignment with human intent, safety, and usefulness. Compensation is competitive and tasks can vary in duration, often one hour of work.