Remote AI Model Auditor & RLHF Specialist

prolificacademicltd; United States; Remote; USD 66,000 - 110,000; Full time

Benefits offered by this job

Fully remote work

Flexible hours

Job summary

Prolific Academic Ltd is offering a remote, research-oriented role for experienced AI/ML engineers to train and evaluate language models. Contributors work remotely with flexible blocks for technical review and evaluation tasks, typically in one-hour focus sessions.

The position suits senior engineers in the United States who can commit to focused blocks of ML review and provide high-quality feedback for RLHF alignment.

Qualifications

• BS, MS, or PhD in Computer Science, AI, Robotics, or related field with ML focus.
• Experience building, deploying, or fine-tuning ML models in production.
• Deep familiarity with Transformers, CNNs, and RNNs; optimization techniques.
• Hands-on with prompt engineering, RLHF, or retrieval-augmented generation (RAG).
• Attention to detail for spotting hallucinations and biased outputs.

Responsibilities

• Review explanations of model architectures, loss functions, and backpropagation for accuracy.
• Audit ML code and notebooks: training loops, preprocessing, evaluation.
• Provide high-quality human feedback for RLHF alignment.
• Analyze model reasoning on chain-of-thought prompts and flag issues.
• Conduct comparative testing across outputs using defined criteria.

Skills

ML model training

Prompt engineering

RLHF pipelines

RAG systems

Education

BS/MS/PhD in CS/AI/Robotics

Tools

PyTorch

TensorFlow/Keras

Job description

Prolific Academic Ltd is offering a remote, research-oriented role for experienced AI/ML engineers to train and evaluate language models. Contributors work remotely with flexible blocks for technical review and evaluation tasks, typically in one-hour focus sessions.

The position suits senior engineers in the United States who can commit to focused blocks of ML review and provide high-quality feedback for RLHF alignment.