Remote AI Model Alignment Researcher (RLHF)

prolificacademicltd; United States; Remote; USD 66,000 - 110,000; Part time

Job summary

Prolific Academic Ltd is seeking an expert in machine learning to participate in paid contract work evaluating and training large language models. You will review model architectures and training components, provide structured feedback, and help ensure high-quality reasoning and safety across tasks.

The role offers fully remote scheduling with study-based tasks, typically up to one hour each, and compensation up to $80 per hour depending on study requirements.

Qualifications

• Bachelor's, Master's or PhD in Computer Science, AI, Robotics or related quantitative field with ML focus.
• Hands-on production experience building, deploying, or fine-tuning ML models.
• Strong understanding of neural networks incl. Transformers, CNNs and RNNs with optimization knowledge.
• Experience with prompt engineering, RLHF or retrieval-augmented generation (RAG).
• Ability to audit model logic and assess training-data quality for correctness.

Responsibilities

• Review explanations of architectures, loss functions, and backpropagation for technical accuracy.
• Audit ML code, training loops, preprocessing scripts, and evaluation notebooks for efficiency and accuracy.
• Provide structured feedback for RLHF workflows and model alignment tasks.
• Assess how models handle complex chain-of-thought prompts and identify reasoning gaps.
• Benchmark model outputs against defined technical taxonomies and metrics.

Skills

ML model development

Attention to detail

RLHF workflows

Model evaluation

Prompting

Education

BS/MS/PhD in CS/AI/ML

Tools

PyTorch

TensorFlow/Keras

NumPy/Pandas/Scikit-learn

Hugging Face Transformers

Cloud ML platforms

Job description

Prolific Academic Ltd is seeking an expert in machine learning to participate in paid contract work evaluating and training large language models. You will review model architectures and training components, provide structured feedback, and help ensure high-quality reasoning and safety across tasks.

The role offers fully remote scheduling with study-based tasks, typically up to one hour each, and compensation up to $80 per hour depending on study requirements.