Senior AI/ML Engineer: RLHF & Model QA (Remote)

prolificacademicltd; United States; Remote; USD 66,000 - 110,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Competitive pay

Job summary

Prolific Academic Ltd offers remote expert engagements for ML researchers to review and refine AI outputs. Professionals review explanations of architectures, loss functions, and backpropagation for accuracy while auditing training loops, data preprocessing, and evaluation pipelines.

The role emphasizes providing high-quality RLHF feedback to align model behavior with human intent and to critically evaluate chain-of-thought reasoning for failures. Flexible, paid, project-based work from home.

Qualifications

• PhD or MS/BS in CS/AI/Robotics or related quantitative field with ML focus.
• Hands-on experience building, deploying, or fine-tuning ML models in production environments.
• Professional-level understanding of neural networks (Transformers, CNNs, RNNs) and modern optimization techniques.
• Practical experience with prompt engineering, RLHF, or retrieval-augmented generation (RAG).
• Strong analytical rigor to audit complex model logic and evaluate proofs.
• Attention to identifying hallucinations, biased outputs, and logical failures in AI outputs.

Responsibilities

• Review AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
• Audit ML code and notebooks, including training loops, data preprocessing scripts, and evaluation pipelines.
• Provide high-quality human feedback used in RLHF workflows to align model behavior with human intent.
• Critically evaluate chain-of-thought reasoning, identifying where AI model logic breaks down or produces flawed outputs.
• Conduct comparative benchmarking of model outputs against defined technical taxonomies and performance metrics.

Skills

Prompt engineering

RLHF

RAG workflows

Model auditing

Analytical rigor

Attention to detail

Education

B.S./M.S./Ph.D. in CS/AI/Robotics or related quantitative field

Tools

PyTorch

TensorFlow/Keras

Hugging Face Transformers

NumPy/Pandas/Scikit-learn

Job description

Prolific Academic Ltd offers remote expert engagements for ML researchers to review and refine AI outputs. Professionals review explanations of architectures, loss functions, and backpropagation for accuracy while auditing training loops, data preprocessing, and evaluation pipelines.

The role emphasizes providing high-quality RLHF feedback to align model behavior with human intent and to critically evaluate chain-of-thought reasoning for failures. Flexible, paid, project-based work from home.