Senior AI Engineer — Remote ML Audits & RLHF Expert

prolificacademicltd; United States; Remote; USD 83,000 - 110,000; Full time

Benefits offered by this job

Fully remote

Flexible hours

Skills assessment

Job summary

Prolific Academic Ltd is seeking Senior AI/ML Engineers to join a network that trains and evaluates large language models. Work is entirely remote and paid per task, offering flexible hours and short assignments that require deep technical expertise rather than full-time employment.

The role focuses on auditing model logic, RLHF refinement, and analytical benchmarking, with compensation reaching up to $80 per hour for in-demand expertise.

Qualifications

• BS/MS/PhD in Computer Science, AI, Robotics, or related quantitative field with ML focus.
• Hands-on experience building, deploying, or fine-tuning ML models in production.
• Understanding of neural networks (Transformers, CNNs, RNNs) and modern optimization techniques.
• Experience with prompt engineering, RLHF, or retrieval-augmented generation workflows.
• Ability to audit complex model logic and detect data contamination.

Responsibilities

• Review explanations of model architectures, loss functions, and backpropagation for accuracy.
• Audit ML code and notebooks for correctness and efficiency.
• Provide feedback to refine RLHF and align model behavior with safety and usefulness.
• Analyse model reasoning and identify where chain-of-thought prompts fail.
• Run benchmark tests across model outputs using defined metrics.

Skills

ML Fundamentals

Prompt Engineering

RLHF

Code Review

Education

PhD in AI/CS

MS in ML/AI

Tools

PyTorch

TensorFlow/Keras

AWS SageMaker

LangChain

Weights & Biases

Pinecone

Job description

Prolific Academic Ltd is seeking Senior AI/ML Engineers to join a network that trains and evaluates large language models. Work is entirely remote and paid per task, offering flexible hours and short assignments that require deep technical expertise rather than full-time employment.

The role focuses on auditing model logic, RLHF refinement, and analytical benchmarking, with compensation reaching up to $80 per hour for in-demand expertise.