Senior AI Trainer & Model Auditor - Remote

prolificacademicltd; United States; Remote; USD 91,000 - 129,000; Part time

Benefits offered by this job

Remote work

Flexible hours

Onboarding with skills assessment

Job summary

prolificacademic ltd seeks Senior AI and ML engineers to join an expert contributor network. You will review, audit, and refine ML models and RLHF pipelines, focusing on accuracy, safety, and efficiency while working remotely on flexible tasks.

Ideal candidates have deep ML expertise, hands-on production experience, and strong background in Transformers and prompt engineering. Remote work offers varied, task-based assignments for experts across locations.

Qualifications

• BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with a focus on Machine Learning.
• Hands-on experience building, deploying, or fine-tuning ML models in production.
• Professional-level understanding of neural networks such as Transformers, CNNs, and RNNs, plus modern optimization techniques.
• Practical experience with prompt engineering, RLHF, or retrieval-augmented generation workflows.
• Ability to audit complex model logic, detect training data contamination, and evaluate mathematical proofs behind ML algorithms.
• High attention to detail when spotting hallucinations, biased outputs, or logical failures in AI-generated content.

Responsibilities

• Review AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
• Audit machine learning code and notebooks, including training loops, preprocessing scripts, and evaluation pipelines, for correctness and efficiency.
• Provide structured human feedback used to refine RLHF frameworks and align model behaviour with human intent, safety, and helpfulness.
• Analyse how models navigate complex chain-of-thought prompts and pinpoint where reasoning breaks down.
• Run comparative benchmark tests across model outputs using defined taxonomies and performance metrics.

Skills

Transformers

Prompt engineering

RLHF

Model evaluation

Production ML

Code review

AI safety

Education

Master's/PhD in CS or related

Tools

PyTorch

TensorFlow/Keras

NumPy

Pandas

Scikit-learn

Hugging Face Transformers

AWS SageMaker

Google Cloud Vertex AI

Weights & Biases

LangChain

Pinecone

Milvus

Weaviate

Job description

prolificacademic ltd seeks Senior AI and ML engineers to join an expert contributor network. You will review, audit, and refine ML models and RLHF pipelines, focusing on accuracy, safety, and efficiency while working remotely on flexible tasks.

Ideal candidates have deep ML expertise, hands-on production experience, and strong background in Transformers and prompt engineering. Remote work offers varied, task-based assignments for experts across locations.