Senior AI & ML Auditor for Model Alignment (Remote)

prolificacademicltd; United States; Remote; USD 55,000 - 110,000; Part time

Job summary

prolificacademic ltd is seeking senior AI and ML engineers for a flexible, remote contractor role supporting the training and evaluation of large language models. You will review explanations, audit code, and provide high-quality human feedback used to align models with human intent.

Ideal candidates hold a BS/MS/PhD in a quantitative field, have hands-on production ML experience, and are proficient with modern architectures and tooling. This is a paid hourly engagement, not a full-time position.

Qualifications

• BS/MS/PhD in Computer Science, Artificial Intelligence, Robotics, or related quantitative field with focus on ML.
• Hands-on experience building, deploying, or fine-tuning ML models in production.
• Strong understanding of neural network architectures (Transformers, CNNs, RNNs) and optimization techniques.
• Experience with prompt engineering, RLHF, or retrieval-augmented generation workflows.
• Ability to audit complex model logic, identify data contamination, and evaluate ML proofs.

Responsibilities

• Review AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
• Audit ML code and notebooks, including training loops and data preprocessing, for efficiency and correctness.
• Provide high-quality human feedback used in RLHF and alignment processes.
• Analyze how models navigate chain-of-thought prompts and identify reasoning failures.
• Conduct benchmarking between model outputs using technical taxonomies and metrics.

Skills

Transformer architectures

RLHF

Prompt engineering

Python

ML production experience

Education

PhD in Computer Science / AI

Tools

PyTorch

TensorFlow/Keras

Hugging Face Transformers

AWS SageMaker

Job description

prolificacademic ltd is seeking senior AI and ML engineers for a flexible, remote contractor role supporting the training and evaluation of large language models. You will review explanations, audit code, and provide high-quality human feedback used to align models with human intent.

Ideal candidates hold a BS/MS/PhD in a quantitative field, have hands-on production ML experience, and are proficient with modern architectures and tooling. This is a paid hourly engagement, not a full-time position.