Remote AI/ML Engineer for LLM Alignment & Evaluation

prolificacademicltd; United States; Remote; USD 55,000 - 110,000; Full time

Benefits offered by this job

Hourly pay up to $80

Job summary

prolificacademic ltd invites experienced AI and ML engineers to join a paid expert network that supports the training and evaluation of large language models. Contributors apply deep technical judgment to assess model outputs, audit code, and provide structured human feedback that improves model alignment and reasoning quality.

This is a flexible, remote participant role based in the United States, with hourly compensation for completed tasks.

Qualifications

• BS/MS/PhD in Computer Science, AI, Robotics, or related quantitative field with ML focus.
• Hands-on experience building, deploying, or fine-tuning ML models in production.
• Knowledge of Transformer, CNNs, RNN architectures and optimization techniques.
• Experience with RLHF or retrieval-augmented generation (RAG) workflows.
• Ability to reason about mathematical proofs behind ML algorithms and audit model logic.
• Attention to detail when spotting hallucinations, biases, or logical failures.

Responsibilities

• Review AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
• Audit ML code and notebooks, including training loops, preprocessing scripts, and evaluation routines, for correctness and efficiency.
• Supply structured human feedback used to refine RLHF processes and improve model alignment, safety, and helpfulness.
• Critically evaluate how a model reasons through chain-of-thought prompts and pinpoint where the logic breaks down.
• Run comparative benchmarks across model outputs against defined technical taxonomies and performance criteria.
• Identify hallucinations, bias, training-data contamination, and flawed mathematical reasoning in AI-generated content.

Skills

ML model development

Python programming

Neural networks

RLHF / RL methods

Prompt engineering

Code auditing

Education

PhD in CS or related field

Tools

PyTorch

TensorFlow/Keras

AWS SageMaker

LangChain

Vector DBs (Pinecone/Milvus/Weaviate)

Job description

prolificacademic ltd invites experienced AI and ML engineers to join a paid expert network that supports the training and evaluation of large language models. Contributors apply deep technical judgment to assess model outputs, audit code, and provide structured human feedback that improves model alignment and reasoning quality.

This is a flexible, remote participant role based in the United States, with hourly compensation for completed tasks.