Remote AI Engineer — Model Alignment & Evaluation

prolificacademicltd; United States; Remote; USD 55,000 - 110,000; Full time

Benefits offered by this job

Hourly pay up to $80

Job summary

Prolific Academic Ltd is seeking experienced AI/ML engineers to join a paid expert network for evaluating model outputs and auditing code. This remote role offers hourly compensation for completed tasks and flexible hours in a non-traditional employment setup.

Contributors apply deep technical judgment to improve model alignment and reasoning quality, with tasks ranging from examining architectures to benchmarking and bias detection. A skills assessment gates entry.

Qualifications

• BS, MS, or PhD in Computer Science, AI, Robotics, or related quantitative field.
• Hands-on experience building, deploying, or fine-tuning ML models in production.
• Knowledge of neural network architectures (Transformers, CNNs, RNNs).
• Experience with RLHF, prompt engineering, or RAG workflows.
• Ability to reason about ML proofs and audit model logic.

Responsibilities

• Review explanations of architectures, loss functions, and backpropagation for accuracy.
• Audit ML code/notebooks for correctness and efficiency.
• Provide structured feedback for RLHF and model alignment.
• Evaluate how a model reasons through chain-of-thought prompts and identify breakdowns.
• Run benchmarks across outputs against technical criteria.
• Identify hallucinations, bias, and flawed reasoning in content.

Skills

ML expertise

Prompt engineering

Code review

RLHF knowledge

Model alignment

Education

BS/MS/PhD in CS/AI/related quantitative field

Tools

PyTorch

TensorFlow/Keras

AWS SageMaker

LangChain

Pinecone/Milvus/Weaviate

Job description

Prolific Academic Ltd is seeking experienced AI/ML engineers to join a paid expert network for evaluating model outputs and auditing code. This remote role offers hourly compensation for completed tasks and flexible hours in a non-traditional employment setup.

Contributors apply deep technical judgment to improve model alignment and reasoning quality, with tasks ranging from examining architectures to benchmarking and bias detection. A skills assessment gates entry.