Senior AI/ML Engineer - Remote LLM Training & Evaluation

prolificacademicltd; United States; Remote; USD 66,000 - 110,000; Full time

Benefits offered by this job

Fully remote

Hourly tasks paid up to $80

Flexible contributor arrangement

Job summary

ProlificAcademic Ltd in the United States is seeking a senior AI/ML engineer to contribute to an expert network that provides critical judgement for training and evaluating large language models. The role is remote and task-based, focusing on improving model accuracy, safety, and reasoning quality.

You will review architectures, loss functions, and training loops; audit code, and deliver rigorous feedback to support RLHF and alignment efforts, with emphasis on surfacing hallucinations and

Qualifications

• BS, MS, or PhD in Computer Science, AI, Robotics, or related quantitative field focused on ML.
• Track record of building, deploying, or fine-tuning ML models in production.
• Proficiency with neural network architectures (Transformers, CNNs, RNNs) and modern optimization methods.
• Experience with LLM workflows including prompt engineering, RLHF, or RAG.
• Ability to audit model logic and detect data contamination with rigorous math scrutiny.

Responsibilities

• Assess AI-generated content for correctness in model architectures, loss functions, and backpropagation.
• Review ML codebases and notebooks, validating training loops and data pipelines.
• Deliver rigorous human feedback to inform RLHF and alignment efforts.
• Interrogate chain-of-thought reasoning to surface hallucinations and flawed logic.
• Perform benchmarking of model outputs against defined technical metrics.

Skills

Transformers

RLHF

LLM

Education

BS/MS/PhD in Computer Science or AI

Tools

PyTorch

TensorFlow

AWS SageMaker

Job description

ProlificAcademic Ltd in the United States is seeking a senior AI/ML engineer to contribute to an expert network that provides critical judgement for training and evaluating large language models. The role is remote and task-based, focusing on improving model accuracy, safety, and reasoning quality.

You will review architectures, loss functions, and training loops; audit code, and deliver rigorous feedback to support RLHF and alignment efforts, with emphasis on surfacing hallucinations and