Senior AI/ML Engineer - Training & Evaluation (Remote)

Prolific Academic Ltd; Oxford; Hybrid; GBP 62,000 - 92,000; Full time

Job summary

Prolific Academic Ltd seeks an AI/ML Engineer to join our Expert Network for training and evaluating next‑gen LLMs. You’ll work on high‑stakes tasks, review architectures, and refine RLHF and RAG workflows. Remote work from the UK with competitive hourly pay and flexible hours.

Ideal candidates have hands‑on DL, Python, and ML deployment experience, plus strong analytical skills to audit data and model outputs. Join us to shape safer, smarter AI in collaboration with researchers worldwide.

Qualifications

• BS, MS or PhD in CS/AI/Robotics or related quantitative field with ML focus.
• Production ML experience: build, deploy or fine-tune models.
• Deep learning expertise: Transformers/CNNs/RNNs and optimization.
• Hands-on with Prompt Engineering, RLHF or RAG workflows.
• Ability to audit model logic and data quality; detect data contamination.
• Strong analytical critique for hallucinations and incorrect outputs.

Responsibilities

• Evaluate LLM architecture logic and validate technical accuracy of explanations.
• Audit ML code/notebooks for efficiency and correctness.
• Refine RLHF frameworks to align models with human intent and safety.
• Analyze model reasoning and identify failure points in CoT prompts.
• Benchmark model outputs using technical taxonomies and metrics.

Skills

Education in CS/AI/Robotics

Production ML experience

Deep learning architectures

LLM workflows

Model auditing & critique

Error analysis & hallucination checks

Education

BS in Computer Science / AI

MS in AI/ML or PhD preferred

Tools

PyTorch

TensorFlow/Keras

Hugging Face Transformers

AWS SageMaker

Vertex AI

Weights & Biases

LangChain

Pinecone

Milvus / Weaviate

Job description

Prolific Academic Ltd seeks an AI/ML Engineer to join our Expert Network for training and evaluating next‑gen LLMs. You’ll work on high‑stakes tasks, review architectures, and refine RLHF and RAG workflows. Remote work from the UK with competitive hourly pay and flexible hours.

Ideal candidates have hands‑on DL, Python, and ML deployment experience, plus strong analytical skills to audit data and model outputs. Join us to shape safer, smarter AI in collaboration with researchers worldwide.