LLM AI Engineer: Train, Evaluate & Align Models

Prolific Academic Ltd; United States; Remote; USD 66,000 - 110,000; Full time

Job summary

Prolific Academic Ltd is seeking an AI & Machine Learning Engineer to join our Expert Network for training and evaluating the next generation of LLMs. You will apply deep technical expertise to review architectures, optimize training, and provide high‑quality human feedback.

Ideal candidates hold a BS/MS/PhD in CS/AI/Robotics, have production ML experience, and possess hands‑on experience with Transformers, RLHF, and RAG workflows. Remote US work with flexible hours and competitive pay.

Qualifications

• Education: BS, MS, or PhD in Computer Science, AI, Robotics, or related field with ML focus.
• Production ML experience: build, deploy, or fine-tune models in production.
• Deep learning mastery: Transformers, CNNs, RNNs, optimization techniques.
• LLM specialization: Prompt Engineering, RLHF, or RAG workflows.
• Technical rigor: audit model logic, data contamination, and proofs.
• Analytical critique: identify hallucinations and biases in AI outputs.

Responsibilities

• Evaluate LLM architecture logic for technical accuracy.
• Audit ML code and notebooks for efficiency and correctness.
• Refine RLHF frameworks to align models with human intent and safety.
• Analyze model reasoning and detect failures in chain-of-thought prompts.
• Benchmark model outputs using technical taxonomies and metrics.

Skills

ML model deployment

Auditing model logic

RLHF experience

Prompt engineering

Data analysis

Model evaluation

Education

BS/MS/PhD in CS/AI/Robotics

Tools

PyTorch

TensorFlow/Keras

Hugging Face Transformers

LangChain

Pinecone

Weaviate

Job description

Prolific Academic Ltd is seeking an AI & Machine Learning Engineer to join our Expert Network for training and evaluating the next generation of LLMs. You will apply deep technical expertise to review architectures, optimize training, and provide high‑quality human feedback.

Ideal candidates hold a BS/MS/PhD in CS/AI/Robotics, have production ML experience, and possess hands‑on experience with Transformers, RLHF, and RAG workflows. Remote US work with flexible hours and competitive pay.