Senior AI & ML Engineer for LLM Training (Remote)

Prolific Academic Ltd; United States; Remote; USD 91,000 - 129,000; Full time

Job summary

Prolific is seeking AI & Machine Learning Engineers to join our Expert Network to train and evaluate next-gen LLMs, using deep technical expertise. A quick test screens fit, then you join Prolific as a participant to be paid for tasks. You may work from home with flexible hours and competitive pay rates.

Roles involve evaluating architectures, auditing code and notebooks, refining RLHF frameworks, and benchmarking model outputs. Expect collaboration with researchers and data scientists globally.

Qualifications

• Education: BS, MS, or PhD in Computer Science, AI, Robotics, or related field with ML focus.
• Professional experience: build, deploy, or fine-tune ML models in production environments.
• Deep learning mastery: understand neural architectures (Transformers, CNNs, RNNs) and optimization.
• LLM specialization: experience with Prompt Engineering, RLHF, or RAG workflows.
• Technical rigor: audit model logic and data quality; analyze proofs behind ML algorithms.
• Analytical critique: detect hallucinations, bias, and failures in AI outputs.

Responsibilities

• Evaluate LLM architecture logic for technical accuracy.
• Audit ML code and notebooks for efficiency and correctness.
• Refine RLHF frameworks with high-quality human feedback.
• Analyze model reasoning and identify failure points in CoT prompts.
• Benchmark model outputs using technical taxonomies and metrics.

Skills

ML model development

LLM prompts & RLHF

Model evaluation & debugging

Prompt engineering

Critical thinking & auditing

Analytical critique

Education

BS/MS/PhD in CS/AI/Robotics with ML focus

Tools

PyTorch

TensorFlow/Keras

Hugging Face Transformers

Python (NumPy, Pandas, Scikit-learn)

Job description

Prolific is seeking AI & Machine Learning Engineers to join our Expert Network to train and evaluate next-gen LLMs, using deep technical expertise. A quick test screens fit, then you join Prolific as a participant to be paid for tasks. You may work from home with flexible hours and competitive pay rates.

Roles involve evaluating architectures, auditing code and notebooks, refining RLHF frameworks, and benchmarking model outputs. Expect collaboration with researchers and data scientists globally.