AI/ML Engineer - LLM Training & RLHF (Remote)

Prolific Academic Ltd; United States; Remote; USD 91,000 - 129,000; Full time

Job summary

Prolific Academic Ltd. is seeking AI & Machine Learning Engineers to join our Expert Network to train and evaluate the next generation of LLMs using deep technical expertise. After a short skills test, you may join Prolific as a participant to be paid for tasks requiring about an hour.

Researchers pay up to $80 per hour for produced work. You can complete paid tasks that fit your schedule and, often, shorter durations, with the option to work from home.

Qualifications

• BS, MS, or PhD in CS/AI/Robotics with ML focus.
• Production ML model development and deployment experience.
• Deep learning architectures and optimization techniques.
• LLM workflows including Prompt Engineering, RLHF, or RAG.
• Ability to audit model logic, data contamination, and proofs.

Responsibilities

• Evaluate LLM architecture logic for accuracy.
• Audit ML training code and notebooks for correctness.
• Refine RLHF frameworks with high-quality feedback.
• Analyze model reasoning and CoT prompts for failures.
• Benchmark model outputs using defined metrics.

Skills

ML engineering

Deep learning

LLM familiarity

Model evaluation

Code auditing

Education

BS/MS/PhD in CS/AI/Robotics

Tools

PyTorch

TensorFlow/Keras

Python (NumPy PandasScikit-learn)

Hugging Face Transformers

AWS SageMaker

Google Vertex AI

Weights & Biases

LangChain

Pinecone

Milvus

Weaviate

Job description

Prolific Academic Ltd. is seeking AI & Machine Learning Engineers to join our Expert Network to train and evaluate the next generation of LLMs using deep technical expertise. After a short skills test, you may join Prolific as a participant to be paid for tasks requiring about an hour.

Researchers pay up to $80 per hour for produced work. You can complete paid tasks that fit your schedule and, often, shorter durations, with the option to work from home.