Remote AI/ML Engineer for LLM Training & Evaluation

Prolific Academic Ltd; United States; Remote; USD 55,000 - 110,000; Full time

Benefits offered by this job

Competitive pay rates

Flexible hours

Work from home

Job summary

Prolific is seeking AI and Machine Learning Engineers to join our Expert Network to help train and evaluate the next generation of LLMs using deep technical expertise. If successful, you'll be invited to join Prolific as a participant, paid to train and evaluate powerful AI models.

You'll work on evaluating architectures, auditing code and notebooks, refining RLHF frameworks, and analyzing model reasoning. Competitive pay, flexible hours, and the option to work from home are offered.

Qualifications

• Advanced degree in a quantitative field with ML focus or equivalent professional experience.
• Experience building, deploying, or fine-tuning ML models in production.
• Deep learning mastery with neural architectures (Transformers, CNNs, RNNs) and optimization.
• Hands-on experience with Prompt Engineering, RLHF, or RAG workflows.
• Ability to audit model logic, detect data contamination, and prove ML concepts.

Responsibilities

• Evaluate LLM architecture logic for technical accuracy.
• Audit ML code and notebooks for efficiency and correctness.
• Refine RLHF frameworks to align models with human intent and safety.
• Analyze model reasoning and identify where prompts break down.
• Benchmark model outputs using technical taxonomies and metrics.

Skills

Transformer/LLM understanding

Prompt Engineering

RLHF knowledge

RAG workflows

Code audit / debugging

Attention to detail

Education

BS/MS/PhD in CS/AI/Robotics or related

Tools

PyTorch

TensorFlow/Keras

Python (NumPy, Pandas, scikit-learn)

Hugging Face Transformers

AWS SageMaker

Vertex AI

Weights & Biases

LangChain

Pinecone

Job description

Prolific is seeking AI and Machine Learning Engineers to join our Expert Network to help train and evaluate the next generation of LLMs using deep technical expertise. If successful, you'll be invited to join Prolific as a participant, paid to train and evaluate powerful AI models.

You'll work on evaluating architectures, auditing code and notebooks, refining RLHF frameworks, and analyzing model reasoning. Competitive pay, flexible hours, and the option to work from home are offered.