Senior AI Engineer - Remote ML Training & Evaluation

Prolific; United States; Remote; USD 91,000 - 129,000; Full time

Benefits offered by this job

Competitive pay rates

Flexible hours

Work from home

Job summary

Prolific is seeking AI & Machine Learning Engineers to join its Expert Network to train and evaluate the next generation of LLMs. The role involves performing paid, task-based work with flexible hours and remote opportunities, using deep technical expertise in ML and AI systems.

You will evaluate model architectures, audit code and notebooks, refine RLHF frameworks, and assess model reasoning across CoT prompts, delivering high-quality human feedback to improve AI performance.

Qualifications

• BS, MS, or PhD in Computer Science, AI, Robotics, or related field with ML focus.
• Experience building, deploying, or fine-tuning ML models in production.
• Deep learning mastery with transformers, CNNs, RNNs.
• Hands-on experience with Prompt Engineering, RLHF, or RAG workflows.
• Ability to audit model logic and detect data contamination.
• Strong analytical critique of AI outputs and reasoning.

Responsibilities

• Evaluate LLM architecture logic for technical accuracy.
• Audit ML code and notebooks for efficiency and correctness.
• Refine RLHF frameworks to align models with human intent and safety.
• Analyze model reasoning and identify failure points in CoT prompts.
• Benchmark model outputs using technical taxonomies and metrics.

Skills

ML model development

LLM evaluation

Prompt engineering

RLHF

RAG workflows

Model auditing

Error analysis

Education

BS in CS/AI/Robotics

MS/PhD in relevant field

Tools

PyTorch

TensorFlow/Keras

Hugging Face Transformers

AWS SageMaker

Vertex AI

Weights & Biases

LangChain

Pinecone

Milvus

Weaviate

Job description

Prolific is seeking AI & Machine Learning Engineers to join its Expert Network to train and evaluate the next generation of LLMs. The role involves performing paid, task-based work with flexible hours and remote opportunities, using deep technical expertise in ML and AI systems.

You will evaluate model architectures, audit code and notebooks, refine RLHF frameworks, and assess model reasoning across CoT prompts, delivering high-quality human feedback to improve AI performance.