Senior AI Engineer – RLHF & Model Evaluation (Remote)

prolificacademicltd; USA; Remote; USD 91.000 - 129.000; Vollzeit

Benefits dieser Stelle

Fully remote

Flexible scheduling

Short onboarding

Hourly pay up to $80

Zusammenfassung

prolificacademicltd is seeking Senior AI/ML engineers to contribute to large language model training and evaluation through paid, task-based studies. You will audit, rate, and refine model outputs, applying deep technical expertise to ensure high-quality human feedback for alignment and evaluation pipelines.

The role emphasizes production ML experience, proficiency with transformers, and hands-on work with RLHF/RAG in a fully remote setting with flexible scheduling.

Qualifikationen

• Advanced degree in CS/AI/quantitative field with ML focus.
• Production experience building, deploying, or fine-tuning ML models.
• Strong grasp of neural network architectures (Transformers, CNNs, RNNs) and optimization.
• Hands-on experience with prompt engineering, RLHF, or retrieval-augmented generation (RAG).
• Ability to audit complex model logic and assess training-data quality.
• Attention to hallucinations, biases, and logical failures in AI outputs.

Aufgaben

• Review AI-generated explanations of neural architectures, loss functions, and backpropagation for technical accuracy.
• Audit ML code and notebooks for training loops, preprocessing scripts, and evaluation routines; flag inefficiencies and bugs.
• Deliver structured RLHF feedback to improve model safety and helpfulness.
• Trace how a model navigates chain-of-thought prompts and identify reasoning breakdowns.
• Benchmark outputs against defined technical taxonomies and metrics.

Kenntnisse

Transformers

Neural architectures

Prompt engineering

RLHF

RAG

Model auditing

Evaluation

Problem solving

Ausbildung

BS/MS/PhD in CS/AI/Robotics

Tools

PyTorch

TensorFlow

Keras

Hugging Face Transformers

AWS SageMaker

Google Vertex AI

Weights & Biases

LangChain

Pinecone

Milvus/Weaviate

Jobbeschreibung

prolificacademicltd is seeking Senior AI/ML engineers to contribute to large language model training and evaluation through paid, task-based studies. You will audit, rate, and refine model outputs, applying deep technical expertise to ensure high-quality human feedback for alignment and evaluation pipelines.

The role emphasizes production ML experience, proficiency with transformers, and hands-on work with RLHF/RAG in a fully remote setting with flexible scheduling.