Senior AI Engineer - ML Audits & RLHF (Remote)

prolificacademicltd; USA; Remote; USD 91.000 - 129.000; Vollzeit

Benefits dieser Stelle

Up to $80/hour

Fully remote

Flexible hours

Skills assessment onboarding

Zusammenfassung

Prolific Academic Ltd seeks Senior AI and Machine Learning Engineers to join an expert contributor network. You will work remotely on flexible hours, reviewing explanations, auditing code, and providing feedback to refine RLHF and model alignment with human intent and safety.

The role focuses on deep technical assessment rather than full‑time employment, with opportunities to evaluate model performance, compare outputs, and contribute to cutting‑edge AI research tasks across production systems.

Qualifikationen

• BS/MS/PhD in Computer Science, Artificial Intelligence, Robotics, or related quantitative field with a focus on Machine Learning.
• Hands-on experience building, deploying, or fine-tuning machine learning models in a production environment.
• Professional-level understanding of neural network architectures such as Transformers, CNNs, and RNNs, plus modern optimisation techniques.
• Practical experience with prompt engineering, RLHF, or retrieval-augmented generation workflows.
• Ability to audit complex model logic, detect training data contamination, and evaluate mathematical proofs behind ML algorithms.
• High attention to detail when spotting hallucinations, biased outputs, or logical failures in AI-generated technical content.

Aufgaben

• Review AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
• Audit machine learning code and notebooks, including training loops, preprocessing scripts, and evaluation pipelines, for correctness and efficiency.
• Provide structured human feedback used to refine RLHF frameworks and align model behaviour with human intent, safety, and helpfulness.
• Analyse how models navigate complex chain-of-thought prompts and pinpoint where reasoning breaks down.
• Run comparative benchmark tests across model outputs using defined taxonomies and performance metrics.

Kenntnisse

Hands-on ML deployment

Transformers

Prompt engineering

RLHF

Model evaluation

Ausbildung

BS/MS/PhD in CS/AI/related field

Tools

PyTorch

TensorFlow/Keras

Hugging Face

LangChain

Weaviate/Pinecone

Jobbeschreibung

Prolific Academic Ltd seeks Senior AI and Machine Learning Engineers to join an expert contributor network. You will work remotely on flexible hours, reviewing explanations, auditing code, and providing feedback to refine RLHF and model alignment with human intent and safety.

The role focuses on deep technical assessment rather than full‑time employment, with opportunities to evaluate model performance, compare outputs, and contribute to cutting‑edge AI research tasks across production systems.