Senior AI Engineer: RLHF & Model Auditing (Remote)

prolificacademicltd; USA; Remote; USD 91.000 - 129.000; Teilzeit

Benefits dieser Stelle

Remote work

Flexible hours

Zusammenfassung

Prolific Academic Ltd. is seeking senior AI and Machine Learning Engineers to join an expert contributor network focused on training and evaluating next-generation large language models. Tasks vary from quick audits to sessions up to one hour, with fully remote, schedule-flexible work.

You'll review model architectures, audit code, and deliver high-quality feedback to power RLHF pipelines, helping improve alignment, safety, and helpfulness in production systems.

Qualifikationen

• Bachelor's/Master's/PhD in CS/AI/Robotics with ML focus.
• Production experience building, deploying, or fine-tuning ML models.

Aufgaben

• Review AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy
• Audit ML code and notebooks, including training loops, preprocessing scripts, and evaluation routines, for correctness and efficiency
• Deliver high-quality human feedback that powers RLHF pipelines and improves model alignment, safety, and helpfulness
• Critically assess chain-of-thought reasoning and identify exactly where model logic breaks down
• Run comparative benchmarks across model outputs using defined technical taxonomies and performance metrics

Kenntnisse

Production experience ML models

Transformers, CNNs, RNNs and optim.

Prompt engineering, RLHF, RAG

Audit model logic and data quality

Attention to detail on AI outputs

Ausbildung

Bachelor's/Master's/PhD in CS/AI/Robotics with ML focus

Tools

PyTorch

TensorFlow/Keras

Python (NumPy, Pandas, scikit-learn)

Hugging Face Transformers

AWS SageMaker

Google Vertex AI

Weights & Biases

LangChain

Pinecone

Milvus

Weaviate

Jobbeschreibung

Prolific Academic Ltd. is seeking senior AI and Machine Learning Engineers to join an expert contributor network focused on training and evaluating next-generation large language models. Tasks vary from quick audits to sessions up to one hour, with fully remote, schedule-flexible work.

You'll review model architectures, audit code, and deliver high-quality feedback to power RLHF pipelines, helping improve alignment, safety, and helpfulness in production systems.