Remote AI Model Auditor & RLHF Specialist

prolificacademicltd; United States; Remote; USD 66,000 - 110,000; Full time

Benefits offered by this job

Remote participation

Flexible hours

Competitive pay up to $80/h

Job summary

prolificacademic ltd is seeking experienced AI/ML engineers for remote engagement in evaluating and refining next-generation language models. You will review explanations of architectures and loss functions, audit training loops, and provide high-quality feedback for RLHF workflows from home in a flexible, paid setting.

Ideal candidates have ML production experience, familiarity with transformers and modern optimization, and a strong eye for detecting hallucinations and biased outputs.

Qualifications

• BS/MS/PhD in relevant quantitative field with ML focus
• Hands-on experience building, deploying, or fine-tuning ML models
• Proficiency with neural nets: Transformers, CNNs, RNNs and optimization tech
• Experience with prompt engineering, RLHF or RAG workflows
• Strong ability to audit complex model logic and proofs
• Attention to hallucinations and biased outputs in AI content

Responsibilities

• Review AI explanations of model architectures, loss functions and backpropagation for accuracy
• Audit ML code, notebooks, training loops and evaluation pipelines
• Provide high-quality human feedback for RLHF workflows
• Evaluate chain-of-thought reasoning for reliability
• Benchmark model outputs against technical taxonomies and metrics

Skills

ML model review

Code auditing

RLHF

Prompt engineering

Chain-of-thought evaluation

Analytics

Education

BS in Computer Science or related field

MS in AI/ML or related field

PhD in CS/AI

Tools

PyTorch

TensorFlow/Keras

NumPy

Pandas

Hugging Face Transformers

AWS SageMaker

LangChain

Pinecone/Milvus/Weaviate

Job description

prolificacademic ltd is seeking experienced AI/ML engineers for remote engagement in evaluating and refining next-generation language models. You will review explanations of architectures and loss functions, audit training loops, and provide high-quality feedback for RLHF workflows from home in a flexible, paid setting.

Ideal candidates have ML production experience, familiarity with transformers and modern optimization, and a strong eye for detecting hallucinations and biased outputs.