Remote AI/ML Engineer - Train & Evaluate LLMs

Prolific Academic Ltd; United States; A distancia; USD 91.000 - 129.000; Jornada completa

Descripción de la vacante

Prolific Academic Ltd is seeking AI/ML Engineers to join our Expert Network to train and evaluate next‑gen LLMs. You will assess architectures, audit training code, and refine RLHF workflows while delivering practical, rigorous evaluations.

The role offers flexible hours and the opportunity to work from home, with paid tasks and up to $80 per hour for qualified experts. Applicants should have a strong ML background (BS/MS/PhD in a quantitative field) and hands-on experience with transformers,

Formación

• BS/MS/PhD in CS/AI/Robotics or related quantitative field with a focus on Machine Learning.
• Experience building, deploying, or fine-tuning ML models in a production environment.
• Deep learning mastery: transformers, CNNs, RNNs; optimization techniques.
• LLM specialization: Prompt Engineering, RLHF, or RAG workflows.
• Technical rigor: audit complex model logic, identify training data contamination, and evaluate proofs behind ML algorithms.
• Analytical critique: identify hallucinations, biased outputs, or logical failures in AI-generated content.

Responsabilidades

• Evaluate LLM Architecture Logic: review architecture explanations for accuracy.
• Audit Code & Notebooks: validate training loops, data preprocessing, and model evaluations.
• Refine RLHF Frameworks: contribute high-quality human feedback for alignment.
• Analyze Model Reasoning: assess chain-of-thought and identify breakdowns.
• Benchmark Performance: compare model outputs using technical metrics.

Conocimientos

Deep learning mastery

LLM specialization

Technical critique

Model auditing

Educación

BS/MS/PhD in CS/AI/Robotics

Herramientas

PyTorch

TensorFlow/Keras

Python

NumPy

Pandas

Scikit-learn

Hugging Face Transformers

AWS SageMaker

Vertex AI

Weights & Biases

LangChain

Pinecone

Milvus

Weaviate

Descripción del empleo

Prolific Academic Ltd is seeking AI/ML Engineers to join our Expert Network to train and evaluate next‑gen LLMs. You will assess architectures, audit training code, and refine RLHF workflows while delivering practical, rigorous evaluations.

The role offers flexible hours and the opportunity to work from home, with paid tasks and up to $80 per hour for qualified experts. Applicants should have a strong ML background (BS/MS/PhD in a quantitative field) and hands-on experience with transformers,