Remote AI & ML Engineer – LLM Training & Evaluation

Prolific Academic Ltd; United States; À distance; USD 83 000 - 110 000; Plein temps

Résumé du poste

Prolific is seeking AI & Machine Learning Engineers to join its Expert Network to help train and evaluate the next generation of LLMs. You will complete quick skill tests and, if successful, join Prolific as a participant paid to perform AI tasks.

Expect to audit model logic, refine RLHF frameworks, and benchmark model outputs. Strong expertise in Transformers, PyTorch or TensorFlow, Python, and RLHF/RAG workflows will be essential.

Qualifications

• Education: a BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with a focus on Machine Learning.
• Professional Experience: experience building, deploying, or fine-tuning ML models in a production environment.
• Deep Learning Mastery: knowledge of neural networks (Transformers, CNNs, RNNs) and optimization techniques.
• LLM Specialization: hands-on experience with Prompt Engineering, RLHF, or RAG workflows.
• Technical Rigor: ability to audit model logic, data contamination risks, and proofs behind ML algorithms.
• Analytical Critique: keen eye for hallucinations and biased outputs in AI content.

Responsabilités

• Evaluate LLM Architecture Logic: review AI explanations of model architectures and loss functions for technical accuracy.
• Audit Code & Notebooks: validate training loops and data preprocessing scripts for efficiency and correctness.
• Refine RLHF Frameworks: contribute high-quality human feedback to align models with human intent and safety.
• Analyze Model Reasoning: assess chain-of-thought prompts and identify where reasoning breaks down.
• Benchmark Performance: conduct comparative testing using defined technical metrics.

Connaissances

PyTorch

TensorFlow/Keras

Python

NumPy

Pandas

Scikit-learn

Hugging Face Transformers

Formation

BS in Computer Science or related

MS/PhD in AI/ML/Robotics

Description du poste

Prolific is seeking AI & Machine Learning Engineers to join its Expert Network to help train and evaluate the next generation of LLMs. You will complete quick skill tests and, if successful, join Prolific as a participant paid to perform AI tasks.

Expect to audit model logic, refine RLHF frameworks, and benchmark model outputs. Strong expertise in Transformers, PyTorch or TensorFlow, Python, and RLHF/RAG workflows will be essential.