AI Engineer - LLM Training & Evaluation (Remote)

Prolific; Memphis (TN); Hybrid; USD 90,000 - 130,000; Full time

Benefits offered by this job

Competitive pay rates

Flexible hours

Ability to work from home

Job summary

Prolific is hiring an AI & Machine Learning Engineer to train and evaluate large language models. This role requires proficiency in deep learning, analytical critique skills, and experience with technical frameworks.

Expect responsibilities such as evaluating model logic, auditing code, and refining RLHF frameworks. We offer competitive pay, flexible hours, and remote work options, ensuring you can connect with a diverse global participant pool.

Qualifications

• Education in Computer Science, Artificial Intelligence, Robotics, or related field.
• Experience building, deploying, or fine-tuning ML models.
• Hands-on experience with Prompt Engineering and RLHF workflows.

Responsibilities

• Evaluate AI-generated explanations of model architectures for accuracy.
• Validate ML-specific code for efficiency and correctness.
• Provide high-quality human feedback for aligning models with human intent.

Skills

Deep Learning Mastery

Technical Rigor

Analytical Critique

Expert proficiency in PyTorch or TensorFlow/Keras

Advanced Python (NumPy, Pandas, Scikit-learn)

Education

BS, MS, or PhD in Computer Science, AI, Robotics, or related field

Tools

AWS (SageMaker)

Google Cloud (Vertex AI)

Weights & Biases

Hugging Face Transformers

Job description

Prolific is hiring an AI & Machine Learning Engineer to train and evaluate large language models. This role requires proficiency in deep learning, analytical critique skills, and experience with technical frameworks.

Expect responsibilities such as evaluating model logic, auditing code, and refining RLHF frameworks. We offer competitive pay, flexible hours, and remote work options, ensuring you can connect with a diverse global participant pool.