Senior AI/ML Engineer: Training & Evaluation (Remote)

Prolific; San Francisco (CA); On-site; USD 90,921 - 129,494; Full time

Job summary

Prolific is seeking an AI & Machine Learning Engineer in San Francisco to evaluate and refine AI models. The role involves auditing ML code, providing human feedback on AI frameworks, and analyzing model reasoning. Candidates should have a relevant degree and experience in deploying ML models. The position offers up to $80 per hour with flexible work-from-home hours. This is an excellent opportunity for those passionate about advancing AI and Machine Learning technologies.

Qualifications

• Education in Computer Science, AI, Robotics, or a related field focusing on Machine Learning.
• Experience deploying or fine-tuning ML models in production.
• Mastery of neural network architectures and optimization techniques.

Responsibilities

• Evaluate LLM architecture logic for technical accuracy.
• Audit code and notebooks for efficiency and correctness.
• Refine RLHF frameworks with high-quality human feedback.
• Analyze AI model reasoning and identify breakdowns.
• Benchmark performance between different model outputs.

Skills

AI model evaluation

Code auditing

RLHF frameworks

Deep Learning understanding

Analytical critique

Education

BS, MS, or PhD in Computer Science, AI, or related field

Job description

Prolific is seeking an AI & Machine Learning Engineer in San Francisco to evaluate and refine AI models. The role involves auditing ML code, providing human feedback on AI frameworks, and analyzing model reasoning. Candidates should have a relevant degree and experience in deploying ML models. The position offers up to $80 per hour with flexible work-from-home hours. This is an excellent opportunity for those passionate about advancing AI and Machine Learning technologies.