Remote AI Reasoning & Evaluation - PhD Expert

Outlier; New Zealand; Remote; NZD 292,000 - 365,000; Full time

Job summary

Outlier is hiring PhD-level experts to review and evaluate AI model content remotely. This short-term contract work shapes how models reason and improve. Review AI-generated domain-specific content, assess accuracy, and help raise the quality bar on technical reasoning.

The engagement runs through the end of June with potential extension depending on project needs, and compensation is up to $150/hour based on expertise and assessment performance.

Qualifications

• PhD completed or in final stages in ML/AI, computer science, engineering, statistics, or a closely related quantitative subdomain such as mathematics or physics.
• Strong analytical and critical-thinking skills, with the ability to spot subtle errors in technical reasoning.
• Fluent written English and the ability to communicate complex ideas clearly.

Responsibilities

• Assessing the factuality and relevance of domain-specific text produced by AI models.
• Crafting and answering questions related to Machine Learning and AI.
• Evaluating and ranking domain-specific responses generated by AI models.

Skills

Analytical thinking

Critical thinking

Fluent English

Education

PhD in ML/AI/CS/Engineering/Statistics/Math/Physics

Job description

Outlier is hiring PhD-level experts to review and evaluate AI model content remotely. This short-term contract work shapes how models reason and improve. Review AI-generated domain-specific content, assess accuracy, and help raise the quality bar on technical reasoning.

The engagement runs through the end of June with potential extension depending on project needs, and compensation is up to $150/hour based on expertise and assessment performance.