STEM PhD Expert for AI Reasoning & Evaluation

Braintrust; Puerto Rico; Remote; USD 124,000 - 207,000; Part time

Job summary

Braintrust is seeking PhD-level experts to help train and evaluate advanced AI models. This fully remote, flexible contract work lets you apply your domain expertise to shape how models reason, answer, and improve.

You will review AI-generated content in your field, identify where the model errs, and contribute to raising the quality bar on technical reasoning. Short-term engagement through June with potential extension.

Qualifications

• PhD (completed or in final stages) in ML/AI, CS, Engineering, Stats, or related field.
• Strong analytical and critical-thinking abilities to spot subtle errors.
• Fluent English and ability to explain complex ideas clearly.

Responsibilities

• Assess factuality and relevance of domain-specific AI outputs.
• Craft and answer questions related to Machine Learning and AI.
• Evaluate and rank domain-specific model responses.

Skills

Analytical skills

Critical thinking

English fluency

Communication skills

Education

PhD in Machine Learning/AI/CS/Engineering/Statistics

Job description

We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract work where your academic expertise directly shapes how cutting-edge models reason, answer, and improve. You'll review AI-generated content in your field, identify where the model gets things right or wrong, and help raise the quality bar on technical reasoning. This is a short-term engagement running through the end of June, with potential to extend depending on project needs.

Key Responsibilities

• Assessing the factuality and relevance of domain-specific text produced by AI models
• Crafting and answering questions related to Machine Learning and AI
• Evaluating and ranking domain-specific responses generated by AI models

What We're Looking For

• A PhD (completed or in final stages) in one of the following fields: Machine Learning / AI, Computer Science, Engineering, Statistics, or a closely related quantitative subdomain such as Mathematics or Physics
• Strong analytical and critical-thinking skills, with the ability to spot subtle errors in technical reasoning
• Fluent written English and the ability to communicate complex ideas clearly

Nice to Have

• Research experience (academic or industry)
• Prior experience with data annotation or AI model evaluation
• Experience reviewing or publishing research papers

Compensation

Up to $150/hr, depending on your area of expertise, depth of experience, and assessment performance.

Location

This role is fully remote. We are currently accepting applicants based in:

United States, Canada, Puerto Rico, Mexico, United Kingdom, Australia, New Zealand, and Argentina.