PhD-Level AI Model Evaluator & Domain Expert (Remote)

Braintrust; United States; Remote; AUD 173,000 - 288,000; Part time

Job summary

Braintrust is seeking PhD-level experts to help train and evaluate advanced AI models. This fully remote, flexible contract work shapes how models reason, answer, and improve.

You will review AI-generated content in your field, identify where the model is correct or incorrect, and help raise the quality bar on technical reasoning. The short-term engagement runs through the end of June, with potential to extend.

Qualifications

• PhD completed or near completion in ML/AI, CS, engineering, statistics or related field.
• Strong analytical and critical-thinking abilities to spot subtle errors in technical reasoning.
• Fluent written English for clear technical communication.
• Nice-to-have: research experience and data annotation or model evaluation.

Responsibilities

• Assessing the factuality and relevance of domain-specific text produced by AI models.
• Crafting and answering questions related to Machine Learning and AI.
• Evaluating and ranking domain-specific responses generated by AI models.

Skills

Analytical thinking

Critical thinking

Fluent English writing

Education

PhD in ML/AI/CS/Engineering/Statistics or related

Job description

Braintrust is seeking PhD-level experts to help train and evaluate advanced AI models. This fully remote, flexible contract work shapes how models reason, answer, and improve.

You will review AI-generated content in your field, identify where the model is correct or incorrect, and help raise the quality bar on technical reasoning. The short-term engagement runs through the end of June, with potential to extend.