AI Model Evaluation Scientist (PhD) — Remote Contract

Braintrust; Puerto Rico; On-site; USD 124,000 - 207,000; Part time

Job summary

Braintrust is seeking PhD-level experts to help train and evaluate advanced AI models. This fully remote, flexible contract role lets you apply domain expertise to shape how models reason, answer, and improve.

You will review AI-generated content in your field, identify where the model is right or wrong, and raise the quality bar on technical reasoning. The engagement runs through the end of June, with potential to extend depending on project needs.

Qualifications

• PhD in ML/AI/CS/Engineering/Statistics or related field.
• Strong analytical and critical-thinking abilities.
• Fluent written English with clear communication.

Responsibilities

• Assessing the factuality and relevance of domain-specific text produced by AI models
• Crafting and answering questions related to Machine Learning and AI
• Evaluating and ranking domain-specific responses generated by AI models

Skills

Analytical thinking

Critical thinking

Fluent English

Education

PhD in ML/AI/CS/Engineering/Statistics or related field

Job description

Braintrust is seeking PhD-level experts to help train and evaluate advanced AI models. This fully remote, flexible contract role lets you apply domain expertise to shape how models reason, answer, and improve.

You will review AI-generated content in your field, identify where the model is right or wrong, and raise the quality bar on technical reasoning. The engagement runs through the end of June, with potential to extend depending on project needs.