Remote Senior Python/TypeScript Engineer

Braintrust; United States; Remote; CAD 186,000 - 205,000; Full time

Job summary

Braintrust is seeking a remote contract role to help an AI research team turn expert engineering judgment into reliable evaluation workflows. The engagement lasts about three months, with a minimum of 20 hours per week and four hours of overlap with Pacific Time.

You will design and refine evaluation rubrics and preference-data criteria, build or maintain Python or TypeScript tooling, review examples for quality, and turn findings into concise, actionable write-ups for researchers and engineers.

Qualifications

• Five+ years of professional experience with Python pipelines/infrastructure or TypeScript in a large codebase.
• Hands-on experience collecting preference data or creating evaluation rubrics.
• Strong technical judgment and clear written and verbal communication.
• Current LinkedIn profile included on resume.

Responsibilities

• Design and refine evaluation rubrics and preference-data criteria.
• Review examples with a high bar for quality, explaining subtle issues and tradeoffs.
• Build or maintain Python or TypeScript tooling and pipelines that support data collection and evaluation.
• Turn findings into concise, actionable write-ups for researchers and engineers.

Skills

Python

TypeScript

Preference data collection

Evaluation rubrics

Job description

Braintrust is seeking a remote contract role to help an AI research team turn expert engineering judgment into reliable evaluation workflows. The engagement lasts about three months, with a minimum of 20 hours per week and four hours of overlap with Pacific Time.

You will design and refine evaluation rubrics and preference-data criteria, build or maintain Python or TypeScript tooling, review examples for quality, and turn findings into concise, actionable write-ups for researchers and engineers.