Senior Software Engineer - Python / TypeScript

Braintrust; United States; Remote; CAD 186,000 - 205,000; Full time

Job summary

Braintrust is seeking a remote contract role to help an AI research team turn expert engineering judgment into reliable evaluation workflows. The engagement lasts about three months, with a minimum of 20 hours per week and four hours of overlap with Pacific Time.

You will design and refine evaluation rubrics and preference-data criteria, build or maintain Python or TypeScript tooling, review examples for quality, and turn findings into concise, actionable write-ups for researchers and engineers.

Qualifications

• Five+ years of professional experience with Python pipelines/infrastructure or TypeScript in a large codebase.
• Hands-on experience collecting preference data or creating evaluation rubrics.
• Strong technical judgment and clear written and verbal communication.
• Current LinkedIn profile included on resume.

Responsibilities

• Design and refine evaluation rubrics and preference-data criteria.
• Review examples with a high bar for quality, explaining subtle issues and tradeoffs.
• Build or maintain Python or TypeScript tooling and pipelines that support data collection and evaluation.
• Turn findings into concise, actionable write-ups for researchers and engineers.

Skills

Python

TypeScript

Preference data collection

Evaluation rubrics

Job description

Help an AI research team turn expert engineering judgment into reliable evaluation workflows. In this contract role, you will combine software engineering with hands-on preference-data and rubric work.

What you will do

• Design and refine evaluation rubrics and preference-data criteria.


• Review examples with a high bar for quality, explaining subtle issues and tradeoffs.


• Build or maintain Python or TypeScript tooling and pipelines that support data collection and evaluation.


• Turn findings into concise, actionable write-ups for researchers and engineers.

What we are looking for

• At least five years of professional experience in Python, especially pipelines or infrastructure, or TypeScript in a large codebase.


• Hands‑on experience collecting preference data or creating evaluation rubrics.


• Strong technical judgment and clear written and verbal communication.


• A current LinkedIn profile included on your resume

Engagement

• Remote contract for approximately three months, open to candidates in the United States or Canada.


• At least 20 hours per week, including four hours of daily overlap with Pacific Time.


• $100 per hour


• The selection process includes one approximately 30-minute technical and team conversation.